ZipMessage Tests Commands

When we overhauled and improved our tests suite in October 2022, Aarthi set up the following commands to run our tests.

Brian set up terminal shortcuts on his macs for each of these commands (those are noted below each command for Brian's reference).

Run all tests in parallel + retest failures once

Runs all tests, including all feature tests, using the parellel test run system.

After running all, this command will also re-run the failures, once.

/bin/bash run_specs_parallelly.sh all

Brian's terminal shortcut: zmtests_all

Run all tests except for feature tests

Since feature tests are slower to run and fail more often, we can exclude them and run all of our non-feature tests using this command. Runs in parallel.

/bin/bash run_specs_parallelly.sh non_feature_specs

Brian's terminal shortcut: zmtests_non_features

Run all tests with important tag, except for feature tests

We can narrow down our non-feature tests run only to those with important tag using this command. Runs in parallel.

/bin/bash run_specs_parallelly.sh important_non_feature_specs

Brian's terminal shortcut: zmtests_important_non_features

Run all important tests in parallel

Run all tests with important tag, including both feature and non-feature tests. Runs in parallel.

/bin/bash run_specs_parallelly.sh important

Brian's terminal shortcut: zmtests_important

Run all stripe tests in parallel

Runs all tests related to Stripe, which are those that have the stripe tag. This includes some tests that also have stripe_live, which hits the Stripe API (doesn't use stubs) and uses Stripe Test Mode. Our tests clean up after themselves by deleting Stripe Test mode data after running.

/bin/bash run_specs_parallelly.sh stripe

Brian's terminal shortcut: zmtests_stripe

Run all throttling tests in parallel

These are tests that take extra time to run, so we can test these separately using this:

/bin/bash run_specs_parallelly.sh throttling

Brian's terminal shortcut: zmtests_throttled

Run only feature tests in non-parallel

Runs all feature tests (all tests inside features folder) and runs them in a single process, not in parallel. This is slower to run, but more reliable as feature tests sometimes have failures only when run in parellel.

bundle exec rspec spec/features

Brian's terminal shortcut: zmtests_features

Run only important feature tests in non-parallel

Runs all feature tests that have important tag and runs them in a single process, not in parallel. This is slower to run, but more reliable as feature tests sometimes have failures only when run in parellel.

bundle exec rspec spec/features -t important

Brian's terminal shortcut: zmtests_important_features