summaryrefslogtreecommitdiff
path: root/testing/tests/conftest.py
AgeCommit message (Collapse)Author
2017-09-11[test] add --subdir option and blacklistdrebs
Use subdir path to select/deselect benchmark tests. Because of the way pytest and pytest benchamrk select/deselect tests, it makes more sense for this test suite to use a --subdir option to select only a subset of tests and a blacklist of subdirectories that should not be run unless explicitelly asked to. This commit adds a --subdir option, that will deselect all tests no in ./tests/<subdir> when the option is passed to pytest. Also, a blacklist is added so, unless explicitelly added as a --subdir, tests in blacklisted subdirectories will not be run. The reasons for this modification are: - pytest-benchmarks selects/deselects tests based on the type of their fixtures. This means that fixtures have to be instantiated previous to test selection/deselection, something that may cause side effects that we want to avoid. - the usual test suite is run for all benchmarks, while some tests should only be run in specific situations (as is the case of benchmarks and responsiveness tests). It is saner to implement subdir selection than marking all tests with pytest marks and using them to select/deselect.
2017-09-11[benchmarks] post responsiveness tests to elasticsearchdrebs
2017-09-11[benchmarks] add responsiveness test with watchdogdrebs
2017-09-08[test] allow test_vs_legacy test to run with remote serverdrebs
2017-09-05[test] use indexes in clean client's dbsdrebs
2017-09-05[style] improve naming and fixes from code reviewVictor Shyba
-- Related: #8867
2017-08-31[test] pass config file in environment variabledrebs
2017-08-25[test] enable blobs in soledad server for testsdrebs
2017-08-23[test] find correct twistd when outside tox envsdrebs
2017-08-23[bug] retain tempdir name in soledad server fixturedrebs
2017-07-09[benchmarks] separate memory sampling from cpu measurementdrebs
2017-07-08[benchmarks] run benchmarks twice, for time and resourcesdrebs
We noticed that instrumentation added for watching resources has an impact in time statistics (i.e. it increases average and stddev). This commit makes the benchmark tests run twice: once for measuring time and a second time for measuring resources.
2017-07-07[test] mark tests that depend on couchdb serverdrebs
2017-04-27[test] add memory measurementdrebs
2017-04-27[test] measure cpu percentage during benchmarkdrebs
2017-04-04[feat] add the host hostname to benchmark machine infodrebs
2017-03-17[test] Prepare tests for python3 compatibilityefkin
2017-03-02[test] improve twistd startup and terminationdrebs
- use subprocess.check_call() to ensure any errors during twistd startup will properly show up on test reports. - use SIGTERM instead of SIGKILL to gracefully terminate twistd.
2017-03-02[test] bugfix: actually use an empty local db in download benchmarksdrebs
We were previously not using an empty local db for download benchmark tests, so there was actually nothing to sync. This commit fixes that by adding a way to force an empty local db on soledad client instantiation.
2017-03-02[test] use new way of indicating the tcp port for twisted webdrebs
2017-02-09[refactor] move wsgi sync setup to its own moduledrebs
Conflicts: server/src/leap/soledad/server/_wsgi.py server/src/leap/soledad/server/entrypoint.py server/src/leap/soledad/server/resource.py testing/tests/server/test__resource.py
2016-12-12[refactor] separate server application into another filedrebs
2016-12-12[test] move fixtures one level updrebs
2016-09-30[test] use pytest tmpdir fixture in all testsdrebs
Tests that were imported from u1db or created on top of that structure were leaving temporary directories behind. This could cause problems in test servers, either by filling the partition or by extrapolating the maximum amount of files in a directory. This commit replaces all usages of temporary directories in the old test structure by pytest tmpdir fixture, which properly cares for removing temporary directories.
2016-08-01[test] allow custom couch url for couch testsdrebs