soledad.git/testing/tests/benchmarks, branch 8938

[test] allow test_vs_legacy test to run with remote server

2017-09-08T11:14:19+00:00

[test] refactor and fixes for blobs vs legacy test

2017-09-05T14:17:51+00:00

- create payloads before running tests
- use different group names for different amount/sizes
- move legacy index creation to setup function
- limit concurrency on blobmanager to 2 (same as thread pool size)
- add a VACUUM call to observe blobs db size decreasing between tests
- properly cleanup server between blobs test runs
- refactor blobs pipeline so it makes more sense and is easier to read

[test] use semaphore in legacy vs blobs test

2017-08-31T13:48:17+00:00

[benchmarks] add legacy mail delivery test

2017-08-25T16:11:13+00:00

[benchmarks] add docstrings for benchmarks

2017-07-18T16:51:09+00:00

[benchmarks] store test function docstring

2017-07-18T16:51:08+00:00

[doc] add info on how to update benchmarks website

2017-07-13T16:02:10+00:00

[benchmarks] change 20_500k to 10_1000k

2017-07-13T14:27:57+00:00

[doc] mark which sync benchmark scenarios are actually run

2017-07-12T18:11:35+00:00

[benchmarks] limit number of runs of sqlcipher benchmark tests

2017-07-12T15:29:45+00:00

As sqlcipher benchmark tests take longer, we want to limit the number of
repetitions. Previous to this change, these tests were being calibrated
automatically and would run 5 times becuase it is the default minimum
number of times for pytest-benchmark. By changing the runner to pedantic
mode, now they will be run 4 times, the same number of times as
benchmark sync tests.