summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-07-13[doc] add image example to benchmark with python pagedrebs
2017-07-13[docs] add code example for plotting elasticsearch with pythondrebs
2017-07-13[doc] add info on how to update benchmarks websitedrebs
2017-07-13[doc] show second level in main docdrebs
2017-07-13[benchmarks] change 20_500k to 10_1000kdrebs
2017-07-12[doc] add reference, move deprecationdrebs
2017-07-12[doc] add a contributing pagedrebs
2017-07-12[doc] add explanation on how to run benchmark testsdrebs
2017-07-12[doc] mark which sync benchmark scenarios are actually rundrebs
2017-07-12[doc] clarify what we mean with "big data set"drebs
2017-07-12[doc] update documentation on benchmark testsdrebs
Closes: #8885.
2017-07-12[benchmarks] limit number of runs of sqlcipher benchmark testsdrebs
As sqlcipher benchmark tests take longer, we want to limit the number of repetitions. Previous to this change, these tests were being calibrated automatically and would run 5 times becuase it is the default minimum number of times for pytest-benchmark. By changing the runner to pedantic mode, now they will be run 4 times, the same number of times as benchmark sync tests.
2017-07-12[benchmarks] allow passing args and kwargs to txbenchmark_with_setupdrebs
2017-07-11[doc] unify benchmark pagesdrebs
2017-07-11[doc] factor dev and ref out of main pagedrebs
2017-07-11[doc] fix changelog levelsdrebs
2017-07-10[doc] limit depth of tocdrebs
2017-07-10[benchmarks] checkout script for bundled pysqlcipherdrebs
2017-07-09[benchmarks] import the correct script for setting up envdrebs
2017-07-09[benchmarks] separate memory sampling from cpu measurementdrebs
2017-07-09[benchmarks] fix branch for checking out setup scriptdrebs
2017-07-09[benchamrks] fix .gitlab-ci.ymldrebs
2017-07-09[benchmarks] checkout benchmark-all-commits script before using itdrebs
2017-07-08[benchmarks] setup env for benchmark-all-commits earlierdrebs
2017-07-08[benchmarks] properly pass environment variable to gitlab-runnerdrebs
2017-07-08[benchmark] setup env for benchmark-all-commits conditionallydrebs
2017-07-08[benchmarks] run benchmarks twice, for time and resourcesdrebs
We noticed that instrumentation added for watching resources has an impact in time statistics (i.e. it increases average and stddev). This commit makes the benchmark tests run twice: once for measuring time and a second time for measuring resources.
2017-07-08[benchmarks] add --watch-resources optiondrebs
This commit adds the --watch-resources command line option for benchmarks tests, and allows to running the benchmark test suite with and without resource monitoring instrumentation code. This is needed because resource consumption monitoring impacts the mean time and standard deviation of time taken to run benchmarked tests.
2017-07-08[benchmarks] avoid reinstalling pysqlcipher if unneededdrebs
pysqlcipher just has to be reinstalled for benchmark tests if current installed version fails the HAVE_USLEEP flag test. This commit moves the code for checking and reinstalling to a script and bypasses the reinstallation when it is unneeded.
2017-07-08[benchmarks] skip some tests by defaultdrebs
2017-07-08[feat] use OpenSSL backend for scrypt if availableKali Kaneko
This needs OpenSSL >= 1.1, otherwise it will keep using the scrypt dependency. We should think about deprecating scrypt as a dependency when we can be sure that the adoption of libssl 1.1 is wide enough. I think that at some point (soledad 0.11 or so) we can drop the scrypt dependency, which was being somehow problematic at times (the _scrypt.so was not appearing when installing with pip, needed workarounds). From that moment on, we can raise an error if an old libssl is found and no scrypt can be imported - leaving that to the user/packager. In debian stretch and afterwards, you can get that version by installing libssl-dev - Related: #8472
2017-07-07[pkg] workaround multiline bug in .gitlab-ci.ymldrebs
2017-07-07[doc] add doc on benchmark sync tests sizesdrebs
Closes: #8884
2017-07-07[benchmarks] move adbapi tuning script to benchmark scripts folderdrebs
2017-07-07[benchmarks] use new gitlab ci variable namesdrebs
2017-07-07[benchmarks] add README to benchmark-all-commitsdrebs
2017-07-07[benchmarks] record start and end timestamp when benchmarking all commitsdrebs
2017-07-07[benchmarks] stop benchmarking-all-commits when first commit is reacheddrebs
2017-07-07[benchmarks] move benchmark-all-commits script to scripts dirdrebs
2017-07-07[benchmarks] Set a timeout of 2 hours for docker jobs.drebs
2017-07-07[benchmarks] Checkout check-pysqlcipher script because older commits don't ↵drebs
have it.
2017-07-07[benchmarks] Add timestamp, commit id and exit status to results.txtdrebs
2017-07-07[benchmarks] Fix script name inside .gitlab-ci.ymldrebs
2017-07-07[benchmarks] Fix script name.drebs
2017-07-07[benchmarks] Use script to tune adbapi parameters istead of cherry-pick.drebs
2017-07-07[benchmarks] Cherry pick tuned adbapi parameters before running tests.drebs
2017-07-07[benchmarks] All PRs got mergedvarac
2017-07-07[benchmarks] Ignore failed commitsvarac
2017-07-07[benchmarks] Fetch files from the futurevarac
2017-07-07[benchmarks] Show pytest-benchmark git remote in tox.inivarac