summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-07-12[doc] clarify what we mean with "big data set"drebs
2017-07-12[doc] update documentation on benchmark testsdrebs
Closes: #8885.
2017-07-12[benchmarks] limit number of runs of sqlcipher benchmark testsdrebs
As sqlcipher benchmark tests take longer, we want to limit the number of repetitions. Previous to this change, these tests were being calibrated automatically and would run 5 times becuase it is the default minimum number of times for pytest-benchmark. By changing the runner to pedantic mode, now they will be run 4 times, the same number of times as benchmark sync tests.
2017-07-12[benchmarks] allow passing args and kwargs to txbenchmark_with_setupdrebs
2017-07-11[doc] unify benchmark pagesdrebs
2017-07-11[doc] factor dev and ref out of main pagedrebs
2017-07-11[doc] fix changelog levelsdrebs
2017-07-10[doc] limit depth of tocdrebs
2017-07-10[benchmarks] checkout script for bundled pysqlcipherdrebs
2017-07-09[benchmarks] import the correct script for setting up envdrebs
2017-07-09[benchmarks] separate memory sampling from cpu measurementdrebs
2017-07-09[benchmarks] fix branch for checking out setup scriptdrebs
2017-07-09[benchamrks] fix .gitlab-ci.ymldrebs
2017-07-09[benchmarks] checkout benchmark-all-commits script before using itdrebs
2017-07-08[benchmarks] setup env for benchmark-all-commits earlierdrebs
2017-07-08[benchmarks] properly pass environment variable to gitlab-runnerdrebs
2017-07-08[benchmark] setup env for benchmark-all-commits conditionallydrebs
2017-07-08[benchmarks] run benchmarks twice, for time and resourcesdrebs
We noticed that instrumentation added for watching resources has an impact in time statistics (i.e. it increases average and stddev). This commit makes the benchmark tests run twice: once for measuring time and a second time for measuring resources.
2017-07-08[benchmarks] add --watch-resources optiondrebs
This commit adds the --watch-resources command line option for benchmarks tests, and allows to running the benchmark test suite with and without resource monitoring instrumentation code. This is needed because resource consumption monitoring impacts the mean time and standard deviation of time taken to run benchmarked tests.
2017-07-08[benchmarks] avoid reinstalling pysqlcipher if unneededdrebs
pysqlcipher just has to be reinstalled for benchmark tests if current installed version fails the HAVE_USLEEP flag test. This commit moves the code for checking and reinstalling to a script and bypasses the reinstallation when it is unneeded.
2017-07-08[benchmarks] skip some tests by defaultdrebs
2017-07-08[feat] use OpenSSL backend for scrypt if availableKali Kaneko
This needs OpenSSL >= 1.1, otherwise it will keep using the scrypt dependency. We should think about deprecating scrypt as a dependency when we can be sure that the adoption of libssl 1.1 is wide enough. I think that at some point (soledad 0.11 or so) we can drop the scrypt dependency, which was being somehow problematic at times (the _scrypt.so was not appearing when installing with pip, needed workarounds). From that moment on, we can raise an error if an old libssl is found and no scrypt can be imported - leaving that to the user/packager. In debian stretch and afterwards, you can get that version by installing libssl-dev - Related: #8472
2017-07-07[pkg] workaround multiline bug in .gitlab-ci.ymldrebs
2017-07-07[doc] add doc on benchmark sync tests sizesdrebs
Closes: #8884
2017-07-07[benchmarks] move adbapi tuning script to benchmark scripts folderdrebs
2017-07-07[benchmarks] use new gitlab ci variable namesdrebs
2017-07-07[benchmarks] add README to benchmark-all-commitsdrebs
2017-07-07[benchmarks] record start and end timestamp when benchmarking all commitsdrebs
2017-07-07[benchmarks] stop benchmarking-all-commits when first commit is reacheddrebs
2017-07-07[benchmarks] move benchmark-all-commits script to scripts dirdrebs
2017-07-07[benchmarks] Set a timeout of 2 hours for docker jobs.drebs
2017-07-07[benchmarks] Checkout check-pysqlcipher script because older commits don't ↵drebs
have it.
2017-07-07[benchmarks] Add timestamp, commit id and exit status to results.txtdrebs
2017-07-07[benchmarks] Fix script name inside .gitlab-ci.ymldrebs
2017-07-07[benchmarks] Fix script name.drebs
2017-07-07[benchmarks] Use script to tune adbapi parameters istead of cherry-pick.drebs
2017-07-07[benchmarks] Cherry pick tuned adbapi parameters before running tests.drebs
2017-07-07[benchmarks] All PRs got mergedvarac
2017-07-07[benchmarks] Ignore failed commitsvarac
2017-07-07[benchmarks] Fetch files from the futurevarac
2017-07-07[benchmarks] Show pytest-benchmark git remote in tox.inivarac
2017-07-07[benchmarks] Stay on current branch and not in detatched HEADvarac
2017-07-07[benchmarks] Use git reset --hard so commit_info.branch will stay at mastervarac
2017-07-07[benchmarks] Show date and commit infovarac
2017-07-07[benchmarks] Break on errorvarac
2017-07-07[benchmarks] Run test in dockervarac
2017-07-07[benchmarks] Improve benchmark-all-commits.sh scriptvarac
2017-07-07[benchmarks] Add benchmark-all-commits.shvarac
2017-07-07[doc] add tests and benchmarks documentationdrebs
2017-07-07[test] change memory sampling interval to 0.1 on benchmarksdrebs