soledad.git - [soledad]

Age	Commit message (Collapse)	Author
2016-12-12	[tests] fixes test_crypto bench	Victor Shyba
	encrypt returns a deferred and needs the adapted benchmark runner.
2016-12-12	[tests] use options instead of marks	Victor Shyba
	When we use marks the new pytests from benchmarks folder are collected and ignored, but this causes trial to fail sometimes. Using --ignore avoids it from being loaded while --benchmark-only will properly select the benchmarks for tox, as intended.
2016-12-12	[tests] migrate pytest to trial	Victor Shyba
	test_deprecated_crypto was using pytest, which unfortunately doesnt work when mixed with trial. Migrated back. Also added norecursedirs option back, as it is necessary for parallel testing mode.
2016-12-12	[test] rename benchmark tests directory and tag	drebs

2016-12-12	[test] add test for deprecated crypto format update	drebs

2016-12-12	[test] move fixtures one level up	drebs

2016-12-12	[test] use tags for selecting benchmark tests	drebs

2016-12-12	[style] fix pep8 and confs	Victor Shyba
	Fixes setup.cfg, adding current exclude rules, simplified tox.ini to use setup.cfg and fixed all.
2016-12-12	[bug] include_deleted=True on sync	Victor Shyba
	Also refactored tests and code to stop relying on old parameters which included docs instead of get_doc calls.
2016-12-12	[tests] remove test_sync_deferred	Victor Shyba
	Deferred encryption option is gone.
2016-12-12	[feature] Adds back support to deprecated crypto	Victor Shyba
	Will be removed when we have the proper tool to migrate data.
2016-12-12	[tests] remove test_sync_very_large_files	Victor Shyba
	We have benchmarks now to test sync limits and 100mb is too far from current needs.
2016-12-12	[tests] improve doc creation on benchmarks	Victor Shyba
	If we create all at once we cant test higher loads because it will try to hold all in memory at the same time. Also, this code is smaller and more readable.
2016-12-12	[tests] fall back to TestCase classes	Victor Shyba
	This test was using pytest, but it was making other trial based tests fail. I couldn't figure out why, but falling back to TestCase solved it.
2016-12-12	[refactor] stop using leap.common.http	Victor Shyba
	We aren't using leap.common.http implementation and we need specific features from original Twisted Web Agent. This commit implements it on HTTP Targer.
2016-12-12	[bug] total number of documents	Victor Shyba
	Parsing from metadata we can store the total of docs and handle it for the doc parser in order to be able to keep consistent events info.
2016-12-12	[test] fix test and remove leftovers defer_encryption	Victor Shyba

2016-12-12	[bug] fix import	Kali Kaneko

2016-12-12	[refactor] remove lingering refs to syncdb	Kali Kaneko

2016-12-12	[tests] adapt tests	Kali Kaneko

2016-12-12	[refactor] add SoledadCrypto interface	Kali Kaneko

2016-12-12	[feature] blob encryptor / decryptor	Kali Kaneko

2016-12-12	[refactor] remove encryption pool	Kali Kaneko

2016-12-12	[feature] upload streaming	Victor Shyba
	1) enable HTTP 1.1 chunked upload on server 2) make the client sync.py generate a list of function calls instead of a list of full docs 3) disable encryption pool 4) make the doc encryption a list of function calls 5) create a twisted protocol for sending 6) make a producer that calls the doc generation as necessary
2016-12-12	[feature] streaming download protocol	Victor Shyba
	This commit finishes reversion into u1db original streaming protocol for downloads.
2016-12-12	[refactor] remove decpool	Victor Shyba
	It's not being used
2016-12-12	[bug] disable decpool	Victor Shyba
	Temporary fix for server streaming
2016-11-22	[refactor] separate server application into another file	drebs
	Conflicts: server/src/leap/soledad/server/__init__.py testing/tests/conftest.py
2016-10-21	[tests] make check_schema_versions default to False	Victor Shyba
	CouchServerState is spread across test codebase and this option is intended to be used only on server startup. This commit makes it default to False and explicitly set it to True on where it's necessary.
2016-10-03	[feature] check for user dbs couch schema versions	drebs

2016-09-30	[test] use pytest tmpdir fixture in all tests	drebs
	Tests that were imported from u1db or created on top of that structure were leaving temporary directories behind. This could cause problems in test servers, either by filling the partition or by extrapolating the maximum amount of files in a directory. This commit replaces all usages of temporary directories in the old test structure by pytest tmpdir fixture, which properly cares for removing temporary directories.
2016-08-29	[test] randomize payload	Victor Shyba
	We were using 'x'*size as payload, but on real usage the payload will be random. This commit randomizes the payload using a predefined seed, so the random payload will be the same across benchmarks. Using random payloads also improves accuracy of compression or encoding impacts and we will be evaluating those changes for resouce usage issues. Also note that base64 is used on payload. That was needed for utf8 safety, but overhead was removed to leave payloads as defined by benchmarks. Base64 was chosen also due its popular usage on MIME encoding, which is used on mail attachments (our current scenario).
2016-08-25	[test] stop trying to hit me and hit me	Victor Shyba
	TestSyncEncrypterPool.test_encrypt_doc_and_get_it_back was trying to do an operation and asserting the number of attempts. This test is about putting a doc on encrypter pool and getting it encrypted. If we dont wait for the encryption operation to succeed, then complex trial-and-error happens, but if we just ask twisted to wait for one operation before going to the other, this is not needed. -- Resolves: #8398
2016-08-23	[test] test_instance -> test_initialization	Victor Shyba
	This isnt a test, but a benchmark. Initialization sounds more like an operation while instance is just something.
2016-08-23	[test] point issue #7370 as reason for low values	Victor Shyba
	We are using lower values on test_encdecpool due high memory usage, described in #7370. Added a comment to explain it.
2016-08-22	[test] refactor load_up for readability	Victor Shyba
	defer parameter wasnt clear
2016-08-22	[tests] move doc creation to setup	Victor Shyba
	Otherwise it will add unrelated overhead to results.
2016-08-22	[tests] remove unused new=False logic	Victor Shyba

2016-08-22	[test] make txbench ignore kwargs for readability	Victor Shyba
	They arent used so far and using empty dicts to make them work is ugly. Removing it leaves the return function on setup code clean and readable.
2016-08-22	[test] calibrate encdecpool bench for memory	Victor Shyba
	1000 docs at 100k~500k are exploding memory (4Gb+4Gb swap). Changed for 100 docs in order to be able to get measures on higher loads. Now its 10k, 100k and 500k
2016-08-22	[test] adds tests for raw encryption	Victor Shyba
	Hypothesis: raw vs doc Added the same sizes set (10k, 100k, 500k, 1M, 10M, 50M) as the document crypto test, so we can compare how close to raw the higher level operation is.
2016-08-22	[test] adds test for SoledadCrypto	Victor Shyba
	10k, 100k, 500k, 1m, 10m and 50m for encryption and decryption of a whole document.
2016-08-22	[test] adds encdecpool tests	Victor Shyba
	Most of them are commented as memory usage is going out of control for now.
2016-08-22	[test] test soledad instatiation time	Victor Shyba
	It has a heavy scrypt hashing processing with room for improvement.
2016-08-22	[test] sync without changes	Victor Shyba
	Syncing without any changes was reported as slow. This benchmark will help measure it.
2016-08-22	[test] remove fixed default uuid	Victor Shyba
	Use a new one to avoid reusing the same database.
2016-08-22	[test] make all nested fixture function-scoped	Victor Shyba
	function is the default scope, so there is no need to pass this parameter. Previously, one of the scopes was 'module', but it is a nested function that fires on demand, so it should clean up itself from test to test in order to avoid conflict while putting.
2016-08-22	[test] adds sqlcipher synchronous tests	Victor Shyba

2016-08-22	[test] adds sqlcipher create tests	Victor Shyba
	Creating 20/500k, 100/100k and 1000/10k.
2016-08-22	[test] use a nested func to simplify scenarios	Victor Shyba
	If we have many scenarios (like 20/500k, 100/100k, 1000,10k) then making a nested function to generate tests based on scenario parameters simplifies the code a lot.