From 54211505021aba6d9e3098bd6672e97c901939f0 Mon Sep 17 00:00:00 2001 From: Ivan Alejandro Date: Fri, 6 Dec 2013 17:28:28 -0300 Subject: Improve bundle testing section. --- docs/client/bundle-testing.md | 47 ++++++++++++++++++++++++++----------------- 1 file changed, 29 insertions(+), 18 deletions(-) diff --git a/docs/client/bundle-testing.md b/docs/client/bundle-testing.md index 33535c8..dfe151f 100644 --- a/docs/client/bundle-testing.md +++ b/docs/client/bundle-testing.md @@ -5,50 +5,61 @@ Recommended setup ----------------- VirtualBox (or similar) with virtual machines installed for supported OSs + For each system that you are going to test, you should do: + - Install the VM - Restart the VM and check that the process is finished. - Turn it off and make a snapshot named 'fresh install' or similar. -NOTE: The OS should be installed with the default settings and no extra packages. You can choose your language, username, timezone, etc +The OS should be installed with the default settings and no extra packages. However, you can choose your language, username, timezone, etc Test process ------------ -- roll back the virtual machine to its 'fresh install' state, to make sure that you're testing against a reproducible environment. +- roll back the virtual machine to its *fresh install* state, to make sure that you're testing against a reproducible environment. - download the bundle, verify signature (if apply), extract and run the app -- tests to do: - - check if the version number is the same as the current bundle version. +- test the application (see next section) + + +Tests to do +----------- + +- **check if the version number is the same as the current bundle version** - 'Help->About Bitmask' - `./bitmask --version` - - correct installation of files to 'better protect privacy' +- **correct installation of files to 'better protect privacy'** - `/etc/leap/resolv-update` - `/usr/share/polkit-1/actions/net.openvpn.gui.leap.policy` - NOTE: you should check that they get copied when the user says 'yes' and they don't get copied if the user says 'no'. - - installation of tun/tap in Windows and MAC (explain more here) - - account creation - recommended username template: test_bundleversion_os_arch, that way you avoid conflicts between test iterations. + You should check that they get copied when the user says 'yes' and they don't get copied if the user says 'no'. +- **installation of tun/tap in Windows and MAC** + TODO: explain more here + +- **account creation** + + Recommended username template: test_bundleversion_os_arch, that way you avoid conflicts between test iterations. e.g.: 'test_036_debian7_64', 'test_036_win7_32', etc - NOTE: If you need to create extra users in order to test a bug or whatever, you can use 'test_036_ubuntu1204_32a', 'test_036_ubuntu1204_32b', etc + If you need to create extra users in order to test a bug or whatever, you can use 'test_036_ubuntu1204_32a', 'test_036_ubuntu1204_32b', etc + + In case of being a lot of users testing a version you may want to use your username instead of test, e.g.: 'johndoe_036_ubuntu1204_32'. +- **eip connection** - NOTE: In case of being a lot of users testing a version you may want to use your username instead of test, e.g.: 'johndoe_036_ubuntu1204_32'. - - eip connection + You can check if the vpn is working entering to the site: http://wtfismyip.com - you can check if the vpn is working entering to the site: http://wtfismyip.com or using the console: - `shell> wget -qO- wtfismyip.com/json` - - soledad key generation - - thunderbird configuration manually and using add-on - - send and receive mail + `shell> wget -qO- wtfismyip.com/json` +- **Soledad key generation** +- **Thunderbird configuration manually and using add-on** +- **Send and receive mail** You need to test communication between inside and outside users, e.g.: someuser@bitmask.net and otheruser@gmail.com A good thing to do is to subscribe to a mailing list that have a lot of activity. - - check if the account data is correctly synced. +- **Check if the account data is correctly synced.** After the account creation, have everything working and the app closed: - remove the configuration files created by the app (`~/.config/leap` in linux) -- cgit v1.2.3