add different errors I've captured so far

5 files changed, 297 insertions, 0 deletions

diff --git a/bundler_failed b/bundler_failed
new file mode 100644
index 0000000..fb4d044
--- /dev/null
+++ b/bundler_failed
@@ -0,0 +1,4 @@
+this error happened because one of the bundler gem dependencies was not pinned to a specific version (libv8) and the newest version could not compile properly:
+
+    - [web1_vagrant] err: /Stage[main]/Site_webapp/Exec[bundler_update]/returns: change from notrun to 0 failed: /bin/bash -c "/usr/bin/bundle check || /usr/bin/bundle install" returned 5 instead of one of [0] at /srv/leap/puppet/modules/site_webapp/manifests/init.pp:53
+    - [web1_vagrant] err: /Stage[main]/Site_webapp/Exec[bundler_update]: Failed to call refresh: /bin/bash -c "/usr/bin/bundle check || /usr/bin/bundle install" returned 5 instead of one of [0] at /srv/leap/puppet/modules/site_webapp/manifests/init.pp:53
diff --git a/deploy_in_process b/deploy_in_process
new file mode 100644
index 0000000..e2e9557
--- /dev/null
+++ b/deploy_in_process
@@ -0,0 +1,2 @@
+what if two people run deply at the same time? - I haven't captured the error here, but I believe that puppet will complain with:
+notice: Run of Puppet configuration client already in progress; skipping
diff --git a/disk_full b/disk_full
new file mode 100644
index 0000000..3758d85
--- /dev/null
+++ b/disk_full
@@ -0,0 +1,87 @@
+
+this happened when the disk filled up:
+
+micah@minnow:~/leap/bitmask/provider$ leap -v1 deploy turtle
+ = updating hiera.yaml
+ = applying puppet
+   - [turtle] notice: Scope(Node[default]): Services for turtle.bitmask.net: webapp
+   - [turtle] notice: /Stage[main]/Apache::Package/Package[apache]/ensure: ensure changed 'purged' to 'present'
+   - [turtle] notice: /Stage[main]/Apache::Base/File[include_dir]/ensure: created
+   - [turtle] notice: /Stage[main]/X509::Base/File[/usr/local/share/ca-certificates]/group: group changed 'staff' to 'root'
+   - [turtle] notice: /Stage[main]/Site_webapp/Group[leap-webapp]/ensure: created
+   - [turtle] notice: /Stage[main]/Site_config::Apt/Apt::Apt_conf[90disable-pdiffs]/File[/etc/apt/apt.conf.d/90disable-pdiffs]/ensure: created
+   - [turtle] notice: /Stage[main]/Apache::Base/File[htpasswd_dir]/ensure: created
+   - [turtle] notice: /Stage[main]/Apache::Base/Apache::Config::Include[defaults.inc]/Apache::Config::File[defaults.inc]/File[apache_defaults.inc]/ensure: defined content as '{md5}3f175020bd5b06b971349ec7cffac132'
+   - [turtle] notice: /Stage[main]/Apache::Ssl::Base/Apache::Config::Include[ssl_defaults.inc]/Apache::Config::File[ssl_defaults.inc]/File[apache_ssl_defaults.inc]/ensure: defined content as '{md5}2eabc5f406696930ce2263004f9655fa'
+   - [turtle] notice: /Stage[main]/Apache::Base/Apache::Config::Global[git.conf]/Apache::Config::File[git.conf]/File[apache_git.conf]/ensure: defined content as '{md5}b58da72e959d0447e6357f49d98a255a'
+   - [turtle] notice: /Stage[main]/Apache::Debian/Apache::Config::Global[security]/Apache::Config::File[security]/File[apache_security]/content: content changed '{md5}0f644d9d04ad556f44f1e65674bc07dc' to '{md5}070f47e91332a98dbad4f13e6f0e7625'
+   - [turtle] notice: /File[/var/lib/puppet/modules/munin]/ensure: removed
+   - [turtle] err: /Stage[main]/Ruby/Package[ruby1.9.3]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install ruby1.9.3' returned 100: Reading package lists...
+   - [turtle] err: /Stage[main]/Passenger/Package[ruby-rack]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install ruby-rack' returned 100: Reading package lists...
+   - [turtle] notice: /Stage[main]/Apache::Ssl::Debian/Apache::Debian::Module[ssl]/Exec[/usr/sbin/a2enmod ssl]/returns: executed successfully
+   - [turtle] notice: /Stage[main]/Apache::Debian/File[default_debian_apache_vhost]/ensure: removed
+   - [turtle] notice: /Stage[main]/Apache::Ssl::Debian/Apache::Config::Global[ssl.conf]/Apache::Config::File[ssl.conf]/File[apache_ssl.conf]/ensure: defined content as '{md5}235a73c5a3abcbafdd73c00f8c639b89'
+   - [turtle] notice: /Stage[main]/Apt/Config_file[/etc/apt/sources.list]/File[/etc/apt/sources.list]/content: content changed '{md5}c6d40682b29b93e252e3e3484a7d5f01' to '{md5}c85f5486cc2208687527223a0c069530'
+   - [turtle] err: /Stage[main]/Apt::Dot_d_directories/Exec[refresh_apt]: Failed to call refresh: /usr/bin/apt-get update && sleep 1 returned 100 instead of one of [0] at /srv/leap/puppet/modules/apt/manifests/dot_d_directories.pp:20
+   - [turtle] notice: /Stage[main]/Rubygems/Package[rubygems]: Dependency Package[ruby1.9.3] has failures: true
+   - [turtle] warning: /Stage[main]/Rubygems/Package[rubygems]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Bundler::Install/Package[bundler]: Dependency Package[ruby1.9.3] has failures: true
+   - [turtle] warning: /Stage[main]/Bundler::Install/Package[bundler]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/X509::Base/File[/etc/x509]/ensure: created
+   - [turtle] notice: /Stage[main]/X509::Base/File[/etc/x509/keys]/ensure: created
+   - [turtle] notice: /Stage[main]/X509::Base/File[/etc/x509/certs]/ensure: created
+   - [turtle] notice: /Stage[main]/Apache::Base/File[default_apache_index]/content: content changed '{md5}21dde95d9d269cbb2fa6560309dca40c' to '{md5}9e874264f79350a315832ba2f034e255'
+   - [turtle] notice: /Stage[main]/Site_config::Hosts/File[/etc/hosts]/content: content changed '{md5}934c3fc760a8836eeed2d5d12e5352eb' to '{md5}5000f645cbabfe932091c1b2dcc31a4b'
+   - [turtle] notice: /Stage[main]/Passenger/Apache::Config::File[mod_passenger]/File[apache_mod_passenger]/ensure: defined content as '{md5}d41d8cd98f00b204e9800998ecf8427e'
+   - [turtle] err: /Stage[main]/Passenger/Apache::Module[passenger]/Apache::Debian::Module[passenger]/Package[libapache2-mod-passenger]/ensure: change from purged to present failed: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install libapache2-mod-passenger' returned 100: Reading package lists...
+   - [turtle] notice: /Stage[main]/Passenger/Apache::Module[passenger]/Apache::Debian::Module[passenger]/Exec[/usr/sbin/a2enmod passenger]: Dependency Package[libapache2-mod-passenger] has failures: true
+   - [turtle] warning: /Stage[main]/Passenger/Apache::Module[passenger]/Apache::Debian::Module[passenger]/Exec[/usr/sbin/a2enmod passenger]: Skipping because of failed dependencies
+   - [turtle] err: /Stage[main]/Site_webapp/User[leap-webapp]/ensure: change from absent to present failed: Could not create user leap-webapp: Execution of '/usr/sbin/useradd -d /srv/leap-webapp -g leap-webapp leap-webapp' returned 1:
+   - [turtle] notice: /Stage[main]/Site_webapp/Vcsrepo[/srv/leap-webapp]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/Vcsrepo[/srv/leap-webapp]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/File[/srv/leap-webapp]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp::Couchdb/File[/srv/leap-webapp/config/couchdb.yml]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp::Couchdb/File[/srv/leap-webapp/config/couchdb.yml]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/config]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/config]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/config/eip-service.json]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/config/eip-service.json]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/provider.json]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/provider.json]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp/Exec[bundler_update]: Dependency Package[ruby1.9.3] has failures: true
+   - [turtle] notice: /Stage[main]/Site_webapp/Exec[bundler_update]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/Exec[bundler_update]: Skipping because of failed dependencies
+   - [turtle] notice: /Stage[main]/Site_webapp::Apache/Apache::Vhost::File[leap_webapp]/File[leap_webapp.conf]/ensure: created
+   - [turtle] notice: /Stage[main]/Site_webapp::Apache/X509::Key[leap_webapp]/File[/etc/x509/keys/leap_webapp.key]/ensure: defined content as '{md5}43ba5e2033bd27ccbccf58df6b19c694'
+   - [turtle] notice: /Stage[main]/Site_webapp::Apache/X509::Key[leap_api]/File[/etc/x509/keys/leap_api.key]/ensure: defined content as '{md5}a0c5ce7b221dabe54ea28f5985a19ee8'
+   - [turtle] notice: /Stage[main]/Site_webapp::Apache/X509::Ca[leap_webapp]/File[/usr/local/share/ca-certificates/leap_webapp.crt]/ensure: defined content as '{md5}dfd91ade1588557a92783eebce715d09'
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/X509::Cert[leap_webapp]/File[/etc/x509/certs/leap_webapp.crt]/ensure: change from absent to file failed: Could not rename temporary file /etc/x509/certs/leap_webapp.crt.puppettmp_2836 to /etc/x509/certs/leap_webapp.crt: File written to disk did not match checksum; discarding changes ({md5}f3d39d6a0b4eccedb859c6716f27f979 vs {md5}d41d8cd98f00b204e9800998ecf8427e) at /srv/leap/puppet/modules/x509/manifests/cert.pp:13 at /srv/leap/puppet/modules/x509/manifests/cert.pp:13
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/Apache::Module[alias]/Apache::Debian::Module[alias]/Exec[/usr/sbin/a2enmod alias]: Could not evaluate: cannot generate tempfile `/tmp/puppet20121211-11297-1gt7v2l-9'
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/X509::Ca[leap_api]/File[/usr/local/share/ca-certificates/leap_api.crt]/ensure: change from absent to file failed: Could not rename temporary file /usr/local/share/ca-certificates/leap_api.crt.puppettmp_691 to /usr/local/share/ca-certificates/leap_api.crt: File written to disk did not match checksum; discarding changes ({md5}3406caa7c2405c5e0b7b0d63bb673529 vs {md5}d41d8cd98f00b204e9800998ecf8427e) at /srv/leap/puppet/modules/x509/manifests/ca.pp:14 at /srv/leap/puppet/modules/x509/manifests/ca.pp:14
+   - [turtle] notice: /Stage[main]/X509::Base/Exec[update-ca-certificates]: Dependency File[/usr/local/share/ca-certificates/leap_api.crt] has failures: true
+   - [turtle] warning: /Stage[main]/X509::Base/Exec[update-ca-certificates]: Skipping because of failed dependencies
+   - [turtle] err: /Stage[main]/X509::Base/Exec[update-ca-certificates]: Failed to call refresh: cannot generate tempfile `/tmp/puppet20121211-11297-1xc7ch1-9'
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/ca.crt]: Dependency File[/usr/local/share/ca-certificates/leap_api.crt] has failures: true
+   - [turtle] notice: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/ca.crt]: Dependency User[leap-webapp] has failures: true
+   - [turtle] warning: /Stage[main]/Site_webapp/File[/srv/leap-webapp/public/ca.crt]: Skipping because of failed dependencies
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/Apache::Module[rewrite]/Apache::Debian::Module[rewrite]/Exec[/usr/sbin/a2enmod rewrite]: Could not evaluate: cannot generate tempfile `/tmp/puppet20121211-11297-gbxi9a-9'
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/Apache::Module[headers]/Apache::Debian::Module[headers]/Exec[/usr/sbin/a2enmod headers]: Could not evaluate: cannot generate tempfile `/tmp/puppet20121211-11297-17y8dde-9'
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/Apache::Vhost::File[api]/File[api.conf]/ensure: change from absent to present failed: Could not rename temporary file /etc/apache2/sites-enabled/api.conf.puppettmp_3561 to /etc/apache2/sites-enabled/api.conf: File written to disk did not match checksum; discarding changes ({md5}4e1d64488139eeeabfd45783cd589b1d vs {md5}d41d8cd98f00b204e9800998ecf8427e) at /srv/leap/puppet/modules/apache/manifests/vhost/file.pp:38 at /srv/leap/puppet/modules/apache/manifests/vhost/file.pp:38
+   - [turtle] err: /Stage[main]/Site_webapp::Apache/X509::Cert[leap_api]/File[/etc/x509/certs/leap_api.crt]/ensure: change from absent to file failed: Could not rename temporary file /etc/x509/certs/leap_api.crt.puppettmp_1027 to /etc/x509/certs/leap_api.crt: File written to disk did not match checksum; discarding changes ({md5}04004bd1ed1bbb8a8db806c19d455880 vs {md5}d41d8cd98f00b204e9800998ecf8427e) at /srv/leap/puppet/modules/x509/manifests/cert.pp:13 at /srv/leap/puppet/modules/x509/manifests/cert.pp:13
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency Package[libapache2-mod-passenger] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency File[/usr/local/share/ca-certificates/leap_api.crt] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency Exec[/usr/sbin/a2enmod headers] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency Exec[/usr/sbin/a2enmod alias] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency File[/etc/x509/certs/leap_api.crt] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency File[api.conf] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency File[/etc/x509/certs/leap_webapp.crt] has failures: true
+   - [turtle] notice: /Stage[main]/Apache::Base/Service[apache]: Dependency Exec[/usr/sbin/a2enmod rewrite] has failures: true
+   - [turtle] warning: /Stage[main]/Apache::Base/Service[apache]: Skipping because of failed dependencies
+   - [turtle] err: /Stage[main]/Apache::Base/Service[apache]: Failed to call refresh: Could not start Service[apache]: Execution of '/etc/init.d/apache2 start' returned 1:  at /srv/leap/puppet/modules/apache/manifests/base.pp:36
+   - [turtle] err: /Stage[main]/Resolvconf/File[/etc/resolv.conf]/content: change from {md5}cbabb7aa62a87044c51a7e70ef2e3a6c to {md5}7ad39c9811b952ca2d29385eff848d44 failed: Could not rename temporary file /etc/resolv.conf.puppettmp_6784 to /etc/resolv.conf: File written to disk did not match checksum; discarding changes ({md5}7ad39c9811b952ca2d29385eff848d44 vs {md5}d41d8cd98f00b204e9800998ecf8427e) at /srv/leap/puppet/modules/resolvconf/manifests/init.pp:26 at /srv/leap/puppet/modules/resolvconf/manifests/init.pp:26
+   - [turtle] err: Failed to apply catalog: No space left on device - /var/lib/puppet/state/state.yaml
+   - [turtle] err: Report processor failed: No space left on device - /var/lib/puppet/reports/turtle.bitmask.net
+   - [turtle] err: Could not send report: No space left on device - /var/lib/puppet/state/last_run_report.yaml
+error: failed: "sh -c 'cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp'" on turtle
+micah@minnow:~/leap/bitmask/provider$ 
diff --git a/incorrect_fqdn b/incorrect_fqdn
new file mode 100644
index 0000000..e9ac3fc
--- /dev/null
+++ b/incorrect_fqdn
@@ -0,0 +1,96 @@
+no fqdn set properly - unless we set the fqdn in the 'leap init' we cannot set it early enough in puppet to be properly captured by facter (facter is run before even the earliest run stages). we want to require that users of the platform have a properly installed system with the fqdn/hostname set properly, but if they don't this is what happens:
+
+---------------------
+micah@minnow:~/leap/bitmask/provider$ leap -v 2 deploy turtle
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/services/couchdb.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/services/dns.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/services/openvpn.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/services/ca.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/services/webapp.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/tags/local.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/common.json
+ = loading /mnt/home/micah/leap/bitmask/leap_platform/provider_base/provider.json
+ = loading tags/production.json
+ = loading nodes/aligator.json
+ = loading nodes/web1_vagrant.json
+ = loading nodes/turtle.json
+ = loading nodes/koala.json
+ = loading nodes/sloth.json
+ = loading nodes/vpn1_vagrant.json
+ = loading nodes/couchdb1_vagrant.json
+ = loading nodes/ca1_vagrant.json
+ = loading common.json
+ = loading provider.json
+ = loading secrets.json
+ = ran git submodule status 2>&1
+ = executing "test -f /srv/leap/initialized && ! dpkg-query -W --showformat='${Status}\\\n' puppet ruby-hiera-puppet rsync lsb-release 2>&1 | grep -q -E '(deinstall|no packages)'"
+ = updating hiera.yaml
+   - rsync -az -e "ssh -o GlobalKnownHostsFile='/mnt/home/micah/leap/bitmask/provider/files/ssh/known_hosts' -o StrictHostKeyChecking='yes' -o HostKeyAlias='turtle' -o HostName='176.53.69.119' -p 22" /mnt/home/micah/leap/bitmask/provider/hiera/turtle.yaml root@turtle:/etc/leap/hiera.yaml
+ = rsync /mnt/home/micah/leap/bitmask/provider/hiera/turtle.yaml /etc/leap/hiera.yamlexecuting `apply_puppet'
+ = applying puppet
+   - executing `puppet:apply'
+   - executing "if [ ! -f /tmp/puppet.lock ]; then touch /tmp/puppet.lock; else stat -c \"\e[0;31mPuppet in progress, /tmp/puppet.lock owned by %U since %x\e[0m\" /tmp/puppet.lock >&2; exit 1; fi"
+   - executing `puppet:update_code'
+   - rsync -az --delete --exclude=.git --exclude=.svn -e "ssh -o GlobalKnownHostsFile='/mnt/home/micah/leap/bitmask/provider/files/ssh/known_hosts' -o StrictHostKeyChecking='yes' -o HostKeyAlias='turtle' -o HostName='176.53.69.119' -p 22" /mnt/home/micah/leap/bitmask/leap_platform/puppet root@turtle:/srv/leap
+   - executing "cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp"
+   - [turtle] warning: Could not retrieve fact fqdn
+   - [turtle] warning: Host is missing hostname and/or domain: turtle
+   - [turtle] warning: Dynamic lookup of $codename at /srv/leap/puppet/modules/apt/manifests/preferences.pp:6 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] warning: Dynamic lookup of $codename at /srv/leap/puppet/modules/apt/templates/Debian/preferences_wheezy.erb:1 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] warning: Dynamic lookup of $codename at /srv/leap/puppet/modules/apt/templates/Debian/preferences_wheezy.erb:3 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] warning: Dynamic lookup of $codename at /srv/leap/puppet/modules/apt/templates/Debian/preferences_wheezy.erb:6 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] warning: Dynamic lookup of $codename at /srv/leap/puppet/modules/apt/templates/Debian/preferences_wheezy.erb:8 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] notice: Scope(Node[default]): Services for : webapp
+   - [turtle] warning: Dynamic lookup of $apache_no_default_site at /srv/leap/puppet/modules/apache/manifests/base.pp:46 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] warning: Dynamic lookup of $apache_no_default_site at /srv/leap/puppet/modules/apache/manifests/ssl/base.pp:4 is deprecated. For more information, see http://docs.puppetlabs.com/guides/scope_and_puppet.html. To see the change in behavior, use the --debug flag.
+   - [turtle] Failed to parse template site_apache/vhosts.d/leap_webapp.conf.erb:
+   - [turtle]   Filepath: /usr/lib/ruby/vendor_ruby/puppet/parser/templatewrapper.rb
+   - [turtle]   Line: 65
+   - [turtle]   Detail: Could not find value for 'domain' at 2:/srv/leap/puppet/modules/site_apache/templates/vhosts.d/leap_webapp.conf.erb
+   - [turtle]  at /srv/leap/puppet/modules/site_webapp/manifests/apache.pp:25 on node turtle
+   - rolling backexecuting "rm -f /tmp/puppet.lock; true"
+error: failed: "sh -c 'cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp'" on turtle
+/var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/command.rb:176:in `process!': failed: "sh -c 'cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp'" on turtle (Capistrano::CommandError)
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/command.rb:134:in `process'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:185:in `block in run_tree'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:198:in `block in execute_on_servers'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `each'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `each_slice'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `execute_on_servers'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:183:in `run_tree'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:155:in `run'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/extensions.rb:9:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/vendor/supply_drop/lib/supply_drop/plugin.rb:73:in `puppet'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/vendor/supply_drop/lib/supply_drop/plugin.rb:32:in `apply'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/vendor/supply_drop/lib/supply_drop/tasks.rb:85:in `block (4 levels) in <top (required)>'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:56:in `transaction'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:191:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/vendor/supply_drop/lib/supply_drop/tasks.rb:80:in `block (3 levels) in <top (required)>'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `instance_eval'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `invoke_task_directly'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/callbacks.rb:25:in `invoke_task_directly_with_callbacks'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:89:in `execute_task'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:191:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:110:in `block in define_task'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/util/../remote/tasks.rb:32:in `block (2 levels) in load'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/log.rb:94:in `log'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/remote/plugin.rb:12:in `log'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/util/../remote/tasks.rb:31:in `block in load'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `instance_eval'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `invoke_task_directly'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/callbacks.rb:25:in `invoke_task_directly_with_callbacks'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:89:in `execute_task'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:110:in `block in define_task'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/commands/deploy.rb:41:in `block (3 levels) in <module:Commands>'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/util/remote_command.rb:36:in `ssh_connect'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/lib/leap_cli/commands/deploy.rb:23:in `block (2 levels) in <module:Commands>'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/command_support.rb:136:in `call'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/command_support.rb:136:in `execute'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/app_support.rb:262:in `block in call_command'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/app_support.rb:275:in `call'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/app_support.rb:275:in `call_command'
+	from /var/lib/gems/1.9.1/gems/gli-2.5.2/lib/gli/app_support.rb:69:in `run'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/bin/leap:82:in `<module:Commands>'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.4/bin/leap:38:in `<top (required)>'
+	from /usr/local/bin/leap:23:in `load'
+	from /usr/local/bin/leap:23:in `<main>'
diff --git a/lsbdistcodename_not_set b/lsbdistcodename_not_set
new file mode 100644
index 0000000..0a83508
--- /dev/null
+++ b/lsbdistcodename_not_set
@@ -0,0 +1,108 @@
+This error happened because the facter lsbdistcodename was 'Debian/sid' because of a change made to the apt/sources.list and preferences, and
+before an apt-get update happened. It is resolved further on by ssh'ing into the instance and running apt-get update:
+
+    - [couchdb1_vagrant] notice: Scope(Node[default]): Services for minimal-wheezy.vagrantup.com: couchdb
+    - [couchdb1_vagrant] couchdb not available for Debian/sid at /srv/leap/puppet/modules/couchdb/manifests/init.pp:6 on node minimal-wheezy.vagrantup.com
+    - [puppet:apply] rolling back
+    - executing "rm -f /tmp/puppet.lock; true"
+error: failed: "sh -c 'cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp'" on couchdb1_vagrant
+/var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/command.rb:176:in `process!': failed: "sh -c 'cd /srv/leap &&  /usr/bin/puppet apply --color=false --confdir puppet puppet/manifests/site.pp'" on couchdb1_vagrant (Capistrano::CommandError)
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/command.rb:134:in `process'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:185:in `block in run_tree'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:198:in `block in execute_on_servers'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `each'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `each_slice'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/connections.rb:186:in `execute_on_servers'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:183:in `run_tree'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/actions/invocation.rb:155:in `run'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/extensions.rb:9:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/vendor/supply_drop/lib/supply_drop/plugin.rb:73:in `puppet'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/vendor/supply_drop/lib/supply_drop/plugin.rb:32:in `apply'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/vendor/supply_drop/lib/supply_drop/tasks.rb:85:in `block (4 levels) in <top (required)>'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:56:in `transaction'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:191:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/vendor/supply_drop/lib/supply_drop/tasks.rb:80:in `block (3 levels) in <top (required)>'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `instance_eval'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `invoke_task_directly'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/callbacks.rb:25:in `invoke_task_directly_with_callbacks'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:89:in `execute_task'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:191:in `method_missing'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:110:in `block in define_task'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/util/../remote/tasks.rb:39:in `block (2 levels) in load'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/log.rb:87:in `log'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/remote/plugin.rb:8:in `log'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/util/../remote/tasks.rb:38:in `block in load'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `instance_eval'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:138:in `invoke_task_directly'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/callbacks.rb:25:in `invoke_task_directly_with_callbacks'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/execution.rb:89:in `execute_task'
+	from /var/lib/gems/1.9.1/gems/capistrano-2.13.5/lib/capistrano/configuration/namespaces.rb:110:in `block in define_task'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/commands/deploy.rb:48:in `block (3 levels) in <module:Commands>'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/util/remote_command.rb:36:in `ssh_connect'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/lib/leap_cli/commands/deploy.rb:19:in `block (2 levels) in <module:Commands>'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/command_support.rb:136:in `call'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/command_support.rb:136:in `execute'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/app_support.rb:260:in `block in call_command'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/app_support.rb:273:in `call'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/app_support.rb:273:in `call_command'
+	from /var/lib/gems/1.9.1/gems/gli-2.4.1/lib/gli/app_support.rb:67:in `run'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/bin/leap:81:in `<module:Commands>'
+	from /var/lib/gems/1.9.1/gems/leap_cli-0.1.3/bin/leap:37:in `<top (required)>'
+	from /usr/local/bin/leap:23:in `load'
+	from /usr/local/bin/leap:23:in `<main>'
+micah@minnow:~/leap/bitmask/provider$ leap ssh couchdb1_vagrant
+Linux minimal-wheezy 3.2.0-4-amd64 #1 SMP Debian 3.2.32-1 x86_64
+
+The programs included with the Debian GNU/Linux system are free software;
+the exact distribution terms for each program are described in the
+individual files in /usr/share/doc/*/copyright.
+
+Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
+permitted by applicable law.
+Last login: Thu Nov 29 21:28:04 2012 from 10.5.5.1
+faroot@minimal-wheezy:~# facter |grep -i sid
+/usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require': iconv will be deprecated in the future, use String#encode instead.
+lsbdistcodename => sid
+lsbdistdescription => Debian GNU/Linux unstable (sid)
+operatingsystemrelease => wheezy/sid
+root@minimal-wheezy:~# cd /etc/apt/sources.list.d/
+root@minimal-wheezy:/etc/apt/sources.list.d# ls
+unstable.list
+root@minimal-wheezy:/etc/apt/sources.list.d# cd ..
+root@minimal-wheezy:/etc/apt# ls
+apt.conf.d	  preferences	 sources.list	 sources.list~	trusted.gpg
+listchanges.conf  preferences.d  sources.list.d  trustdb.gpg	trusted.gpg.d
+root@minimal-wheezy:/etc/apt# cd apt.conf.d/
+root@minimal-wheezy:/etc/apt/apt.conf.d# ls
+00CDMountPoint	00trustcdrom  01autoremove  02show_upgraded  03clean  20listchanges  70debconf	90disable-pdiffs
+root@minimal-wheezy:/etc/apt/apt.conf.d# rm 90disable-pdiffs 
+root@minimal-wheezy:/etc/apt/apt.conf.d# facter |grep sid
+/usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require': iconv will be deprecated in the future, use String#encode instead.
+lsbdistcodename => sid
+lsbdistdescription => Debian GNU/Linux unstable (sid)
+operatingsystemrelease => wheezy/sid
+root@minimal-wheezy:/etc/apt/apt.conf.d# our kapt-get ^C
+root@minimal-wheezy:/etc/apt/apt.conf.d# apt-get update
+Hit http://cdn.debian.net wheezy InRelease                                                              
+Get:1 http://cdn.debian.net wheezy/main amd64 Packages [5898 kB]                                 
+Hit http://http.debian.net unstable InRelease                                                                                               
+Get:2 http://http.debian.net unstable/main amd64 Packages/DiffIndex [7876 B]                                                                
+Hit http://security.debian.org wheezy/updates InRelease                                                                                     
+Get:3 http://http.debian.net unstable/main Translation-en/DiffIndex [7876 B]                                                                
+Hit http://security.debian.org wheezy/updates/main amd64 Packages                                                                           
+Hit http://security.debian.org wheezy/updates/contrib amd64 Packages                                                                        
+Hit http://security.debian.org wheezy/updates/non-free amd64 Packages                                                                       
+Ign http://security.debian.org wheezy/updates/contrib Translation-en                                                                        
+Ign http://security.debian.org wheezy/updates/main Translation-en                                                                           
+Ign http://security.debian.org wheezy/updates/non-free Translation-en                                                                       
+Get:4 http://cdn.debian.net wheezy/contrib amd64 Packages [43.6 kB]                                                                         
+Get:5 http://cdn.debian.net wheezy/non-free amd64 Packages [81.5 kB]                                                                        
+Get:6 http://cdn.debian.net wheezy/contrib Translation-en [35.6 kB]                                                                         
+Get:7 http://cdn.debian.net wheezy/main Translation-en [3893 kB]                                                                            
+Get:8 http://cdn.debian.net wheezy/non-free Translation-en [66.4 kB]                                                                        
+Fetched 6630 kB in 1min 30s (73.1 kB/s)                                                                                                     
+Reading package lists... Done
+root@minimal-wheezy:/etc/apt/apt.conf.d# facter |grep sid
+/usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require': iconv will be deprecated in the future, use String#encode instead.
+operatingsystemrelease => wheezy/sid
+root@minimal-wheezy:/etc/apt/apt.conf.d#