Codebits by David Medinets
2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2020

11/12/2013: Using Accumulo Proxy From Python

Using Accumulo Proxy From Python Start the Proxy Server
  1. Start an Accumulo cluster using https://github.com/medined/Accumulo_1_5_0_By_Vagrant
  2. vagrant ssh master
  3. cd /home/vagrant/accumulo_home/bin/accumulo/proxy
  4. edit proxy.properties so that instance=instance and zookeepers=affy-master:2181
  5. accumulo proxy -p proxy.properties
Install Thrift
  1. cd /home/vagrant/software
  2. Download the thrift gz from http://www.apache.org/dyn/closer.cgi?path=/thrift/0.9.1/thrift-0.9.1.tar.gz
  3. sudo apt-get install -y libboost-dev libboost-test-dev libboost-program-options-dev libevent-dev automake libtool flex bison pkg-config g++ libssl-dev
  4. sudo apt-get install -y ruby-full ruby-dev librspec-ruby rake rubygems libdaemons-ruby libgemplugin-ruby mongrel
  5. sudo apt-get install -y python-dev python-twisted
  6. sudo apt-get install -y libbit-vector-perl
  7. tar xvfz thrift-0.9.1.tar.gz
  8. cd thrift-0.9.1
  9. ./configure
  10. make
  11. sudo make install
  12. thrift -version
  13. cd lib/py
  14. sudo python setup.py install
  15. cd /home/vagrant/software
  16. thrift --gen py $ACCUMULO_HOME/proxy/thrift/proxy.thrift
  17. cd /home/vagrant/accumulo_home/software/accumulo
  18. export PYTHONPATH=/home/vagrant/accumulo_home/gen-py
  19. python proxy/examples/python/TestClient.py   

 

11/11/2013: Watching Accumulo Heal Itself

Watching Accumulo heal itself was exciting - prove of technology stuff. 1. Start a cluster with a master and two nodes using https://github.com/medined/Accumulo_1_5_0_By_Vagrant.

2. Visit http://affy-master:50095/ to verify that two tablet servers are running.

3. Enable auto-refresh.

4. Run 'vagrant destroy slave1'

5. Visit http://affy-master:50095/. In a minute or two you should see one Dead Tablet Server. You'll also see messages on the Recent Logs page.

6. Run 'vagrant up slave1'

7. Run 'vagrant ssh slave1 -c /vagrant/files/post_spinup_setup_ssh.sh' to re-establish SSH public keys.

8. Run 'vagrant ssh master -c "accumulo_home/bin/accumulo/bin/start-all.sh"' to re-start the Accumulo processes on slave1.

9. Visit http://affy-master:50095/. In a minute or two you should have both Tablet Servers alive and responding to requests.