<div dir="ltr">Hi,<div><br></div><div>A report of yesterday's meeting is now up on the website <<a href="http://www.bradlug.co.uk/june-17th-2013-big-data-and-development-environments/">http://www.bradlug.co.uk/june-17th-2013-big-data-and-development-environments/</a>> and included below. I'm happy to talk about any of this month's discussion topics in further detail at future meetings if people are interested in anything specific.</div>
<div><br></div><div><br></div><div><br></div><div class="gmail_extra">Alice spoke about how it can be slow and painful setting up development environments, and gave a brief demo of her Hadoop development environment [0] which lets anybody deploy a virtual machine with all the necessary tools in minutes. She spoke about how this can easily be copied for other environments using the Vagrant and Chef tools included. Bats Bash Automated Testing System [1] was also shown which makes for nice readable tests.<br>
<br>Discussion then veered off into big data, hadoop, map/reduce and scaling large systems. A presentation from the NSA on their use of Hadoop for big social graphs [2] was shown, as were images of a 33 node beowulf cluster built with Raspberry Pi [3]. Meanwhile we noted that Obama is checking your email [4].<div>
<br></div><div>[0] <a href="https://github.com/kaerast/chef-cdh-pseudocluster">https://github.com/kaerast/chef-cdh-pseudocluster</a></div><div class="gmail_extra">[1] <a href="https://github.com/sstephenson/bats">https://github.com/sstephenson/bats</a></div>
<div class="gmail_extra">[2] <a href="http://www.pdl.cmu.edu/SDI/2013/slides/big_graph_nsa_rd_2013_56002v1.pdf">http://www.pdl.cmu.edu/SDI/2013/slides/big_graph_nsa_rd_2013_56002v1.pdf</a></div><div class="gmail_extra">[3] <a href="http://hackaday.com/2013/05/21/33-node-beowulf-cluster-built-with-raspberry-pi/">http://hackaday.com/2013/05/21/33-node-beowulf-cluster-built-with-raspberry-pi/</a></div>
<div class="gmail_extra">[4] <a href="http://obamaischeckingyouremail.tumblr.com/">http://obamaischeckingyouremail.tumblr.com/</a></div><div><br></div><div><br></div><div><br></div><div>-- </div></div><div class="gmail_extra">
Regards</div><div class="gmail_extra">Alice</div></div>