Devops Drop 023
Wednesday, September 28, 2011 at 5:11PM 
Follow John Willis on Twitter: @botchagalupe
Follow Damon Edwards on Twitter: @damonedwards
Notes:
Hack Day in China...
http://kb.dtosolutions.com/wiki/Duke%27s_Bank_J2EE_Jenkins/Rundeck_example
Minimalist pipeline.. CI loop, CD model...
Customer was Centos based....
SVN,Jenkins, Rundeck, JBoss and Mysql... (5 Servers).
Due to cultural differences....
Make a change to the code and see the CI loop, delivery loop take place.
The do a Roll back....
Talk about Rundeck and the mechanics - Jenkins Rundeck Plugin. Drives the rundeck job automatically. Also Rundeck pulls the latest, last and history of builds.
Normally we would use Chef or Puppet on the back end of Rundeck...
Point about manual vs automated process
--------------------------------------------------------------------------
A Contentious Question by Chris Hoff (@beaker)
http://www.rationalsurvivability.com/blog/?p=3304
Contentios question by @beaker.. no, Actually if you guys don’t follow @beaker you should. He is our #devops mirror for networking and security (imho). He tried to keep us honest...
“Given the recent influx of virtual networking solutions, many of which are OpenFlow-based, what possible in-roads and value can they hope to offer in heavily virtualized enterprise environments wherein the virtual networking is owned and controlled by VMware?”
Specifically, if the only third-party VMware virtual switch to date is Cisco’s and access to this platform is limited (if at all available) to startup players, how on Earth do BigSwitch, Nicira, vCider, etc. plan to insert themselves into an already contentious environment effectively doing mindshare and relevance battle with the likes of mainline infrastructure networking giants and VMware?
If you’re answer is “OpenFlow and OpenStack will enable this access,...
Not meaning to piss anyone off, but many of these startups’ business plans are shrouded in the mystical vail of “wait and see.”
--------------------------------------------------------------------------
Pro Puppet [Kindle Edition]
--------------------------------------------------------------------------
Ask about BigDrops?
Learning and Hadoop
http://www.slideshare.net/jpatanooga/machine-learning-and-hadoop
September 2011 – HUG– Atlanta, GA
Machine Learning With Hadoop
Josh Patterson | Sr Solution Architect
Open source work at
Lumberyard“
https://github.com/jpatanooga/Lumberyard
After the refining process, one barrel of crude oil yielded more than 40% gasoline and only 3% kerosene, creating large quantities of waste gasoline for disposal.”
--- Excerpt from the book “The American Gas Station”
Hadoop Today: The Oil Industry Circa 1900
Digital universe grew by 62% last year to 800K petabytes and will grow to 1.2 “zettabytes” this year
Speed @ Scale is the new Killer App
Results in that previously took 1 day to process can gain new value when created in 10 minutes.
ML Focused on in Mahout
An algorithm that looks at a user’s past actions and suggests
Products
Services
People
What is time series data?
What is ISAX Lumberyard?
Bioinformatics
Packages For Hadoop
DataFu
http://sna-projects.com/datafu/
UDFs in Pig
used at LinkedIn in many of off-line workflows for data derived products
"People You May Know”
"Skills”
Techniques
PageRank
MRv2
Hadoop Not Good At in Data Mining
We’ve talked about this before with twitter's storm...
Not everything fits great in MapReduce
Mahout as evidence of this
--------------------------------------------------------------------------
Common Challenges in DevOps Change Management
http://www.slideshare.net/mattray/common-challenges
Matt Ray
Starts out with meat and potato .. everything in source control
Talks about spiceweasel .. yaml or jason..
http://wiki.opscode.com/display/chef/Spiceweasel
Think roles not nodes... nodes can be ephemeral..
Start from scratch don’t reuse nodes...
Don’t hard code IP addresses .. m&p
Golden mages are an anti-pattern. <The don’t have to be...
--------------------------------------------------------------------------
Three Drunk in SysAdmins....
http://www.threedrunkensysadsonthe.net/2011/05/a-new-hope/
Continuous Delivery of Server Configurations
Toolbox
Puppet, Git, Mcollective,Jeninks,and Capistrano
Three part series...
--------------------------------------------------------------------------
10Gen
Announcing the MongoDB Monitoring Service (MMS)
MongoDB Monitoring Service (MMS) to the public for free. MMS is a SaaS based tool that monitors your MongoDB cluster and makes it easy for you to see what’s going on in a production deployment.
--------------------------------------------------------------------------
Devops Chicago and Devops Camp
http://dev2ops.org/blog/2011/9/26/devops-chicago-and-devops-camp.html
Interview w/Martin J. Logan
Oct 22 - 23 in Chicago
Camp Devops
--------------------------------------------------------------------------
Devopsdays Goteborg 2011
The conference will be a two day event on Friday 14 and Saturday 15 of October 2011
Reader Comments