Fwd: beCraft 3/12 - 6PM - Stream Architectures by Andrew Montalenti

[Al Tenhundfeld]

Hola Richmonders,

Our March beCraft meeting promises to be pretty great. If you've been wanting to check out a meeting in Charlottesville, this would be a good one.

-Al

---------- Forwarded message ----------
From: Al Tenhundfeld <tenhu...@gmail.com>
Date: Mon, Mar 3, 2014 at 1:56 PM
Subject: beCraft 3/12 - 6PM - Stream Architectures by Andrew Montalenti
To: "beC...@googlegroups.com" <bec...@googlegroups.com>

Hi everybody,

This month's beCraft meeting is next Wednesday, March 12th, from 6-8PM at the Center for Open Science (directions below)

I'm really excited about this meeting. Andrew Montalenti is leading a discussion on stream architectures, a.k.a., log-centric or lambda architectures. This is an interesting architecture that's been getting some buzz lately, and we're fortunate to have an experienced practitioner among us. I've included background links below.

--

Stream Architectures for Real-time Data Analysis

Some of the biggest issues at the center of analyzing large amounts of data are query flexibility, latency, and fault tolerance. Modern technologies that build upon the success of “big data” platforms, such as Apache Hadoop, have made it possible to spread the load of data analysis to commodity machines, but these analyses can still take hours to run and do not respond well to rapidly-changing data sets.

A new generation of data processing platforms -- which Parse.ly internally calls “stream architectures” -- have converted data sources into streams of data that can be processed and analyzed in real-time. This has led to the development of various distributed real-time computation frameworks (e.g. Apache Storm) and high-performance data integration technologies (e.g. Apache Kafka). Andrew Montalenti (Parse.ly's co-founder & CTO) will give an overview from what he has seen in the field, and how his team applied this knowledge to a backend re-implementation at Parse.ly.

Relevant links: Parse.ly - his company (http://parse.ly);  Pixel Monkey - his blog (http://pixelmonkey.org); @amontalenti - his twitter handle (http://twitter.com/amontalenti).

--

The Center for Open Science is located in the Downtown Business Center (DBC) of the Omni Hotel at 210 Ridge McIntire Road, Suite 500. The DBC faces Ridge/McIntire Rd. opposite Staples/McDonalds. You can park in the Omni parking garage – it's free, just bring your ticket inside for validation. You can enter through the glass doors in the front. Or, walk through the lobby of the Omni Hotel past the concierge desk, ballrooms, and through a set of double doors.

Some background links:

Great (long) LinkedIn Engineering Team post:  The Log: What every software engineer should know about real-time data's unifying abstraction

Andrew's post about that LinkedIn post: The Log: a building block for large-scale data systems

Big Data by Nathan Marz describing a similar architecture: MEAP and Free 1st Chapter (PDF)

Please RSVP if you are planning to attend so we can get the right amount of pizza.

See you next Wednesday!

-Al

[Peter Fries]

Nice! I posted this to data hackers.

--
You received this message because you are subscribed to the Google Groups "Richmond Software Craftsmanship Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to RSCG+uns...@googlegroups.com.
To post to this group, send email to RS...@googlegroups.com.
Visit this group at http://groups.google.com/group/RSCG.
For more options, visit https://groups.google.com/groups/opt_out.

[Christopher Wash]

Definitely interested in attending this one. Anyone else interested?

[Justin Etheredge]

I'm interested in going, but won't know for sure until early next week. You trying to get a carpool together?

[Peter Fries]

I'm interested too, but have to see how my week is shaping up

[Christopher Wash]

Yeah if you guys want to carpool let me know