Censys Data Pipeline: Storing and Analyzing the Internet

Criteo - 523 S. Main Street Ann Arbor - View Map Ann Arbor
Wed, Jul 25, 2018, 6:00 PM (EDT)

About this event

This month, Andrew Sardone will provide an overview of Censys’s architecture, an internet-wide collection, with a focus on some of the lessons learned in making this dataset and insight accessible to all. We’ll talk about our development of our latest data pipeline, migrating from an in-house developed database and streaming service to a suite of Apache Beam pipelines deployed on Google Cloud Dataflow.

We’re lucky enough to have a lightning talk from Jerry Wiltse as well! - Bincrafters is an Open-Source software team with a complex CI footprint spanning more than 200 repositories on Github. As such, they have CI scalability and management challenges on-par with to those faced in enterprise environments. Jerry Wiltse will present “Domino” and “CI Anywhere”, two proposed projects that aim to address these challenges for both OSS and Enterprise CI workflows.

As always, pizza will be provided, and look forward to seeing everyone there!

When

Wednesday, Jul 25
6:00 PM - 8:00 PM (EDT)

Where

Criteo
523 S. Main Street Ann Arbor