Kubernetes SF: Building an Automated Data Pipeline & Cilium App Aware Security

San Francisco Kubernetes Meetup

Mar 16, 2018, 1:30 – 3:30 AM

In-person event

About this event

Kubernauts! We are excited to announce the next San Francisco Kubernetes meetup will be March 15, 2018 at Amazon in San Francisco.

We'll be jumping into Cilium and a production story on how Komodo Health built an automated data pipeline on K8s. Also, if you'd like to present please ping me via meetup or twitter @baldwinmathew. Email is baldwin_at_stackpoint.io.

SPONSORED: Spin up and manage a Kubernetes cluster with Istio at AWS, GCE, GKE, DigitalOcean or Azure using Stackpoint.io today! https://stackpoint.io/clusters/new?solution=istio&utm_source=meetup&utm_medium=event_page&utm_campaign=sf_k8s


6:30 - 7:00 - Social

7:00 - 7:30 - Cilium: Application-Aware Security for Microservices via BPF - Cynthia Thomas

BPF (Berkeley Packet Filter) is becoming the fastest growing technology in the Linux kernel and is revolutionizing networking, security and tracing. At the same time, the rise of container-based orchestration platforms such as Kubernetes is creating demand for routing, load-balancing & security infrastructure that is highly scalable, application-aware, and resilient. This talk introduces the open source project Cilium - a modern networking and security platform for microservices. Cilium is built on top of BPF and provides Linux native networking and security services with application protocol awareness. Cilium works hand in hand with application proxies such as Envoy and the services management orchestration layer Istio to provide infrastructure services in a transparent manner and with minimal overhead. This talk will discuss the challenges of exposing services via APIs and the solution that Cilium provides to enforce least privilege security.

7:30 - 8:00 - Building an Automated Data Pipeline - Challenges & Gotchas - Weiwei Zhang

This talk is an overview of how the Data Engineering team at Komodo Health tackles configuration management, automating data deployment via micro-services, and creating a paradigm for collecting and analyzing logs. It introduces the challenges the team faced during creating and maintaining these systems and shares what they have learned from leveraging open-source tools like Airflow, Kubernetes and Spark.

8:00 - Social, Wrap-up, Jet


Cynthia Thomas (@_techcet_) is a Technology Evangelist at Covalent IO. Her background includes working with open source cloud & networking solutions. Since 2015, she has been working on Docker and Kubernetes with CNI plugins, currently through the open source project Cilium (www.cilium.io). She is a frequent speaker at conferences, including ContainerCon, Container Camp, DevOps Days, DockerCon, IT Cloud Computing Conference (IC3), and OpenStack Summits & MeetUps. Cynthia received her B.Sc. (Eng) and M.Sc. (Eng) from Queen’s University in Kingston, Canada.

Twitter: @_techcet_

Weiwei Zhang is a Data Engineer at Komodo Health.


Our friends at Amazon have offered to provide space for this upcoming event.



Friday, March 16, 2018
1:30 AM – 3:30 AM UTC


  • Jason Smith


    App Modernization Specialist

  • Reyann Lejano

    Red Hat

    Solutions Architect