We have invited two experts on the frontier of keeping data & state in Kubernetes:
Talk 1: "Data-Aware Scheduling in Kubernetes", by Johannes Scheuermann
In order to provide prompt results and efficiently deal with data-intensive workloads, Big Data applications execute their jobs on compute slots across large clusters. Also, for optimal performance, these applications should be as close as possible to the data they use. Data-aware scheduling is the way to achieve that optimization and can conveniently be set up using Kubernetes. We’ll present two different use cases: First, we’ll make use of how Big Data applications like Hadoop and Spark can use their native HDFS protocol for data-aware scheduling. Second, we’ll demonstrate an efficient way to write a data-aware scheduler for Kubernetes that satisfies not just your application’s requirements, but also keeps your admins happy. As a bonus, it’ll also allows us to run data-aware scheduling on applications other than Big Data.
Johannes is an operations guy with a software development background. He's been working with Containers and Kubernetes for over years. He has a strong interest in modern infrastructures and building infrastructure software.
Talk 2: "Managing Stateful Services with the Operator Pattern", by Jakob Karalus
While it's easy to deploy stateless application with Kubernetes, it's harder for stateful software. Since applications often require custom functionality that Kubernetes can't provide, developers want to add more specialized patterns like automatic backups, failover or rebalancing to their Kubernetes deployments. In this talk, we will look at the Operator Pattern and other possibilities to extend the functionality of Kubernetes and how to use them to operate stateful applications.
Jakob is a IT-Consultant at codecentric focusing on DevOps and Data Science. Currently, he is deeply into kubernetes but he also likes to play around with exciting and evolving technologies around orchestration, automation and Machine Learning. He holds a masters degree in Computer Science from the Ludwig Maximilians University Munich.
So if you have read until here, you might not only be interested in the above topics, but you surely also have something to share. Let us know if you want to volunteer for presenting your topic at our next meetup or if you know someone who would and last not least, let us know which topics would be of interest and let's find an expert together ...