Spark with OpenShift & Service Mesh & Open Source Projekt Freifunk

Computacenter - Werner-Eckert-Straße 14-18 81829 München - View Map München Kubernetes/Cloud-Native Meetup
Wed, Sep 26, 2018, 6:00 PM (CEST)

About this event

Hello Kubernauts,

Join us for our next Munich MeetUp in September!
This time we've got three great speakers for you. Franz Wimmer from QAware starts and presents his master thesis about „Leveraging the power of SolrCloud and Spark with OpenShift". Followed by Miriam Bressan from Computacenter, she will clarify the question "What is a Service Mesh and why do I need Sidecars?" and lead over to Daniel Fussy. He will talk about the "Open Source Projekt Freifunk München".

Due to the October season, we've got pretzels and beer.

Agenda:

6:00 PM - Admission
6:30 PM - Franz Wimmer
7:00 PM - Miriam Bressan
7:30 PM - Daniel Fussy
8:00 PM - Food & Drinks & Networking

*********************************************************************

Franz Wimmer, QAware GmbH

Leveraging the power of SolrCloud and Spark with OpenShift:

One of the most commonly used big data processing frameworks is Apache Spark. Spark manages to process large datasets with parallelization. Solr is a search platform based on Lucene. Solr can be distributed across a cluster using ZooKeeper for configuration management. Both applications can be combined to create performant Big Data applications.
But what if you want to scale up horizonally and add a node? In a manual setup, you'd have to install the new node manually. Cluster orchestrators like OpenShift claim to solve this problem.
This talk shows how to put Spark, Solr and ZooKeeper into containers, which can then be scaled individually inside a cluster using OpenShift. We will cover OpenShift details like DeploymentConfigs, StatefulSets, Services, Routes and Persistent Volumes and install a complete, failsafe and horizontally scaleable SolrCloud / Spark / Zookeeper cluster in seconds.
You will also learn about the drawbacks and pitfalls of running Big Data applications inside an OpenShift cluster.

*********************************************************************
Miriam Bressan, Computacenter AG & Co oHG

What is a Service Mesh and why do I need Sidecars?

The complexity in managing communication between service instances increases with the number of microservices in our happily growing containerized world. At the same time DevSecOps and Container Security topics gain a lot more attention lately and need to be addressed by design.
A Service Mesh supports by adding functionalities like service discovery, load balancing, encryption, authentication, service authorization and many more.
Hear about how projects like istio and envoy in combination with Kubernetes and Kubernetes-based PaaS solutions like Openshift integrate well to make use of the powerful service mesh approach.

*********************************************************************

Daniel Fussy

Open Source Projekt Freifunk München:

The project Freifunk Munich is building a city-wide data network with WLAN devices called nodes. The use is free from registration and collection of information. Specifically, Freifunk has set itself the goal of setting up open wireless networks and connecting them together. This allows free traffic "through the air" throughout the city within the free-radio network. Freifunk is thus an open non-commercial, non-hierarchical initiative for free wireless networks.

*********************************************************************

If you have any questions, please feel free to ask in the comment section below.

See you there!

When

Wednesday, Sep 26
6:00 PM - 9:00 PM (CEST)

Where

Computacenter
Werner-Eckert-Straße 14-18 81829 München