Discover the power of event sourcing with Azure CosmosDB and Azure Function in our sharing! Learn how to build scalable, resilient systems through real-time data processing and seamless integration, transforming your architecture with serverless solutions. Unleash potential, optimize performance, and drive innovation in your applications.
Apache Airflow is a popular open source orchestration tool that helps you to programmatically create workflows that will help you run, schedule, monitor and manage data engineering pipelines. Apache Airflow workflows are created in Python, but increasingly users of Airflow are wanting to escape out of Python, and run their workflows using other tools, runtimes, and languages. Containers are the key to this, and in this talk I will take a look at some of the approaches you can take to run containers using Apache Airflow, including how you can run those tasks anywhere - in the clouds, or on premises.
Friday, April 12, 2024
11:30 AM – 2:00 PM (UTC)
11:00 AM | Registration & Welcoming |
11:30 AM | Introduction of NFQ and AWS |
11:45 AM | First Talk - Event Sourcing Patterns on Azure Cosmos DB |
12:15 PM | Break |
12:30 PM | Second talk - Using Apache Airflow as a container orchestrator |
1:00 PM | QnA |
1:30 PM | Pizzas & Beers |
CONTACT US