Securing LLMs using HashiCorp Vault & Just-in-time Nodes for {Any} K8s Cluster


May 22, 2:30 – 6:00 PM

In-person event

About this event


16:30: Doors open

17:00: Welcome by Cloud Native Aarhus

17:10: Welcome by our host SEGES Innovation

17:15: "Securing custom LLMs using HashiCorp Vault" by Nic Jackson, HashiCorp

18:00: Break with food

18:30: “Just-in-time Nodes for {Any} Kubernetes Cluster” by Hari Charan Ayada, AWS

19:30: Networking

20:00: Doors close

TALK 1: Securing custom LLMs using HashiCorp Vault

Building custom Large Language Models (LLM) using private data dramatically benefits your business by allowing the model to understand specific documents and data unavailable in public datasets. 

However, there are issues with this approach; one problem is how you secure the data used to train the dataset, and another is how you ensure that this data remains private, specifically when using the public cloud.
Secondly, how do you ensure that your compiled models are tamper-proof and have not been manipulated by a hostile actor? 

This talk will show you how to solve both problems using HashiCorp Vault, and how to do it using common Kubernetes patterns that you are used to.
You will learn how to install Vault onto your own server using the Helm, how to install the operator, and all the configuration you need to secure and configure Vault. 

We will wrap up all this in a healthy layer of fun, and as a takeaway, you can try these techniques on your own using the interactive workbook provided at the end of the session.

Nic Jackson is a developer advocate at HashiCorp and has over 25 years of industry experience working with and creating open-source software and distributed systems.
One of his core interests is system connectivity and reliability. Nic is the CNCF TAG Network co-chair and a published author working on his second book, Service Mesh Patterns for O’Reilly Media.

Talk 2: Karpenter: Just-in-time Nodes for {Any} Kubernetes Cluster

Karpenter simplifies Kubernetes infrastructure with the right nodes at the right time. 

Karpenter automatically launches just the right compute resources to handle your cluster’s applications.
It is designed to let you take full advantage of the cloud with fast and simple compute provisioning for Kubernetes clusters. 

Join Hari Charan Ayada, as he guides us through the tour of Scaling Adventures with Karpenter. 


Solution Architect from Amazon Web Services
Right at home when sharing insights on containerization, architecture, DevOps, and cloud technologies in a relatable way.
I’m committed to making complex concepts accessible to foster learning across every audience.


You can find free parking lots in the "gæsteparkering"-areas marked with red on this map.


  • Nic Jackson


    Developer Advocate

  • Hari Charan Ayada


    Solution Architect



Wednesday, May 22, 2024
2:30 PM – 6:00 PM UTC


  • Kasper Borg Nissen


    Lead Organizer

  • Rasmus Steiniche


    Lead Organizer

  • Ophelia Zhang Dalsgaard

    Danske Bank

    Squad & Chapter Lead

  • Henrik Høegh


    Digital Platform Owner

  • Henrik Løvborg

    Red Hat

    Tech Sales Lead Denmark

  • Stefan Daugaard


    Area Tech Lead

  • Ryan Gough

    Senior IT Operations Specialist / Platform at JYSK

  • Kasper Tygesen

    OK a.m.b.a.

    Chief Solutions Architect


SEGES Innovation logo

SEGES Innovation