AI Defense in Prod: Minimal and Zero CVE CUDA Images with Chainguard

Kubernetes Austin

May 17, 5:00 – 6:00 PM

Virtual event

About this event

Deep learning is moving out of the lab and into production at a breakneck pace. However, as CNNs get baked into real-time applications and models run in inference become the responsibility of devops teams, security becomes a major issue.

In this presentation, Dr. Patrick Smyth, Staff Developer Relations Engineer at Chainguard, will discuss and demo new CUDA-powered Chainguard Images. While runtime images for major AI frameworks tend to throw in the kitchen sink by including hundreds of packages, these Chainguard Images for PyTorch and NeMo aim to be as minimal as possible to reduce attack surface, and at time of writing have 0 CVEs compared to the dozens of CVEs in official images. We'll train a simple animal recognition model, compare these images with their official counterparts, and discuss some of the advantages and tradeoffs in building on these base images. And, yes, there will be some jokes and animated GIFs along the way

Speaker

  • Patrick Smyth

    Chainguard

    Staff Developer Relations Engineer

Moderator

  • Chad M. Crowell

    CNCF

    Ambassador

Organizers

  • Chris Aniszczyk

    Linux Foundation (CNCF)

    CTO

  • James Angel

    Kubernetes Austin

  • Chad Crowell

    Civo

    Kubernetes SME

  • Rafael Brito

    StormForge

    Staff Engineer at StormForge

Titanium

Chainguard logo

Chainguard

Media

Civo logo

Civo

CONTACT US