@Scale Conferences podcast

Scaling AI Infrastructure: Inside CoreWeave’s Global Network with Jim Julson

0:00
47:18
Rewind 15 seconds
Fast Forward 15 seconds

What does it take to build and scale the infrastructure powering the AI revolution?

In this episode of the @Scale podcast, Francois Richard, Engineering Director at Meta, sits down with Jim Julson, VP of Global Infrastructure Networking at CoreWeave, to explore the technical and organizational challenges of scaling AI infrastructure.

Jim shares lessons from his experience helping CoreWeave grow from standing up four data centers in just 90 days to operating a global infrastructure footprint that continues to evolve alongside the rapidly growing demands of AI.

The conversation covers:

• Building and scaling AI infrastructure at unprecedented speed

• The role of engineering “heroes” — and why teams need a culture of ownership to scale effectively

• Event-driven automation and CoreWeave’s approach to infrastructure management

• Building observability systems for large-scale AI infrastructure

• Capacity planning across GPUs, CPUs, switches, and networks

• The opportunities and limitations of using AI agents in production environments

• Why infrastructure architectures need to continuously evolve as AI workloads grow

• Building an engineering culture where teams collaborate, take ownership, and learn from one another

Jim also shares a look at his personal passion for automation: building a fully automated home theater with custom LED lighting and event-driven controls.

Tune in for a behind-the-scenes look at the infrastructure, engineering practices, and culture helping power AI at scale.

Want to attend conversations like this in person? Register for an @Scale event here: atscaleconference.com

More episodes from "@Scale Conferences"