Software Engineering Daily podcast

Scaling Large ML Models to Small Devices with Atila Orhon

0:00
56:48
Rewind 15 seconds
Fast Forward 15 seconds

The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops. Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting

The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.

More episodes from "Software Engineering Daily"