Software Engineering Daily podcast

Scaling Large ML Models to Small Devices with Atila Orhon

0:00
56:48
Spola tillbaka 15 sekunder
Spola framåt 15 sekunder

The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops. Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting

The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.

Fler avsnitt från "Software Engineering Daily"