0:00
56:48
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops. Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
More episodes from "Software Engineering Daily"
Don't miss an episode of “Software Engineering Daily” and subscribe to it in the GetPodcast app.