Scaling Large ML Models to Small Devices with Atila Orhon
07/05/2024
0:00
56:48
The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops. Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting
The post Scaling Large ML Models to Small Devices with Atila Orhon appeared first on Software Engineering Daily.
D'autres épisodes de "Software Engineering Daily"
Ne ratez aucun épisode de “Software Engineering Daily” et abonnez-vous gratuitement à ce podcast dans l'application GetPodcast.