
0:00
1:03:57
VRAM prices are insane. Legacy cards are the answer.
Upcast BF16 to FP32. Use mixed INT8 quantization.
This saves thousands of dollars. It unlocks massive memory pools.
Blog: https://ojambo.com/bf16-upcasting-secret-for-legacy-gpus
Amazon Storefront: https://amzn.to/4xevbes - Explore the hardware, tools, and gear I use and recommend.
Video: https://youtube.com/live/ha19Ft7Pbgk
Books: https://www.amazon.com/stores/Edward-Ojambo/author/B0D94QM76N
Woodworking Blueprints: https://ojamboshop.com
Tutorials: https://ojambo.com/contact
Consultations: https://ojamboservices.com/contact
#VRAM #ROCm #AI
Mais episódios de "Tech Rants"



Não percas um episódio de “Tech Rants” e subscrevê-lo na aplicação GetPodcast.








