[v0.12.2] Deepseek R1 Distill 8B Q40 on 4 x Raspberry Pi 5 8GB · b4rtaz/distributed-llama · Discu...

https://github.com/b4rtaz/distributed-llama/discussions/162 Model: deepseek_r1_distill_llama_8b_q40 Version: 0.12.2 Evaluation Prediction 2 x Raspberry Pi 5 8GB 7.70 tok/s 3.54 tok/s 4 x Raspberry Pi 5 8GB 11.68 tok/s 6.43 tok/s 2 x Raspberry Pi 5 8GB ... 🔶... Powered by VoiceFeed. https://voicefeed.web.app/lp/podcast?utm_source=apple_githubtrenddaily&utm_medium=podcast Developer:https://twitter.com/_horotter