Mom, I finally changed the world, even if only a little… 🥹❤️ Guys, presenting the World’s First Heterogeneous nvidia CUDA + apple Metal Distributed Inference Cluster 🎉 I managed to get Nvidia CUDA + Apple Metal running distributed LLM inference together — same pipeline, same ring. I owe this to exo’s amazing infrastructure. ❤️ The BF16 model splits across architectures — layers 0-10 on NVIDIA, layers 10-32 on Apple Silicon. I achieved this by adding just ~200 lines across 5 files to exo’s brilliant open-source codebase. PR to exolabs coming soon. #exolab #nvidia #macmini #apple #ai