Running a 552B MoE on Two Desktop Workstations: Dissecting MiaAI’s DeepSeek V4.1 Flash EXL3 Stack
How fine-grained 2.9 bpw mixed quantization, unified memory management, and DSpark speculative decoding fit DeepSeek V4.1 Flash across dual NVIDIA DGX Sparks.
Part of Track
LLMOps & Production AI Infrastructure
DevOps & AI Architecture Dispatch
Join engineers receiving hands-on writeups on Kubernetes clustering, Terraform GitOps, distributed ML infrastructure, and low-latency LLMOps. No marketing fluff—strictly technical notes.
Join the Discussion on Running a 552B MoE on Two Desktop Workstations: Dissecting MiaAI’s DeepSeek V4.1 Flash EXL3 Stack
Comments and Q&A are powered by GitHub Discussions. To enable them with zero maintenance, add your repository IDs to your environment variables or visit giscus.app.
The Sub-$1,000 MoE Cluster: Serving a 70B Mixture-of-Experts with Speculative Expert Paging
How asynchronous NVMe streaming, router logit lookahead, and tiered ring buffers push production-grade inference out of commodity hardware.
H A R S H H A ACI/CD in DevOps: Building a Scalable Pipeline on AWS
How to take a Node.js application from local git push to zero-downtime AWS deployment using CodePipeline, CodeBuild, and CodeDeploy.
H A R S H H A AScaling Beyond a Single Box: Engineering Multi-Node Distributed LLM Serving for Production
How tensor parallelism, 200 Gb/s RoCE, and low-level runtime forensics turn raw multi-GPU hardware into a rock-solid, 1-million-token AI serving platform.
H A R S H H A A