Squeezing a 27B LLM into a $700 GPU: A Masterclass in AI Platform Engineering

How low-level inference engineering, 4-bit quantization, and speculative decoding push 1,000+ tokens/sec out of a consumer RTX 3090.

Content

H A R S H H A A6 days ago

Scaling Beyond a Single Box: Engineering Multi-Node Distributed LLM Serving for Production

How tensor parallelism, 200 Gb/s RoCE, and low-level runtime forensics turn raw multi-GPU hardware into a rock-solid, 1-million-token AI serving platform.

3,721200

H A R S H H A AAug 14, 2026

AI Token Cost: What Is a Token — and How Every Model Games the Count

Complaints about opaque AI pricing are flooding social media. Which ones hold up to scrutiny and which are just users' overactive imaginations? How do models slip past their own published rate cards? How do usage limits actually work, and why do companies benefit from keeping the explanations as vague as possible?

10,059382

H A R S H H A AMay 12, 2025

🚀 CI/CD in DevOps: Building a Scalable Pipeline on AWS

In this post, we’ll walk through how to set up a CI/CD pipeline for a simple Node.js application using AWS CodePipeline, CodeBuild, and CodeDeploy.

80,5914,351