Profile

H A R S H H A A

Admin

DevOps Engineer/Content Creator

GitHubJoined April 2025

13posts

Likes29,501

Posts13

The Sub-$1,000 MoE Cluster: Serving a 70B Mixture-of-Experts with Speculative Expert Paging

How asynchronous NVMe streaming, router logit lookahead, and tiered ring buffers push production-grade inference out of commodity hardware.

2,516181

Scaling Beyond a Single Box: Engineering Multi-Node Distributed LLM Serving for Production

How tensor parallelism, 200 Gb/s RoCE, and low-level runtime forensics turn raw multi-GPU hardware into a rock-solid, 1-million-token AI serving platform.

3,721200

Squeezing a 27B LLM into a $700 GPU: A Masterclass in AI Platform Engineering

How low-level inference engineering, 4-bit quantization, and speculative decoding push 1,000+ tokens/sec out of a consumer RTX 3090.

2,486151

AI Token Cost: What Is a Token — and How Every Model Games the Count

Complaints about opaque AI pricing are flooding social media. Which ones hold up to scrutiny and which are just users' overactive imaginations? How do models slip past their own published rate cards? How do usage limits actually work, and why do companies benefit from keeping the explanations as vague as possible?

10,059382

🚨 Upload your CV to Claude.

7 prompts that will uncover positions you never realized matched your experience.

13,040317

🚀 CI/CD in DevOps: Building a Scalable Pipeline on AWS

In this post, we’ll walk through how to set up a CI/CD pipeline for a simple Node.js application using AWS CodePipeline, CodeBuild, and CodeDeploy.

80,5924,351

Learn DevOps by Playing Games 🎮

Ever thought learning DevOps could be fun? Check out this blog post where I explore gamified resources that teach CI/CD, containers, Kubernetes, and more — all through interactive games!

56,9133,426

End-to-End DevOps with Azure and GitHub Actions: A Developer's Journey

In this blog, I share how to set up a simple yet powerful CI/CD pipeline using GitHub Actions and Azure App Service. From automating deployments to securing credentials and running tests, this guide walks through the end-to-end DevOps workflow—perfect for developers looking to streamline cloud deployments with minimal setup

56,3063,943

🚀 Streamline Your CI/CD with AWS CodePipeline

Learn how AWS CodePipeline can automate your CI/CD workflow for faster, more reliable deployments. From source to production, streamline your release process with ease using AWS-native tools.

57,5034,202

🐧 Understanding Linux File System: Key Topics for DevOps in 2025

A quick dive into the Linux file system essentials every DevOps engineer should master in 2025. From file permissions to logs, mounts, and container file systems, this guide highlights the key areas to focus on for better infrastructure management and debugging.

46,3472,831