Hi, I'm Ayush Saxena, a software engineer.

I build high‑scale, low‑latency systems. multi‑tenant AI platforms. distributed systems. products thousands rely on every day. AI that cuts costs, not corners. open‑source tools that get under the hood.

I specialize in software architecture, distributed systems and generative AI, and I enjoy turning hard problems into simple, scalable systems. Right now I'm an SDE 2 and founding engineer at Meesho AI Services, building the core platform the vertical runs on. Off the clock I go low-level: building open-source tools and writing about what I find inside.

Work

  • Platform and architecture
  • AI and LLMs
  • Backend and distributed systems
  • Data and infra
  • Product and frontend
  1. 2024 – now
    2024 – now

    Meesho

    Intern to SDE 2 in 19 months.
    1. InternJan 2024
    2. SDE 1Jul 2024
    3. SDE 2Aug 2025
    SDE 2

    Software Development Engineer 2

    Aug 2025 - Present
    • Founding engineer, Meesho AI Services

      Architected the core multi-tenant AI platform behind voice, chat, agent assist and campaign management. It now handles 2.5M+ interactions a day and made AI Services a new business line for Meesho.

      0 → 10+enterprise clients
    • Agent-assist platform

      Real-time insights and guided actions for 2,000+ concurrent support agents, all in one interface, which also brought agent costs down.

      30%lower average call handling time
    • No-code agent builder

      DAG-based orchestration on a config-driven CRM and data platform. 50+ product and business people launch agents themselves, with far less dependence on engineering, and new clients onboard much faster.

    • Config, experiments and rules engine

      One platform for configuration, live A/B experiments and business-logic changes across 10+ services.

      <1msoverhead at 1,000+ RPS
    • Real-time AI observability platform

      Turn-level tracing, self-serve testing and agentic production debugging across voice and chat, with zero added call latency and query latencies in the low hundreds of milliseconds.

    • Adaptive LLM routing

      Region selection and cross-model fallbacks that cut mean latency by 200ms and let the platform recover from provider incidents 90% faster.

      75%lower LLM error rate
    • Lower voice bot cost per call

      Reduced through a model experimentation platform and cross-model fallbacks, enabling faster evaluation and onboarding of new LLM, TTS and ASR models.

    • Leading the Execution Excellence pod

      Automating tenant onboarding, testing and RCA feedback loops, halving go-live timelines and multiplying the pilots each person can deliver.

    • Go
    • Python
    • gRPC
    • MongoDB
    • Redis
    • Kafka
    SDE 1

    Software Development Engineer 1

    Jul 2024 - Aug 2025
    • India's first LLM voice bot at scale

      Customer support voice bot on a real-time ASR, LLM and TTS pipeline. Cost per call down 75%, handling time down 40%.

      1M+calls a day
    • Multi-model RAG chatbot

      DAG-orchestrated chatbot with retrieval over support knowledge, handling 1M+ queries a day and routing each one to the lowest-cost capable model.

    • Python
    • LLM
    • RAG
    • Flask
    • Java
    • Spring Boot
    • Kafka
    • Redis
    Intern

    Software Developer Intern

    Jan 2024 - Jul 2024
    • Reverse shipment tracking, rebuilt

      Migrated the end-to-end flow from a legacy PHP monolith to an event-driven Java microservice.

      5M+requests a day
    • GenAI catalogue enrichment

      Rebuilt the experimentation setup to run concurrent A/B tests on catalogue images, speeding up generative vision experiments for product discovery.

    • Java
    • Spring Boot
    • Kafka
    • Redis
    • Elasticsearch
  2. 2023
    2023

    Summer of Bitcoin, Eye of Satoshi

    Software Developer Intern

    May 2023 - Aug 2023
    • Open-source watchtower dashboard

      Operator dashboard for Eye of Satoshi, a Bitcoin Lightning watchtower, with real-time user, appointment and breach tracking. Also improved error handling in teos-cli.

      100+operators
    • TypeScript
    • React
    • NestJS
    • Rust
    • gRPC
    • Docker
  3. 2023
    2023

    Probe AI

    Software Developer Intern

    Apr 2023 - May 2023
    • Auto-fix for LLM-generated SQL

      Query auto-fix and dry runs for a database-aware text-to-SQL tool, plus support for MySQL, PostgreSQL, BigQuery and Snowflake side by side.

      85 → 94%SQL query accuracy
    • NestJS
    • React
    • LLM
    • AWS
    • Metabase
  4. 2022
    2022

    Fyntune Solutions

    ReactJs Developer Intern

    Jun 2022 - Nov 2022
    • Insurance product front ends

      Worked across 10+ digital insurance products and led six launches, with a front-end rework and client-side caching that made pages load faster.

    • React
    • Redux

Skills

Tools and techniques

Pick a focus area above to highlight what I use for it.

  • LLMs
  • RAG
  • AI agents
  • Speech to text
  • Text to speech
  • Claude
  • Go
  • Python
  • Java
  • gRPC
  • Gin
  • Spring Boot
  • FastAPI
  • Flask
  • Kafka
  • Redis
  • MongoDB
  • PostgreSQL
  • ClickHouse
  • ScyllaDB
  • Elasticsearch
  • Docker
  • AWS
  • Jenkins
  • ArgoCD
  • Grafana
  • Git
  • TypeScript
  • JavaScript
  • React
  • Node.js

About

I'm a Software Development Engineer 2 at Meesho. I joined as an intern in 2024, helped launch India's first LLM-powered customer support voice bot at scale, and then became a founding engineer of Meesho AI Services.

I like problems where distributed systems and AI meet: routing across models and regions, keeping latency low on real-time voice, and building platforms that let other people ship agents without waiting on engineering.

Building
The core platform behind Meesho AI Services
Exploring
Low-level systems, concurrency and performance
Studied
B.Tech in CSE at IIIT Jabalpur, 8.7 CPI
Off the clock
Football and dancing

Achievements

  • SpeakerMeesho BharatConf '25On scaling India's first GenAI voice bot.
  • 3rdHackMee 3.0Out of 130+ teams, with a voice bot that tests other voice bots.
  • 2 awardsRecognised at MeeshoAppreciation at the AI Services All-Hands 2025, and a Panchayat Award.
  • Top 44Summer of Bitcoin 2023Selected from 10,350 applicants.
  • 20345★ on CodeChefMaximum rating.
  • 1438Specialist on CodeforcesMaximum rating.
  • KnightLeetCode badge700+ problems solved across platforms.
  • 1,000+Students supportedAs UG Coordinator, Counselling Services at IIIT Jabalpur.

Side projects

  • Gmeter

    An agent-friendly, open-loop load tester for HTTP and gRPC that reports honest latency and tells you when the generator itself is the problem. Runs from the CLI, inside a Go test, or as an MCP server for AI agents.

    • Go
    • gRPC
    • Docker
    • MCP
  • DevHub

    A social platform for developers to showcase projects and connect with each other.

    • React
    • Redux
    • Node.js
    • Express
    • MongoDB
  • AlgoX

    A sorting algorithm visualizer with custom inputs, speed and array-size controls.

    • React
    • CSS
  • Shoppy

    A full-stack shopping website and clothing store management system.

    • React
    • Node.js
    • Express
    • MySQL
  • Findit

    A web app for finding nearby stores and facilities based on what you need.

    • React
    • Redux
  • NewsIt

    A cross-platform mobile app for news and articles.

    • React Native
    • Context API

Got a hard problem? I'd like to hear it.

I'm always up for a conversation about systems, development, AI or anything in between.