Abhishek Bhardwaj

Abhishek Bhardwaj

My expertise lies at the intersection of Distributed Systems and Operating Systems. I am currently exploring Sandboxes and Infrastructure for AI Agents

2024 - Present

I joined South Park Commons and built Arrakis - secure sandboxes for AI Agents. Checkout a demo in this viral X post.

  • Solo founder of Arrakis - MicroVM based sandboxes for AI Agents for computer use and code execution.
  • Provides an on-prem and local first solution to spawn and manage cloud-hypervisor based MicroVMs.
  • Supports snapshotting and restoring VMs to support Monte Carlo Tree Search based AI Agents.
  • Supports a Python SDK (py-arrakis) and MCP.
2023 - 2024

Staff Software Engineer, Platform And AI Infrastructure at Replit Inc.

  • Implemented a new reverse WebSockets proxy Kubernetes service that proxies all client connections to their containers. Handles 1M WAUs and slow draining of client connections.
  • TL for microVM based sandboxes for user code. Using cloud-hypervisor VMs on top of GCP bare metal servers at scale.
  • Developed sidecar service for RAG based code chat: file chunking and fanotify-based change detection.
  • Implemented Redis caching to reduce GCS operation rate limiting, achieving 5% monthly cost savings.
  • Implemented an Operational Transform persistence layer to persist user edits in the container to GCS.
2015 - 2023

Technical Lead, Containers and Virtualization, ChromeOS Platform Engineering at Google Inc.

  • Founding engineer on Rust-based "crosvm", a VMM to run Virtual Machines on ChromeOS.
  • Designed and implemented "concierge", a daemon in C++ that manages Virtual Machines on 10M+ Chromebooks.
  • Founding engineer on Android app support on ChromeOS with Linux containers, achieving 20K+ MAUs.
  • Implemented Trusted Execution Environments (TEE) support on ChromeOS using Virtio-Vhost-User protocol in Rust and C++.
  • Implemented privileged container support using the LXC containers GoLang API over gRPC.
  • Implemented 30+ Android APIs (Android Framework) in Java to enable compatibility with Android Networking and Power stacks on ChromeOS.
  • Designed and implemented C++ "cron"-like OS update policy system in Chrome and ChromeOS.
  • Improved Android emulator boot time on ChromeOS by 30% through 'perf kvm' profiling and VMEXITS reduction.
2013 - 2015

Software Engineer, Wearables OS, Windows Subsystem For Linux at Microsoft Corporation

  • Designed WSL file sharing between Windows and Linux via inode caching, serving 10M+ MAUs.
  • Founding engineer on Microsoft Band (Smartwatch) OS team.
  • Implemented core features in C including the Scheduler, Sensor Power Manager, Updater and Syncing Protocol. 200K+ units sold.