About

I'm @ryanjamescaldwell, nice to meet you 👋

I'm a senior software engineer at GitHub, focused on designing and scaling the backend for Copilot Chat since 2023.

Improving token efficiency for GitHub Copilot in VS Code

How prompt caching, tool search, and WebSockets reduce Copilot's token usage and latency.

Cache Explorer comparing two Copilot requests and showing a 96.8% prompt cache hit

What I'm currently focused on

Building backend infrastructure for agentic developer tools: the API platforms, inference routing, and reliability systems that make them work at scale.

The pace of AI development right now is incredible. I don't find it chaotic, just genuinely engaging. Inference is being applied in brand-new ways every day, and figuring out how to expose that functionality through the API is work I spend a lot of time thinking about.

Outside of work

Making pourovers and lattes at home.

Spending time with my wife, daughter, cat, and dog.

Keeping up with the latest AI tools.

Automating all the things with Home Assistant.