Software Engineer- GPU Fabric Observability

About Baseten

Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

The Role

Baseten is building its own GPU infrastructure for large‑scale inference. As we move into large‑scale, high‑density NVIDIA systems, the hardest failures are intermittent, cross‑layer, and difficult to prove: RoCE congestion, InfiniBand stalls, ECN/DCQCN mis‑tuning, bad optics, RNIC issues, host kernel stalls, GPU driver problems, and workload symptoms that look like network problems, b...