Staff Software Engineer: AI Inference Data Plane
About the role
The data plane behind DigitalOcean's inference offering: multi-tenant, high scale, hosting large generative models with real availability requirements. Tensor and data parallelism, KV cache optimisation, and vLLM are named directly.
This is the layer where inference economics are decided, and it sits between distributed systems work and hardware behaviour in a way very few roles do.
US remote, Python and Go with Kubernetes and gRPC. The posting notes it is hands-on and expects full use of current AI coding tools.
Skills
How to apply
Apply directly on the employer's application page. Your application goes straight to them.
More from Digital Ocean
-
Manager, AI Engineering - AI & Business Tech Engineering
Digital Ocean US only · US (remote)
$180K - $200K per year -
Principal Software Engineer
Digital Ocean US only · US (remote)
$235.2K - $294K per year -
Principal Infrastructure Architect
Digital Ocean US only · US (remote)
$184K - $231K per year -
Principal Engineer, Data Center Architect
Digital Ocean US only · US (remote)
$184K - $231K per year
Jobs like this
-
Senior Platform Software Engineer, Transport
Fivetran US only · US (remote)
$152.9K - $183.5K per year -
Staff Software Engineer, AI Foundations (AI Agent Optimization)
Temporal North America · United States or Canada
$169.6K - $278.3K per year -
Software Engineer, Cloud Enablement
Temporal US only
$118.4K - $194.3K per year -
AI Provider Operations & Support Engineer
OpenRouter US only · US (remote)
$215K - $280K per year
Republished listing
This opportunity was discovered on Digital Ocean's public careers page and is republished here for discovery purposes. Applications are handled by the employer.
If this is your role and you want it off the board, contact us.