Staff Software Engineer: AI Inference Data Plane
About the role
The data plane behind DigitalOcean's inference offering: multi-tenant, high scale, hosting large generative models with real availability requirements. Tensor and data parallelism, KV cache optimisation, and vLLM are named directly.
This is the layer where inference economics are decided, and it sits between distributed systems work and hardware behaviour in a way very few roles do.
US remote, Python and Go with Kubernetes and gRPC. The posting notes it is hands-on and expects full use of current AI coding tools.
Skills
How to apply
Apply directly on the employer's application page. Your application goes straight to them.
More from Digital Ocean
-
Manager, AI Engineering - AI & Business Tech Engineering
Digital Ocean US only · US (remote)
$180K - $200K per year -
Principal Software Engineer
Digital Ocean US only · US (remote)
$235.2K - $294K per year -
Principal Infrastructure Architect
Digital Ocean US only · US (remote)
$184K - $231K per year -
Principal Engineer, Data Center Architect
Digital Ocean US only · US (remote)
$184K - $231K per year
Jobs like this
-
Staff Software Engineer- AI Platform
Aledade US only · United States
$176K - $238K per year -
Senior Platform Software Engineer, Transport
Fivetran US only · US (remote)
$152.9K - $183.5K per year -
Staff Software Engineer, Ecosystem
Boulevard US only · United States
$193.9K - $225K per year -
AI Native Senior Software Engineer
Versaterm Canada only · Canada
$140K - $170K per year
Republished listing
This opportunity was discovered on Digital Ocean's public careers page and is republished here for discovery purposes. Applications are handled by the employer.
If this is your role and you want it off the board, contact us.