Senior Engineer II, AI Inference Engine Systems
About the role
The senior counterpart to the staff inference data plane role. High-scale, resilient services powering inference as a service, at the intersection of distributed systems and specialised AI hardware. Throughput, latency and GPU utilisation are all in tension, and small improvements compound across an entire fleet.
US remote, Python and Go with gRPC and vLLM. The posting notes it is hands-on and expects you to make full use of current AI coding tools.
Skills
How to apply
Apply directly on the employer's application page. Your application goes straight to them.
More from Digital Ocean
-
Manager, AI Engineering - AI & Business Tech Engineering
Digital Ocean US only · US (remote)
$180K - $200K per year -
Principal Software Engineer
Digital Ocean US only · US (remote)
$235.2K - $294K per year -
Principal Infrastructure Architect
Digital Ocean US only · US (remote)
$184K - $231K per year -
Principal Engineer, Data Center Architect
Digital Ocean US only · US (remote)
$184K - $231K per year
Jobs like this
-
Staff Software Engineer- AI Platform
Aledade US only · United States
$176K - $238K per year -
Senior Software Engineer - Builder Platform
Temporal US only · United States
$140.8K - $231K per year -
Senior Software Engineer
Coinbase US only · US; quarterly in-person sessions
$186.1K - $218.9K per year -
Staff Software Engineer, AI Foundations (AI Agent Optimization)
Temporal North America · United States or Canada
$169.6K - $278.3K per year
Republished listing
This opportunity was discovered on Digital Ocean's public careers page and is republished here for discovery purposes. Applications are handled by the employer.
If this is your role and you want it off the board, contact us.