Senior ML Inference Engineer
Job Summary
The Model Deployment & Inference Solutions team seeks a Senior ML Inference Engineer to build platforms for deploying machine learning models onto autonomous vehicle hardware. You will automate the path from trained models to on-vehicle inference while optimizing for real-time latency and memory constraints. This role is critical to GM's autonomous driving initiative, focusing on scalable developer tooling and production-grade deployment workflows.
Responsibilities
- Develop and maintain automated ML deployment platforms.
- Optimize models for real-time latency and memory on autonomous hardware.
- Build agentic tools to diagnose and resolve deployment issues.
- Improve developer experience and observability dashboards.
- Coordinate cross-team model deployment and integration.
Required Skills
- BS/MS/PhD in Computer Science or related field
- 3+ years industry experience
- Proficiency in Python
- Experience with ML infrastructure/serving
- Familiarity with coding agents and clean software design
Job Details
What you'll be doing (Responsibilities)
- Design, build, and operate the ML deployment platform that automates the path from trained model to on-vehicle inference.
- Drive cross-organization model deployments to the autonomous vehicle stack, partnering with model development teams to take high-value models from training to production on-vehicle.
- Build agentic tools that diagnose and fix deployment-blocking issues, automating workflows currently performed manually by engineers.
- Build the developer experience that ML model development teams use day to day: tooling, dashboards, automation, and observability.
- Drive shift-left validation that surfaces deployment risk (compile, runtime, parity, latency) early in the model development cycle.
- Build platform tools that integrate the work of our sister teams (kernels, compiler, reduced precision and parity) so their optimization wins land directly in the deployment workflow.
- Partner with the team's Performance pillar and model development teams across the AV organization.
Your Skills & Abilities (Required Qualifications)
- BS, MS, or PhD in Computer Science or a related technical field.
- 3+ years of relevant industry experience.
- Strong fundamentals and excellent coding ability in Python.
- Experience building or operating production platform or infrastructure systems where reliability, observability, and extensibility matter.
- Experience with ML model deployment, inference integration, model optimization workflows, or model serving infrastructure.
- Experience using coding agents (Cursor, Claude Code, GitHub Copilot, or equivalent) as part of your engineering workflow.
- Experience designing clean, well-tested software with clear interfaces and good abstractions.
- Strong cross-team collaboration skills.