Senior Machine Learning Perception Engineer, Fallback Driving System

General Motors (GM)

Confirmed live today High trust
Hybrid

Quick summary

Work type
Hybrid
Location
Sunnyvale, CAAtlanta, GAAustin, TXDetroit, MIWarren, MIMilford, MIMountain View, CA
Salary
$170,600–$261,300 / yr
Employment
Full-time
Posted
84 days ago
Freshness
Confirmed live today

Market check

Salary context

Competitive pay

How this pay compares to similar roles

Similar $227k
This role $216k
$157k $301k
below market most similar roles pay here above market

This role pays less than 58% of similar roles. Most pay $200,000–$254,750 — the blue band above. At the midpoint, this role pays about $216k versus about $227k for comparable roles.

Based on 240 similar postings.

Employer

About General Motors (GM)

General Motors (GM) is a leading American multinational automotive corporation founded in 1908 and headquartered in Detroit, Michigan.

General Motors (GM) currently has 196 open roles on FindRole.

Listed pay typically runs $159,200–$245,000 across 54 roles with salary data.

Most-posted roles

View all roles at General Motors (GM)

At a glance

TL;DR · Senior Machine Learning Perception Engineer, Fallback Driving System

As a Senior Machine Learning Perception Engineer on the State Estimation and Mapping organization, you will develop and improve the ML perception model for the secondary fallback autonomy stack for Super Cruise 3. You will build robust perception from multi-modal camera, lidar, and radar data to ensure the vehicle can safely reach a minimal risk condition when the primary stack fails. Your daily responsibilities include designing, training, and evaluating models for object detection, semantic/instance segmentation, tracking, and short-horizon prediction. You will utilize PyTorch, TensorFlow, or JAX and Python to build efficient training and inference pipelines, applying techniques like pruning and quantization. You must also demonstrate proficiency in C++ to integrate models into production systems. This role solves critical safety problems by managing long-tail scenarios and degraded-sensor conditions.

What you'll do

  • Design, train, and evaluate ML perception models for object detection, segmentation, tracking, and prediction.
  • Develop and maintain the secondary stack perception model to enable safe fallback autonomy.
  • Define ML success metrics and drive systematic experimentation to improve model performance and robustness.
  • Analyze large-scale datasets and build data selection and labeling strategies for long-tail scenarios.
  • Implement efficient training and inference pipelines using model optimization techniques like pruning and quantization.
  • Integrate models into production systems by collaborating with software and infrastructure engineers.
  • Translate system requirements into concrete ML model requirements, metrics, and validation criteria.
  • Contribute to verification and validation strategies including offline evaluation, simulation, and on-road testing.

What we're looking for

  • BS, MS, or PhD in Machine Learning, Robotics, Computer Science, or a related technical field; or equivalent practical experience.
  • 3–5 years of experience developing ML solutions in perception, prediction, and/or autonomous driving or related domains.
  • Strong experience with multi-modal sensor data including camera, lidar, and radar for preprocessing, synchronization, and fusion.
  • Deep expertise in modern deep learning for 2D/3D object detection, semantic/instance segmentation, and multi-object tracking.
  • Proficiency in Python and at least one major ML framework such as PyTorch, TensorFlow, or JAX.
  • Solid software engineering skills including experience working in C++ or similar languages in large, collaborative codebases.
  • Experience deploying ML models on embedded or resource-constrained platforms, including model optimization and performance tuning (preferred).
  • Experience with AV/ADAS perception stacks, robotics, or ROS (preferred).

More like this

Similar roles

Senior Machine Learning Engineer, Perception, Autonomous Driving

Nvidia

Remote (Santa Clara, CA) +5 21 days ago $184,000–$287,500
Machine Learning Computer Vision C++ Python PyTorch TensorFlow Deep Learning LiDAR Multi-sensor Fusion TensorRT Transformers Data Pipelines Object Detection Semantic Segmentation Model Optimization NVIDIA DRIVE AV
8+ yrs exp Remote

Senior Machine Learning Engineer

Nvidia

Santa Clara, CA 57 days ago
Machine Learning C++ Python PyTorch TensorFlow Computer Vision Multi-sensor Fusion Deep Learning TensorRT Transformers Data Pipelines Model Optimization NVIDIA DRIVE AV Object Detection Semantic Segmentation
8+ yrs exp