Senior Software Engineer, NIM Model Customization

What you'll do

• Build the fine-tuning handoff pipeline including LoRA adapter repackaging, re-quantization, and re-validation.
• Develop an evaluation harness to ensure models meet high performance standards.
• Implement an observability and attestation layer to produce auditable compliance artifacts.
• Partner with ISVs and CSPs to roll out NVIDIA NIMs on a large scale.
• Define and improve durable platform APIs to avoid one-off integrations.
• Manage the model customization and deployment lifecycle platform from inception.

What we're looking for

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
• Experience utilizing model customization tools including LoRA, QLoRA, SFT, RL, DPO, and RAG.
• 7+ years of experience with LLM serving infrastructure such as vLLM or TRT-LLM.
• Deep understanding of model quantization and fine-tuning workflows.
• Demonstrated history of developing robust platform APIs.
• Strong collaborative skills and experience working in cross-functional teams.
• Experience with large-scale deployment of AI models (preferred).
• Familiarity with compliance and audit processes for AI models (preferred).