Senior Software Engineer, Cosmos Infrastructure and End to End Performance

What you'll do

• Build state-of-the-art world foundation models like Cosmos3.
• Conduct end-to-end performance analysis and drive HW-SW codesign for data center and edge deployments.
• Develop infrastructure to automate data ingestion, curation, pre-training, and post-training processes.
• Optimize model export, quantization, and deployment for edge environments.
• Design systems for high robustness and fault tolerance.
• Engage with customers to ensure model usability and ecosystem enablement.

What we're looking for

• A Master's in Computer Engineering, Computer Science, Electrical Engineering or related STEM degree or equivalent experience.
• 5 years of relevant work experience.
• Expertise in large scale parallel and distributed accelerator-based systems.
• Expertise optimizing performance and AI workloads on large scale systems, including performance modeling and benchmarking.
• Proficiency in Distributed PyTorch, Python, and C/C++.
• Strong background in Computer Architecture, Networking, Storage systems, and Accelerators.
• Understanding of DNNs and their use in emerging AI/ML applications and services.
• Expertise with at least one public CSP infrastructure (GCP, AWS, Azure, OCI, etc.).
• Deep understanding of World Foundation Models and their application to Physical AI.
• Experience developing infrastructure to automate multimodal data ingestion and curation.
• Experience driving tokenization and data set preparation (preferred).
• Prior experience building transformer models or driving Post training, fine-tuning, and RL algorithms.
• Understanding of how to optimize for inference, export, quantization, and containerization.
• Familiarity with popular AI frameworks such as TensorFlow, JAX, Cosmos, Megatron-LM, Tensort-LLM, or VLLM (preferred).
• Proficiency in CUDA (preferred).