Senior Software Engineer, NeMo Core Platform
Free to start · No card · 5 credits the moment you sign up
Job description
We are looking for a Senior Software Engineer to help build NeMo Helix, NVIDIA’s product for developing, evaluating, deploying, and operating AI systems at scale. This role is for a senior engineer/architect for our Core team which owns and ships an open source plugin-based AI platform for running and optimizing Agents targeting multiple compute backends (local/docker, Kubernetes, Slurm, etc.).
As AI systems become more autonomous and more deeply integrated into real workflows, teams need robust APIs and orchestration systems for running, monitoring, and optimizing Agents at scale. Increasingly, the users of these systems are themselves autonomous or semi-autonomous Agents. The NeMo Helix group is building a sophisticated agent execution framework to enable agents to automatically run hundreds of experiments in parallel to find the most efficient agent architectures for our customers. This is important product engineering research for making agents more sustainable. AI systems are not yet nearly as efficient as they can be, and systems like NeMo Helix will allow large scale AI consumers to automatically tune their agents to use fewer tokens and rely on more efficient models with better throughput.
What you'll be doing:
- Working in a product research environment where we place big bets on where the future is heading, adapting in real time as we build alongside an industry that is constantly evolving with us. This means fast iteration, high ownership, pragmatic decisions, and performance-minded implementation under production constraints
- Designing an Agentic Execution system that are flexible enough to work in many environments (local, k8s, Slurm, on prem / air-gapped)
- Provide senior technical leadership through design reviews, code reviews, mentoring, and ownership of ambiguous cross-component problems
- Building and maintain our Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC and Auth
- Extending our flexible Plugin Architecture that makes it easy for many teams and external customers to install new capabilities into our system
- Building in the open in our OSS repo, keeping up the high standards that the open source community demands
- Shipping code at the speed of light with an unlimited token budget using best in class agentic coding tools
- Improving reliability, observability, debuggability, and performance across NeMo Helix, SDKs, plugins, jobs, and developer workflows
- Building strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows
What we need to see:
- BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related technical field
- 10+ years of professional software engineering experience building production systems
- Comfort working in a very fast and ambiguous environment
- Exceptional communication, both verbal and written. This includes the ability to produce and review high quality architectural RFCs, and to discuss them clearly with the right level of technical detail for the right people (Engineer, Product, Marketing, etc.)
- Strong system design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating. Strong understanding of reliability, scalability, security, and performance tradeoffs in production infrastructure
- Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration
- Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis, and maintainable software design
- Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
- Ability to work independently, define technical scope, break down ambiguous problems, and drive work across team boundaries
Ways to stand out from the crowd:
- Experience building, deploying, and iterating on production agentic AI systems at scale in Kubernetes
- Experience with sophisticated plugin architectures
- Strong ability to connect technical evaluation work to business outcomes, product quality, user experience, reliability, or operational efficiency
- Experience with enterprise AI systems where measurement, regression testing, observability, governance, and continuous improvement are required for production deployment
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
Originally posted on Himalayas
Prepare your application
Use the description above to assess your fit for NVIDIA. This checklist is guidance from Resumize, rather than additional requirements from the employer. Imported listings can be shortened or change after collection, so confirm the complete description and current availability before sending an application.
Match requirements to evidence
Identify the responsibilities and skills the employer explicitly names. For each important requirement, choose one example from your work, education, training, or projects. Explain what you did, how you did it, and what changed as a result. Include a measurable outcome when you can support it. If you lack a requirement, describe related experience accurately instead of adding an unfamiliar skill to your resume.
Put the most relevant examples near the top of your resume. Keep job titles, dates, qualifications, and contact details consistent across your application materials. Use the employer’s terminology when it describes your experience accurately; a copied list of keywords does not explain your contribution. A short, specific bullet is easier to review than a paragraph that mixes several unrelated duties.
Check the working arrangement
Confirm the location, schedule, employment type, and any eligibility requirements on the employer’s site. A remote label does not establish worldwide eligibility or flexible hours. If compensation, benefits, equipment, travel, or contract duration are missing from this listing, write down your questions for the recruiter. Do not assume details from another opening at the same company apply to this role.
Review before submitting
Follow the employer’s requested file format and application instructions. Open your exported resume and check that its text is selectable, its sections read in order, and its links work. Proofread names, dates, and contact information. Share confidential work samples only when you have permission, and use an anonymized example when necessary.
Submit through a trusted employer or recruiting destination. If the original listing has disappeared, search the employer’s careers page for the title rather than assuming the vacancy remains open. Save the application date, job reference, and the version of your resume you sent. Those details help you prepare for a later conversation and avoid submitting conflicting information through several job boards.
Review your resume for writing and readability feedback, or browse other openings if this opportunity is unavailable.