Senior C++ Software Engineer – AI Developer Tools

The NVIDIA PerfTech team is looking for an outstanding Senior C++ Software Engineer to build the next generation of AI-powered developer tools. You will apply deep expertise in modern C++, systems architecture, performance, and debugging to extend our developer-tools ecosystem into the emerging world of agentic software. In this role, you will help develop Genie, NVIDIA’s company-wide AI knowledge and developer-productivity service. You will build production-quality C++ components and integrations while contributing to agentic workflows and retrieval systems that help engineers find information, understand complex systems, and work more effectively.

What You’ll Be Doing:

• Architect and develop production-quality C++ components, APIs, and integrations for NVIDIA’s AI-powered developer-tools ecosystem.
• Build reliable, performance-sensitive systems connecting native C++ tools with Genie’s retrieval and agentic capabilities.
• Design maintainable interfaces between C++ applications and AI services exposed through Python, MCP, REST APIs, and structured tool calling.
• Contribute to agentic workflows, retrieval systems, ingestion pipelines, evaluation infrastructure, and enterprise integrations.
• Drive technical initiatives from early exploration through production deployment, working closely with multidisciplinary engineering teams.
• Mentor engineers and help establish best practices for production-quality AI-powered systems.

What We Need to See:

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
• 5+ years of professional experience developing complex production software in modern C++.
• Strong knowledge of software architecture, concurrency, debugging, performance optimization, and maintainable API design.
• Experience owning complex systems from design through implementation, deployment, and ongoing operation.
• Practical experience with AI-powered applications, agentic workflows, developer tools, retrieval systems, or related technologies.
• Ability to integrate native C++ applications with Python-based services and service APIs.
• Excellent communication skills and demonstrated ability to lead technical initiatives, clarify ambiguous requirements, and mentor engineers.

Ways to Stand Out From the Crowd:

• Experience building developer tools, profiling systems, debugging infrastructure, or performance-analysis platforms.
• Background with MCP, structured tool calling, agent orchestration, or retrieval-augmented generation.
• Experience designing secure, enterprise-scale retrieval or semantic-search systems.
• Familiarity with LLM evaluation, grounding, observability, and hallucination reduction.
• Knowledge of GPU architecture, graphics APIs, game engines, or application-performance optimization.

NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working with us. If you are creative and autonomous, with a genuine passion for technology, we want to hear from you!

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees and do not discriminate—including in our hiring and promotion practices—on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Originally posted on Himalayas