NVIDIA Logo

NVIDIA

Senior AI Infrastructure Engineer - DGX Cloud

Posted 2 Days Ago
Be an Early Applicant
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Design, deploy, operate, and scale large-scale AI training and inference infrastructure on cloud platforms. Build automation and internal tooling, analyze multi-GPU and distributed-system performance, manage capacity, monitor reliability, support production launches, improve service lifecycle practices, and participate in incident response and on-call operations.
The summary above was generated by AI

NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer  to join our DGX Cloud group. This engineering role will design, build and maintain large scale production systems with high efficiency and availability using the combination of software and systems engineering practices. This role demands knowledge across different systems, networking, coding, database, capacity management, continuous delivery and deployment and open source cloud enabling technologies like Kubernetes and OpenStack. AI Infrastructure Engineer at NVIDIA ensures that our internal and external facing GPU cloud services run maximum reliability and uptime and at the same time making changes to the existing system through careful preparation and planning while managing capacity and performance.

NVIDIA’s culture of diversity, intellectual curiosity, problem solving and openness is important to our success.
 

Our organization brings together people with a wide variety of backgrounds, experiences and perspectives. We encourage them to collaborate, think big and take risks in a blame-free environment. We promote self-direction to work on meaningful projects, while we also strive to build an environment that provides the support and mentorship needed to learn and grow.


What You’ll Be Doing:

  • Design, build, deploy, and run internal tooling for large scale AI training and Inferencing platform built on top of cloud infrastructure
  • Conduct in-depth performance characterization and analysis on large multi-GPU and multi-node clusters. 
  • Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement.
  • Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews.
  • Maintain services once they are live by measuring and monitoring availability, latency and overall system health.
  • Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity
  • Practice sustainable incident response and blameless postmortems
  • Be part of an on call rotation to support production systems

What We Need To See:

  • BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience.
  • 5+ years of experience.
  • A track record showing a good balance between initiating your own projects, convincing others to collaborate with you and collaborating well on projects initiated by others.
  • Experience with infrastructure automation and distributed systems design developing tools for running large scale private or public cloud systems in production.
  • Experience in one or more of the following: Python, Go, C/C++, Java
  • In depth knowledge in one or more of Linux, Networking, Storage, and Containers Technologies
  • Experience with Public Cloud and Infrastructure as a code (IAAC) and Terraform
  • Distributed system experience
     

Ways to stand out from the crowd:

  • Interest in crafting, analyzing and fixing large-scale distributed systems.
  • Systematic problem-solving approach, coupled with strong communication skills and a sense of ownership and drive.
  • Ability to debug and optimize code and automate routine tasks.
  • Experience in using or running large private and public cloud systems based on Kubernetes or Slurm.
     

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hard-working people in the world working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. If you're creative and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services

NVIDIA Bengaluru, Karnataka, IND Office

6, Chinappa Layout, Laxmi Sagar Layout, Mahadevapura, Bengaluru, Karnataka, India, 560048

Similar Jobs

An Hour Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Fintech • Financial Services
Leads software engineering initiatives focused on generative AI. Designs, codes, tests, debugs, documents, and deploys complex technology solutions while guiding less experienced engineers. Develops AI and machine learning applications, including RAG pipelines, model training, tuning, microservices, cloud infrastructure, integrations, CI/CD, observability, and DevOps practices. Collaborates with technical stakeholders, resolves complex issues, supports enterprise risk and compliance requirements, and evaluates emerging technologies through proofs of concept.
Top Skills: AjaxAngularAnsibleSparkAWSAzureDatadogDevOpsElk StackGoogle Cloud Platform (Gcp)GrafanaHadoopHarnessInfrastructure As CodeJavaScriptJenkinsJqueryLangchainLanggraphLarge Language Models (Llms)MicroservicesPrometheusPythonPyTorchReactRestRetrieval-Augmented Generation (Rag)ServicenowSoapTensorFlowTest-Driven DevelopmentVector Databases
An Hour Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Fintech • Financial Services
Supports institutional investment operations through trade processing, transaction reconciliation, inquiry research, exception resolution, documentation review, and operational issue management. Maintains risk, audit, compliance, and control requirements; recommends process improvements; participates in initiatives; and guides less experienced team members. Collaborates with internal and external stakeholders to deliver accurate, timely services. Requires at least two years of institutional investment operations experience and availability for a 5:30 PM to 2:30 AM shift.
An Hour Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Junior
Junior
Fintech • Financial Services
Develop, test, debug, document, upgrade, and deploy Java full-stack applications and microservices. Improve service quality and availability, evaluate technology solutions, resolve technical issues, and support security and compliance requirements. The role requires strong experience with Java, microservices architecture, APIs, cloud and distributed systems, Angular front-end development, testing frameworks, observability tools, and modern architectural patterns. Candidates may also lead a small technical team and contribute to Scrum-based development.
Top Skills: Ai ToolsAngularAngularjsApigeeAppdynamicsAWSBootstrapCucumberDistributed LoggingDistributed TracingDomain-Driven DesignElk StackFongoGitGradleJ2EeJavaJunitKafkaMicroservicesMockitoMongoDBPcfPrimengRdbmsService DiscoveryService MeshSplunkSpring Cloud GatewayTestng

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account