AI Infrastructure System Engineer Bangalore

Home > Python programming jobs

AI Infrastructure System Engineer Bangalore in Others

Together AI
Full time
Email

Others
10/09/2026
Report

Bengaluru, India

Responsibilities

Design and build fleet automation systems for provisioning, validation, deployment, upgrades, repairs, and retirement of GPU clusters.
Build AI infrastructure agents that automate deployment, root-cause analysis, incident triage, and remediation.
Develop fleet intelligence platforms to monitor hardware, firmware, networking, storage, thermals, and workload performance and predict failures.
Build software that improves GPU availability, utilization, performance, and reliability across thousands of accelerators.
Create automated validation systems for GPUs, networking fabrics, NVLink/NVSwitch, storage, and distributed AI workloads.
Build internal infrastructure platforms and developer tools that enable software-managed operations.
Improve deployment velocity, reliability, and operational efficiency through automation.
Partner with hardware, networking, platform, and AI teams on large-scale AI infrastructure.

Requirements

3+ years of experience building distributed systems, infrastructure platforms, or large-scale backend software.
Strong software engineering skills in Python, Go, or Rust.
Experience building platforms, automation systems, or developer infrastructure.
Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies.
Strong systems thinking across hardware and software.
Passion for solving complex infrastructure challenges through software and an automation-first mindset.
Bonus experience with GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch, InfiniBand, RoCE, bare-metal provisioning, AI training or inference clusters, hardware health monitoring, predictive failure detection, distributed storage, or AI agents.

Together AI

Together AI is the AI Native Cloud, purpose-built for AI engineers and researchers with a full suite of tooling across inference, model shaping, and pre-training. AI natives can use Together AI as a full-stack AI platform — from a high- performance inference engine built for reliable and fast sca...

Similar positions

Security Platform Automation Engineer

Apple
Full time

USA
10/15/2026

Seattle, WA

Analytics Engineer

Reddit
Full time

USA
10/15/2026
Salary: $164k-$230k

Remote

Senior AI Engineer

Infiterra S.A
Full time

Remote
10/15/2026

Greece, UK

Security Operations Engineer (SecOps)

Collibra
Full time

USA
10/15/2026
Salary: $116k - $145k/yr

Remote

Accounting Automation Engineer

Ruby Labs
Full time

Remote
10/15/2026

EMEA