Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Principal Software Engineer

Home > Other programming jobs

Principal Software Engineer in USA

  • Microsoft
  • Full time
  • Email
  • Remote

Responsibilities

  • Define and drive the technical vision, architecture, and roadmap for Windows ML compiler stack components.
  • Lead cross-team initiatives to improve AI workload performance, scalability, and efficiency across CPU, GPU, and NPU hardware.
  • Drive NPU enablement strategy and advanced optimization techniques for next-generation AI processors.
  • Partner with hardware vendors and internal platform teams to influence future AI hardware and software capabilities.
  • Design and develop high-performance compiler infrastructure, execution engines, and developer tooling.
  • Solve systems challenges involving scheduling, memory management, code generation, graph optimization, and hardware abstraction.
  • Mentor engineers and provide technical leadership across multiple projects and organizations.
  • Shape Microsoft’s long-term strategy for on-device AI and generative AI execution on Windows.

Requirements

  • Bachelor’s degree in computer science or a related technical field and 6+ years of technical engineering experience with production-quality systems software, AI/ML platforms, or related technologies, or equivalent experience.
  • Experience designing and delivering production-quality systems software, AI/ML platforms, or related technologies.
  • Hands-on experience with ML compilers, runtimes, frameworks, tools, and platform technologies.
  • Operating system development experience, including user-mode and/or kernel-mode driver development.
  • Experience designing ML accelerators or hardware microarchitecture and connecting hardware with compilers, runtimes, drivers, and frameworks.
  • Knowledge of computer architecture, heterogeneous computing, memory systems, parallel processing, and hardware/software co-design.
  • Experience optimizing ML workloads across the full software and hardware stack, including GPU optimization.
  • Technical leadership experience defining architecture and taking AI platforms or accelerators from early design and prototypes through production.

Benefits

  • The typical U.S. base pay range is USD $142,800–$274,800 per year; a separate range applies to specified San Francisco Bay Area and New York City metropolitan area locations.
  • Certain roles may be eligible for benefits and other compensation.
  • The position will remain open for a minimum of 5 days and accept applications on an ongoing basis until filled.

Salary: $143k - $304k/yr

Microsoft

Every company has a mission. What's ours? To empower every person and every organization to achieve more. We believe technology can and should be a force for good and that meaningful innovation contributes to a brighter world in the future and today. Our culture doesn’t just encourage curiosity; ...

Similar positions

Middle QA Engineer II

  • Snoonu
  • Full time
  • USA
  • 11/18/2026
  • Remote

Software Engineer II (DevX team)

  • OpenGov
  • Full time
  • Others
  • 11/18/2026
  • Pune, India

Staff Engineer

  • Nagarro
  • Full time
  • Remote
  • 11/18/2026
  • India

Software Testing Intern

  • Razer Inc.
  • Full time
  • Others
  • 11/18/2026
  • Shenzhen, China

Engineering Manager - Grafana Productivity

  • Grafana Labs
  • Full time
  • Remote
  • 11/18/2026
  • Salary: $135k-$162k
  • Canada