Work in Washington Veterans Jobs

Job Information

Microsoft Corporation Principal Technical Program Manager, Cloud AI Acceleration in Redmond, Washington

The Cloud Accelerated Systems and Technologies team is building the next generation AI hardware and systems for large scale datacenter deployments. Our team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. We are a cross-discipline team of highly capable and motivated people with a collaborative and inclusive culture.

We are seeking a Principal Technical Program Manager to help shape and execute the next generation of AI hardware innovations that will power Azure Deep Learning services. We are looking for someone who is motivated and able to motivate others, proactive with a demonstrated history of problem solving and persistent in the face of challenges. An entrepreneurial approach and ability to take initiative and operate autonomously are essential.

In this role you will be driving end-to-end integration of advanced hardware infrastructure systems into the Azure cloud. You will work closely with customers, and hardware/software engineers to plan, scope, and drive product integration strategy and execution for cutting-edge large-scale systems - ensuring successful delivery of these systems into the broader Azure infrastructure and product portfolio.



  • Own end-to-end integration of advanced AI hardware infrastructure systems into Azure.

  • Work with multiple internal AI customers to understand the user personas, major use cases, and pain points.

  • Develop and manage overall requirements, scope, schedules, and deliverables with engineering teams, partners, and stakeholders.

  • Partner closely with engineering teams as a customers’ advocate to define, prioritize, and implement features.

  • Stakeholder management - highlighting risks across functional teams and providing recommendations to support product level decisions.



  • B.S. or higher preferably in computer engineering, computer science, or related fields OR equivalent work experience in lieu of education.

  • 7+ years of software development or technical product/program management experience with a proven track record of delivering large, complex, cross-team technical projects.

  • Familiarity with computing and software frameworks/tools and software development life cycles for data center solutions.

  • Working experience with deep learning frameworks (like PyTorch, TensorFlow or MXNet) and SDKs/APIs (like CUDA or ROCm).

  • Experience with program management across complex systems with teams driving silicon, HW systems & SW ecosystem setup.


  • Self-starter with customer centric mindset.

  • Exceptional communication and interpersonal skills, including relationship building and collaboration within a diverse, cross-functional organization.

  • Ability to handle high ambiguity, drive clarity, and identify/prioritize issues and opportunities.

  • Experience with distributed training (Data and Model Parallelism).

  • Hands-on experience with ML Kernel authoring.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form ( .

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.