Principal Software Engineering Manager – CoreAI

jobs-near-me.org

<div class="isg-job-description“>OverviewCoreAI is at the heart of Microsoft’s mission to revolutionize how software is built and experienced. We build the foundational platforms, services, and developer experiences that power the next generation of applications using Generative AI. Our work enables developers and enterprises to harness the full potential of AI to create intelligent, adaptive, and transformative software. The Inferencing Control Plane team is responsible for building the distributed systems and orchestration frameworks that manage the lifecycle, routing, and execution of AI workloads at scale. We provide the critical infrastructure that ensures reliable, performant, and secure inferencing across heterogeneous environments and models. This Principal Software Engineering Manager – CoreAI role is a unique opportunity to lead a team building the backbone of generative AI infrastructure at Microsoft!
ResponsibilitiesLead and grow a team of software engineers focused on building scalable, cloud-native inferencing services and orchestration layers.Partner with product, research, and platform teams to define requirements and deliver robust, extensible infrastructure platforms and product APIs.Drive architectural decisions and technical strategy for inferencing control systems, ensuring high availability, performance, and cost efficiency.Guide the team in designing and implementing distributed systems that support dynamic routing, load balancing, and execution of AI workloads.Ensure engineering excellence through code reviews, design reviews, and mentoring, fostering a culture of innovation and inclusion.Own the operational health of services, including on-call rotations, incident response, and continuous improvement of reliability metrics.Collaborate across CoreAI and Microsoft to align on platform integration, security, and compliance requirements.Champion developer experience and usability in SDKs and tooling, enabling seamless integration with agentic and generative AI platforms.

To help us track our recruitment effort, please indicate in your cover/motivation letter where (usajobvacancies.com) you saw this job posting.