Principal AI Optimization Software Engineering Manager
Microsoft · microsoft.com
HerzliyaLead / Manager
Subscribers got this job on 20 October 2026.
New jobs reach them at 8 am and 6 pm, 5 days before they open here. Get the next one first
The job in short
AI optimization engineering management.
Details
- Found
- 5 d ago · posted 2026-10-20
- Location as listed
- Herzliya, Tel Aviv District,IL, IL
- Role
- Engineering Manager
- Source
- The company’s own careers site
Full description
People Management Managers deliver success through empowerment and accountability by modeling, coaching, and caring. Model: Live our culture. Embody our values. Practice our leadership principles. Coach: Define team objectives and outcomes. Enable success across boundaries. Help the team adapt and learn. Care: Attract and retain great people. Know each individual's capabilities and aspirations. Invest in the growth of others. Provides technical leadership during code reviews for a solution/product area to assure it meets team standards, contains the correct test coverage, and is appropriate for the product or solution area. Ensures coding standards are followed. Establishes best practices and mentors others to create a clear test strategy that ensures solution quality, prevents regression from being introduced into existing code. Establishes best practices and mentors others on ensuring test plans incorporate security testing to validate security invariants (including negative cases). Provides technical leadership on adding new tests to cover gaps, deleting or fixing broken tests, and improving the speed, reliability, and defect localization of the overall test suite across a solution or product. Designs and executes plans for redesigning or rearchitecting difficult or untestable sections of code across solutions and/or products. Provides technical leadership to ensure system architecture and individual designs meet performance, scalability, resiliency, disaster recovery, cost of goods sold (COGS), and other requirements and expectations. Provides technical leadership for the identification of dependencies and incorporating them into the development of design documents for a product, application, service, or platform. Enables and fosters communications and proactively negotiates across teams to resolve conflicts around dependency ownership and required work. Develops substantial skills in tools inside and outside current areas of expertise. Collaborates with partner teams to ensure a set of products work well with the components of the partner team, ensuring proper end-to-end testing, live-site coverage, scalability, performance, and DRI escalation pathways are established before going live. Guides other members for project estimation and escalates only the most critical issues. Ensures solutions are scalable, financially responsible, and meet capture/storage guidelines. Provides technical leadership in efforts to classify, and analyze complex data and analyses on a range of metrics (e.g., health of the system, where bugs might be occurring), and sets expectations for outputs (e.g., notifications, dashboards) that improve monitoring and investigating security-related concerns and scenarios, system monitoring and/or issue identification and mitigation. Develops a playbook for the team to resolve issues. Coordinates people and resources to ensure DRI responsibilities are covered across teams. Implements and helps others implement solutions and mitigations to complex issues impacting the performance or functionality of live site services. Ensures playbooks are logical and understandable. Partners with and guides appropriate internal (e.g., product manager, privacy/security subject matter expert, technical lead) and external (e.g. customer escalation team, public forums) stakeholders and leverages expertise to anticipate, determine, and confirm customer/user requirements and their feasibility for one or more complex scenarios. Proactively seeks and leverages a variety of feedback channels to incorporate customer insights into future designs or solution fixes. Leads incorporation of unwritten requirements, such as appropriate continuous feedback loops that measure actionable, quantitative (e.g., customer value, usage patterns, solution performance) and qualitative (e.g., accessibility, globalization) indicators of value. Determines additional critical metrics. Understands and leads providing feedback on, and advocating for the security and privacy needs of the customer who will be using the complex set of solutions. Bachelor's degree in Computer Science or a related technical field. 10+ years of technical engineering experience, including 2+ years designing and implementing AI kernels, AI optimization algorithms, or AI compilation techniques (or closely related performance and systems optimization work). Proficiency in C++ and Python. 3+ years of people management experience. Proven ability to recruit and build a team, and to create energy and momentum. Master's Degree or PhD in Computer Science or related technical field Deep expertise in one or more areas such as quantization, sparsity, speculative decoding, graph optimization, operator fusion, code generation, inference serving, batching and scheduling, caching.
Engineering Manager jobs in the United States · All Microsoft jobs