Microsoft Foundry is building the foundational platforms that power the next generation of intelligent agents and generative AI systems. Within CoreAI, the Foundry Agents organization is responsible for key ownership areas across the end‑to‑end agent lifecycle: (a) Foundry Agents platform to deploy and run agents securely at enterprise scale with seamless integration with governed tools, (b) model fine‑tuning to train and improve agentic performance, and (c) Foundry observability to generate insights from agentic traces and continuously evaluate and optimize agents.
As a Software Engineer II within Foundry Agents, you will contribute to building large‑scale, cloud‑native systems that support the full lifecycle of advanced agentic applications — from secure enterprise deployment and tool integration, to fine‑tuning workflows, to observability and evaluation in production. Your work will help enable developers and enterprises to build reliable and effective AI-powered agents.
You will work as part of a team at the intersection of distributed systems, AI infrastructure, and developer platforms, implementing components that meet high standards for performance, reliability, security, and compliance. This role is ideal for engineers who are strong coders, eager to learn, and excited to grow their expertise in large-scale systems and AI platforms.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. We bring that mission to life through a culture that values growth mindset, diverse perspectives, and continuous learning. Join us and help build the platforms that will power the next generation of AI-driven applications.
Responsibilities
Across the organization, you will:
- Implement and maintain services that support agent deployment, execution, and observability
- Contribute to building distributed systems and cloud services for running agents at scale
- Improve tooling and workflows for engineering and research through incremental enhancements
- Debug issues across services, models, and infrastructure with support from senior team members
- Participate in design discussions and contribute to team-level technical decisions
- Write high-quality, maintainable code with strong testing and reliability practices
- Collaborate with teammates and partner teams across CoreAI and Azure to deliver production-ready features
You will contribute to a collaborative engineering culture by participating in code reviews, learning from peers, and continuously improving your technical skills. This role provides an opportunity to grow into more complex system design and ownership over time while working on cutting-edge AI infrastructure.
Qualifications
Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Demonstrated expertise in solving complex technical challenges in one or more domains such as distributed systems, AI/ML infrastructure, developer platforms, or cloud services.
1+ years of experience in backend service development (APIs, microservices, or distributed systems)
Demonstrated proficiency with AI-assisted software development tools and workflows (e.g. AI coding agents, LLM-powered development environments)
Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
