Microsoft Logo

Microsoft

Software Engineering II - AI Compiler Engineer

Posted 4 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
102K-219K Annually
Junior
Remote
Hiring Remotely in United States
102K-219K Annually
Junior
Designs and implements compiler, runtime, and system software for Microsoft AI accelerator devices. Responsibilities include transforming code through LLVM IR, developing JIT compilation and dynamic code-generation features, deploying application code, and collaborating with hardware architects and ML developers. The role requires hands-on C/C++ and Python development, optimized systems-level programming, Unix-like platforms, and compiler framework experience.
The summary above was generated by AI
Overview

The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build software for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator, working closely with hardware architects, platform engineers, researchers, and ML developers. Our interdisciplinary team operates at the intersection of AI, compiler engineering, systems software, and high-performance computing. We have a collaborative and inclusive culture and participate in the open-source community.

We are seeking a Software Engineer II - AI Compiler Engineer to join the Maia Code-gen team. You will work on the fundamental mechanisms for building and deploying application code to Microsoft AI accelerator devices. This includes analyzing and modifying code through the LLVM IR API, implementing dynamic code-generation and JIT-compilation features, and developing system and runtime components for dynamic-code deployment. This is a hands-on technical role for someone who enjoys solving difficult engineering problems, takes initiative, and wants to help build an end-to-end AI software stack.


At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth mindset culture, we innovate responsibly and measure success by shared progress people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone. 


Responsibilities
  • Design and implement robust, maintainable software architectures and components for dynamic code generation and deployment.
  • Analyze and transform code using LLVM IR and develop advanced JIT-compilation features.
  • Build system and runtime components that support deploying application code to AI accelerator devices.
  • Develop software in C/C++, Python, and other languages as appropriate.
  • Collaborate across disciplines, from hardware architects to ML developers.
  • Identify requirements, scope solutions, estimate work, and plan deliverables.
  • Contribute to sound engineering practices and an inclusive, collaborative team culture.

Qualifications
Required/minimum qualifications
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, or Python OR equivalent experience. 

Other Requirements:

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred qualifications

  • Bachelor’s degree in computer engineering, computer science, or a related technical field, or equivalent experience.
  • 2+ years of software development experience.
  • 1+ years of experience with C/C++
  • 1+ years of experience developing software for GNU/Linux or another Unix-like platform.
  • 1+ years of experience with optimized systems‑level programming.
  • Experience building compilers or other tooling using compiler frameworks like LLVM.

#AIInfra


Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $102,100 - $202,200 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $133,800 - $219,200 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Similar Jobs

An Hour Ago
Remote or Hybrid
United States
Senior level
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Manage government accounts across Texas, Oklahoma, Louisiana, and Mississippi; develop sales strategies, build agency relationships, influence procurement specifications, manage pipelines, forecast revenue, and drive customer adoption and account expansion. The field-based role requires frequent travel of up to 75%, residence or relocation to Dallas or Houston, a valid ability to operate a motor vehicle, and government B2G/B2B sales experience.
Top Skills: Crm ApplicationsExcelMicrosoft PowerpointMicrosoft Word
An Hour Ago
Remote or Hybrid
160K-291K Annually
Senior level
160K-291K Annually
Senior level
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Build and own physics-grade robotics simulation infrastructure for manipulation, perception, SLAM, and navigation validation. Model robot dynamics, kinematics, actuation, and sensors; develop scene-authoring and CAD import tools; integrate simulation into CI; support AI data generation; and lead virtual commissioning and digital twin capabilities. The role also evaluates simulation-to-hardware divergence, supports infrastructure users, and balances simulation fidelity with performance.
Top Skills: C++CadCiDigital TwinsGazeboGpu-Accelerated SimulationIsaac SimLidarProcess SimulatePythonRgb-D CamerasRosSdfUrdfUsdVirtual CommissioningVisual Components
An Hour Ago
Remote or Hybrid
Massachusetts, USA
98K-134K Annually
Mid level
98K-134K Annually
Mid level
Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Develop and test digital signal processing algorithms for audio, speech, voice pickup, noise reduction, spatial audio, and microphone arrays. Integrate and validate algorithms on embedded real-time systems, optimize performance across hardware and software platforms, investigate issues using acoustic measurements and lab equipment, and collaborate with engineering, software, systems, product, and external partners.
Top Skills: Acoustic Measurement EquipmentBluetooth AudioCDigital Signal ProcessingEmbedded SystemsMatlabMicrophone ArraysPythonReal-Time Systems

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account