With the rapid acceleration of AI and the need to deliver trustworthy, high-performing models, Microsoft's Commercial Business & AI (CEAI) Data Science and Applied AI team is driving innovation at scale! Our mission is to advance AI capabilities through rigorous evaluations, fine-tuning, and large-scale experimentation to create intelligent, personalized experiences for customers worldwide. The CEAI Data Science and Applied AI team is seeking passionate AI practitioners and data scientists to join agile, cross-functional teams working on cutting-edge model evaluation frameworks, optimization pipelines, and experimentation platforms that power Microsoft's AI ecosystem.
We are looking for a Principal Data and Applied Scientist to join our team! As a member of the Commercial Business & AI (CEAI) Data Science and Applied AI organization at Microsoft, you will help us accelerate the company's own AI transformation. You will have the opportunity to partner directly with the engineering and product management groups responsible for managing the Dynamics 365 applications that power Microsoft's sales, marketing, and support platforms. You will apply advanced analytics, statistical modeling, machine learning and GenAI tools to uncover insights, drive action and deliver innovative solutions for complex business challenges.
This role offers the opportunity to:
Collaborate across a diverse team of data scientists, engineers, and product managers.
Deepen your experience in the evolving Artificial Intelligence (AI) and Machine Learning (ML) landscape.
Drive meaningful impact for thousands of Microsoft sales, marketing and support platform users.
Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
Partner with senior business, engineering, and product stakeholders to translate ambiguous questions about AI impact into well-scoped scientific problems with clear hypotheses, measurable objectives, and agreed definitions of success.
Own the scientific and statistical strategy for measuring the business impact of AI, including the causal and experimental frameworks (A/B testing, quasi-experimental designs, counterfactual and uplift methods) used to separate real impact from correlation.
Define and govern the metric framework that connects AI adoption and usage to downstream business outcomes such as productivity, revenue, retention, and cost, and set the standards for how those metrics are computed, validated, and interpreted across the organization.
Turn problem formulations into executable plans by selecting or creating the appropriate methods, algorithms, and tooling, and by delivering results that are statistically valid, reproducible, and defensible under executive scrutiny.
Write robust, reusable, and extensible code and analytical pipelines that make impact measurement repeatable at scale rather than a one-time analysis.
Develop ML and GenAI models using advanced statistical, machine learning, and LLM techniques, and quantify their incremental value to the business.
Lead the evaluation of GenAI solutions end to end, designing evaluation methodology, diagnosing quality and performance issues, identifying root causes, and recommending fine-tuning, reinforcement learning, or system-level fixes.
Communicate findings, tradeoffs, and levels of confidence to senior leadership in clear business language, and influence investment and prioritization decisions based on the evidence.
Raise the scientific bar across the broader team through design reviews, mentorship, and reusable measurement standards that other data scientists can build on.
Use AI-powered tools in your daily work to accelerate coding, analysis, experimentation, and reporting.
Qualifications
Required/Minimum Qualifications
Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 6+ years related experience (e.g., statistics, predictive analytics, research) OR Master's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 4+ years related experience (e.g., statistics, predictive analytics, research) OR Doctorate in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND 3+ years related experience (e.g., statistics, predictive analytics, research) OR equivalent experience.
Preferred Qualifications
Experience in Python, PySpark, and SQL and LLMs.
Experience with ML development platforms such as Azure Machine Learning, Azure AI Foundry + Azure OpenAI.
Experience in Spark and ability to write/maintain/understand declarative Spark code and to cleanly write and maintain SQL.
Experience with the operational aspects of Spark such as setting optimal cluster size, executor memory, number of executors etc. and experience in Azure Synapse/Databricks (or similar).
Experience in ML development platforms such as Azure Machine Learning, Azure AI Foundry + Azure OpenAI.
6+ year(s) experience creating publications (e.g., patents, peer-reviewed academic papers).
#CEAIjobs
Applied Sciences IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
