Goldman Sachs Logo

Goldman Sachs

The Core Engineering, New York, Vice President, AI/ML Engineer

Reposted 17 Days Ago
In-Office
New York, NY, USA
130K-250K Annually
Senior level
In-Office
New York, NY, USA
130K-250K Annually
Senior level
Design, build, and deploy scalable GenAI/LLM-driven compliance solutions (RAG, embeddings, agentic frameworks). Lead projects, produce production-ready code, mentor engineers, collaborate with compliance and legal stakeholders, and ensure regulatory-aligned, monitored ML systems.
The summary above was generated by AI

The Core Engineering 

The Core Engineering builds and operates the platforms, applications, data solutions, models, and analytics that power critical processes for The Core divisions of the firm (e.g., Risk, responsible for the risk profile of firm activities; Controllers, responsible for the financial control and reporting obligations; Compliance, responsible for the firm’s compliance, regulatory, and reputational risks; Corporate Treasury, responsible for the firm’s liquidity, funding, balance sheet, etc.; and Human Capital Management, responsible for attracting, developing, and managing a global workforce). A centralized engineering structure in support of The Core enables a common platform model and operating framework that promotes consistent governance and scalable solutions, leveraging cloud, AI, and machine learning for innovation and efficiency. The Core Engineering’s 2,000+ engineers and strats deliver engineering, data, analytics, and quantitative capabilities within six business units: 

  • Metrics & Analytics Platforms: responsible for the measurement and management of the firm’s risk, capital, and liquidity for The Core functions

  • The Core Strats: responsible for the development and implementation of models and other quantitative methodologies, including the accuracy and attribution of modeled metrics

  • Financials & Reporting: responsible for facilitating the production of the firm’s financials and a wide range of reporting functions

  • Non-Financial Risk & Controls: responsible for non-financial risk and control processes

  • Enterprise Platforms: responsible for platforms and applications that support critical operational processes across The Core such as payments, people processes, and procurement

  • Shared Services: responsible for driving the adoption of consistent engineering strategy, including data platforms, cloud, and AI enablement, as well as the management of technology risk 


YOUR IMPACT

Are you passionate about leveraging cutting-edge AI/ML techniques, including Large Language Models, to solve complex, mission-critical problems in a dynamic environment? Do you want to contribute to safeguarding a leading global financial institution?

OUR IMPACT

We are The Core Engineering, a global team of engineers and scientists dedicated to preventing, detecting, and mitigating regulatory and reputational risks across Goldman Sachs. We build and operate a suite of platforms and applications that protect the firm and its clients.

We offer:

  • Access to petabyte scale of structured and unstructured data to fuel your AI/ML models, including textual data suitable for LLM applications.
  • The opportunity to work with state-of-the-art LLM models and agentic framework.
  • A collaborative environment where you can learn from and contribute to a team of experienced engineers and scientists.
  • The chance to make a tangible impact on the firm's ability to manage risk and maintain its reputation.

Within The Core Engineering, we are seeking an experienced AI/ML Engineer to join our Engineering team. This role will focus on solving highly complex business problems using AI/ML techniques, incorporating latest emerging trends om building out vertical AI agents to run on data at massive scale.  

HOW YOU WILL FULFILL YOUR POTENTIAL

As a member of our team, you will:

  • Design and architect scalable and reliable end-to-end AI/ML solutions specifically tailored for compliance applications, ensuring adherence to relevant regulatory requirements. This encompasses the development and implementation of GenAI-driven solutions, including agentic frameworks for automating compliance processes, RAG pipelines, and the creation and utilization of embeddings for compliance knowledge bases.
  • Explore diverse AI/ML problems, such as model fine-tuning, prompt engineering, and experimentation with different algorithmic approaches to address novel business challenges.
  • Develop, test, and maintain high-quality, production-ready code.
  • Lead technical projects from inception to completion, providing guidance and mentorship to junior engineers.
  •  Collaborate effectively with compliance officers, legal counsel, and other stakeholders to understand business requirements and translate them into technical solutions. 
  • Participate in code reviews to ensure code quality, maintainability, and adherence to coding standards. Promote best practices for AI/ML development, including version control, testing, and documentation.
  • Stay current with the latest advancements in AI/ML platforms, tools, and techniques to solve business problems. 

QUALIFICATIONS

A successful candidate will possess the following attributes:[MR4] 

  • A Bachelor's, Master's or PhD degree in Computer Science, Machine Learning, Mathematics, or a similar field of study.
  • Preferably 7+ years AI/ML industry experience for Bachelor’s/Masters, 4+ years for PhD with a focus on Language Models.
  • Strong foundation in machine learning algorithms, including deep learning architectures (e.g., transformers, RNNs, CNNs)
  • Proficiency in Python and relevant libraries/frameworks such as TensorFlow, PyTorch, Hugging Face Transformers, scikit-learn.
  • Demonstrated expertise in GenAI techniques, including but not limited to Retrieval-Augmented Generation (RAG), model fine-tuning, prompt engineering, AI agents, and evaluation techniques.
  • Experience working with embedding models and vector databases.
  • Experience with MLOps practices, including model deployment, containerization (Docker, kubernetes), CI/CD, and model monitoring.
  • Strong verbal and written communication skills.
  • Curiosity, ownership and willingness to work in a collaborative environment.
  • Proven ability to mentor and guide junior engineers.

Experience in some of the following is desired and can set you apart from other candidates:

  • Experience with Agentic Frameworks (e.g., Langchain, AutoGen) and their application to real-world problems.
  • Understanding of scalability and performance optimization techniques for real-time inference such as quantization, pruning, and knowledge distillation.
  • Experience with model interpretability techniques.
  • Prior experience in code reviews/ architecture design for distributed systems.
  • Experience with data governance and data quality principles.
  • Familiarity with financial regulations and compliance requirements.

ABOUT GOLDMAN SACHS

At Goldman Sachs, we commit our people, capital and ideas to help our clients, shareholders and the communities we serve to grow. Founded in 1869, we are a leading global investment banking, securities and investment management firm. Headquartered in New York, we maintain offices around the world. 

We believe who you are makes you better at what you do. We're committed to fostering and advancing diversity and inclusion in our own workplace and beyond by ensuring every individual within our firm has a number of opportunities to grow professionally and personally, from our training and development opportunities and firmwide networks to benefits, wellness and personal finance offerings and mindfulness programs. Learn more about our culture, benefits, and people at GS.com/careers. 

We’re committed to finding reasonable accommodations for candidates with special needs or disabilities during our recruiting process. Learn more: https://www.goldmansachs.com/careers/footer/disability-statement.html

© The Goldman Sachs Group, Inc., 2021. All rights reserved.

Goldman Sachs is an equal employment/affirmative action employer Female/Minority/Disability/Veteran/Sexual Orientation/Gender Identity

Salary Range
The expected base salary for this New York, NY, United States-based position is $130000-$250000. In addition, you may be eligible for a discretionary bonus if you are an active employee as of fiscal year-end.

Benefits
Goldman Sachs is committed to providing our people with valuable and competitive benefits and wellness offerings, as it is a core part of providing a strong overall employee experience. A summary of these offerings, which are generally available to active, non-temporary, full-time and part-time US employees who work at least 20 hours per week, can be found here.

HQ

Goldman Sachs New York, New York, USA Office

200 West Street, New York, NY, United States, 10282

Goldman Sachs Edison, New Jersey, USA Office

Edison, United States

Goldman Sachs Jersey City, New Jersey, USA Office

Jersey City, United States

Goldman Sachs New York, New York, USA Office

New York, United States

Goldman Sachs Newark, New Jersey, USA Office

Newark, United States

Similar Jobs

16 Minutes Ago
Remote or Hybrid
USA
41K-83K Annually
Mid level
41K-83K Annually
Mid level
Machine Learning • Payments • Security • Software • Financial Services
Provides enterprise technology support through phone, ticketing, and potentially chat channels. Troubleshoots hardware, software, network, access, and application issues; manages incidents and escalations; documents resolutions in ServiceNow or similar ITSM tools; analyzes trends and operations data; supports knowledge management, training, process improvement, and automation; and coaches junior analysts while maintaining customer service, security, and confidentiality standards.
Top Skills: Call Center TechnologiesHardware InfrastructureItsmNetworkingServicenow
16 Minutes Ago
Remote or Hybrid
USA
86K-173K Annually
Senior level
86K-173K Annually
Senior level
Machine Learning • Payments • Security • Software • Financial Services
Leads the design, automation, deployment, monitoring, and security of Azure cloud infrastructure. Builds Infrastructure as Code with Terraform, Bicep, or ARM templates; manages CI/CD pipelines through Azure DevOps and GitHub; and implements monitoring, logging, alerting, incident response, patching, and vulnerability management. Collaborates with engineering, development, architecture, security, and incident management teams to improve system reliability, scalability, performance, and cost efficiency.
Top Skills: Arm TemplatesAzureAzure DevopsAzure MonitorBashBicepCi/CdElastic StackElk StackGithub ActionsGithub EnterpriseInfrastructure As CodeKubernetesPowershellTerraform
16 Minutes Ago
Remote or Hybrid
USA
38K-75K Annually
Mid level
38K-75K Annually
Mid level
Machine Learning • Payments • Security • Software • Financial Services
Provide high-volume, phone-based technical support and first-line resolution for hardware, software, networking and access issues. Log and track incidents in ServiceNow/ITSM, escalate complex problems, suggest process improvements, and maintain security and confidentiality while working from an approved remote workspace on a set evening/weekend schedule.
Top Skills: Call Center TechnologiesItsmPhone SystemsServicenowTicketing Systems

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account