MeridianLink Logo

MeridianLink

Staff Software Engineer - AI Platform

Posted 13 Days Ago
Remote
Hiring Remotely in US
126K-215K Annually
Senior level
Remote
Hiring Remotely in US
126K-215K Annually
Senior level
Lead a cross-functional engineering team with hands-on architecture and coding. Mentor engineers, drive technical execution, improve delivery practices, and collaborate with Product and QA to deliver reliable, modern cloud-based AI platform solutions.
The summary above was generated by AI

Job Summary

This role is responsible for defining and building the shared AI platform that MeridianLink’s product and engineering teams use to deliver AI-powered features consistently and at scale. You will work across product domains to identify common requirements, design platform services that abstract the hard parts of AI integration, and establish the patterns and standards teams follow when building on top of AI. The right person for this role thinks in platforms, not features, and has strong opinions about what it means to make AI capabilities reliable, observable, and safe in a regulated industry.

About the Opportunity

Staff engineers at MeridianLink operate across multiple teams or an entire product line. They set technical direction, make architecture and technology decisions that others build against, and raise the engineering floor across the teams they touch. Staff engineers are active, daily users of AI-assisted development tools — and go further by building the workflows, tooling, and patterns that make those tools more effective for the teams around them.

Technical Leadership & Architecture

  • Makes critical architecture and design decisions that span multiple teams or an entire product area

  • Evaluates technology choices with a clear view of trade-offs at scale, not just for the immediate problem

  • Drives technical standards and patterns that other engineers can follow without being supervised

  • Identifies systemic problems before they become incidents

Cross-Team Execution

  • Provides day-to-day technical direction for one or more scrum teams without holding a management title

  • Steps into ambiguous, high-stakes technical problems across teams and drives them to resolution — without being asked

  • Holds a high bar in code and design review across team boundaries

AI Platform Design & Architecture

  • Designs shared AI platform services — including model integration layers, prompt management, retrieval-augmented generation infrastructure, embedding pipelines, and vector store management — that product teams can build on without re-solving the same problems

  • Defines the reference architecture for how AI capabilities are consumed across products, including interface contracts, versioning, and deprecation strategies

  • Evaluates and selects AI infrastructure components (cloud-managed model services, orchestration frameworks, vector databases) based on reliability, cost, latency, and operational complexity at scale

AI Reliability, Safety & Observability

  • Designs evaluation and monitoring pipelines that give teams visibility into AI output quality, latency, cost, and degradation over time

  • Establishes guardrail patterns and content safety standards appropriate for a regulated financial services environment

  • Defines the platform’s approach to compliance-relevant concerns: data residency, PII handling in AI pipelines, audit logging for AI-driven decisions

Platform Adoption & Developer Experience

  • Works with product engineering teams to understand how they want to consume AI capabilities, then translates that into platform APIs and abstractions that are ergonomic and consistent

  • Builds the documentation, reference implementations, and onboarding paths that make the platform easy to adopt without hand-holding

  • Identifies where product teams are solving similar AI problems in isolation and consolidates that work into shared platform capabilities

Key Responsibilities

AI Platform Discovery & Design

  • Partner with product engineering teams and architects to catalog current and near-term AI use cases, identify common patterns, and define the platform services that should be centralized

  • Produce technical designs — RFCs, architecture decision records, system diagrams — for AI platform components at a level of detail that other engineers can implement and review against

  • Evaluate third-party AI infrastructure options (model providers, vector databases, orchestration frameworks) and make build-vs-buy recommendations with clear rationale

Platform Build & Standards

  • Lead development of core AI platform services: model serving and routing, retrieval infrastructure, prompt management, output evaluation, and usage observability

  • Define and enforce integration standards — API contracts, error handling patterns, cost attribution — so that product teams building on the platform do so consistently

  • Own the technical roadmap for the AI platform, prioritizing based on what unblocks the most product development and reduces the most duplicated effort

Collaboration & Growing Others

  • Develop Senior engineers toward Staff-level scope; give them problems and opportunities that stretch them, not just guidance on their current work

  • Partner with Engineering Managers and Product leadership to align technical decisions with delivery goals

  • Own the design and maintenance of technical knowledge infrastructure — RFCs, ADRs, runbooks, onboarding paths — so teams can operate without needing to escalate

Required Experience

  • 8+ years of professional software engineering experience, with demonstrated technical leadership across multiple teams or product areas

  • Proven ability to make and defend architecture decisions at scale

  • Active daily use of AI-assisted development tools

  • Bachelor’s degree in Computer Science, Software Engineering, or equivalent experience

  • 3+ years of hands-on experience designing or building systems that integrate large language models or other ML models into production software

  • Demonstrated experience building shared platform services or internal developer platforms, not just application-level features

  • Proficiency with cloud-managed AI services (AWS Bedrock, Azure OpenAI, or equivalent) and the operational characteristics of running AI workloads in production

  • Strong understanding of retrieval-augmented generation architectures, vector search, and embedding pipeline design

  • Experience designing systems in regulated industries where data handling, audit trails, and compliance constraints shape technical decisions

Preferred Qualifications

  • Experience in fintech, banking, or other regulated financial services environments

  • Familiarity with AI evaluation frameworks and techniques for measuring output quality and detecting model degradation

  • Experience with prompt management, versioning, and experimentation at scale

  • Prior work on developer-facing platforms with a focus on adoption and internal developer experience

What Success Looks Like

In the first 90 days, this person has completed a discovery pass across our AI products teams, documented the current and planned AI use cases, and produced an initial platform architecture proposal for review by engineering leadership. Within six months, at least one core AI platform service is in production and being consumed by a product team, and the patterns for how teams integrate with AI capabilities are documented and enforced through the platform, not tribal knowledge.

Similar Jobs

5 Days Ago
Remote or Hybrid
167K-291K Annually
Senior level
167K-291K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Design, build, and operate production-grade Java and Python microservices for AI-native features. Own APIs, distributed systems, Kubernetes deployments, AI model integrations, observability, and technical leadership across cross-functional teams.
Top Skills: AnthropicGoogle Ai SdksGrafanaInstanaJavaKafkaKubernetesOpenaiOpenshiftPostgresPrometheusPythonRabbitMQRedisS3-Compatible Object Storage
7 Days Ago
Easy Apply
Remote
USA
Easy Apply
218K-257K Annually
Senior level
218K-257K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Build and operate Coinbase's LLM and agent platform: design the LLM gateway, agent runtime, knowledge bases, AI spend governance, observability/eval tooling, and ship production agents while partnering cross-functionally to ensure secure, cost-effective, and responsible generative AI at scale.
Top Skills: AgentsAi FinopsAWSCloud ProvidersKnowledge BasesLlmsMarkdown StoresMcp GatewayMcp ServersMicrovmsObservability/TracingOpen-Weight ModelsVector Stores
22 Days Ago
In-Office or Remote
250K-280K Annually
Mid level
250K-280K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning
Build and scale AI data and ML infrastructure: evaluation systems, fine-tuning pipelines, agent-first product surfaces, high-throughput data workflows, and integrations of new models into production.
Top Skills: GCPGraphQLJavaKafkaKotlinKubernetesMySQLNode.jsPostgresPubsubPythonReactReduxSpannerTypescript

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account