Horizon Media Logo

Horizon Media

Senior AI Engineer, Applied AI Solutions

Reposted 26 Days Ago
Hybrid
New York, NY, USA
195K-225K Annually
Senior level
Hybrid
New York, NY, USA
195K-225K Annually
Senior level
Design and build production-grade agentic AI systems and RAG pipelines, partner with business leaders to automate complex workflows, prototype across AI platforms, integrate models, APIs and data sources, and drive enterprise adoption and scalable solutions.
The summary above was generated by AI

Job Description

Position Summary:

We are building an applied AI team that turns business workflows into production agent systems. As a Senior AI Engineer, you will design, build and run multi-agent solutions on Google Cloud, from first prototype to a platform other teams build on. The role needs strong software engineering fundamentals, sound judgment about what a model should and should not do, and the ability to work directly with business stakeholders in ambiguous situations.


Key Responsibilities:


Agent Design and Architecture:

  • Design and build multi-agent systems with Google Agent Development Kit (ADK), using orchestrator, sub-agent, sequential and agent-as-tool patterns, and deploy them to Vertex AI Agent Engine.
  • Break business workflows into steps that a model handles and steps that deterministic code handles, so calculations, business rules, permissions and approvals never depend on model output.
  • Build human-in-the-loop controls, including confidence-based clarification, approval steps and bounded retry loops for actions that are irreversible or high value.
  • Add grounding and output checks with model callbacks, so figures and facts in responses trace back to tool results and unsupported content is corrected or withheld.
  • Manage agent state and memory across sessions, including long-term user memory, artifacts and session state, without bloating model context.

Tools, Integration and Data:

  • Build MCP servers and A2A services that expose enterprise systems to agents, with clear tool schemas, scoped permissions and errors the agent can act on.
  • Integrate agents with enterprise data and platforms such as BigQuery, Cloud SQL, Cloud Storage, Vertex AI Search, Microsoft 365, SharePoint and Microsoft Graph.
  • Build retrieval pipelines where needed, combining keyword and semantic search with permission filtering, and measure retrieval quality separately from answer quality.
  • Select and combine models across providers, including the Gemini family and Claude on Vertex AI Model Garden, with tiering and escalation to balance quality, latency and cost.

Security and Identity:

  • Design permission-aware systems in which user identity comes from the platform, never from the prompt, and every data access respects the user's entitlements.
  • Apply least-privilege access with separate deploy and runtime service accounts, Workload Identity Federation, Secret Manager and OAuth.
  • Defend agents against prompt injection by treating external content as untrusted data, limiting tool privileges and keeping audit logs of agent actions.

Evaluation and Quality:

  • Build evaluation suites with golden datasets, deterministic assertions, tool-trajectory checks and repeated runs to account for model non-determinism.
  • Run regression comparisons before every model or prompt change, measuring output quality, format validity, consistency and latency against a baseline.
  • Enforce quality with automated tests, typed Python, lint rules and evaluation gates in CI, and trace requirements through to tests and acceptance criteria.

Platform, Delivery and Operations:

  • Build reusable platform components, including project scaffolding, configuration-driven deployment, and shared modules for identity, secrets, observability and memory, so new agents ship faster on a proven pattern.
  • Operate GitOps deployment pipelines across development, staging and production, with plan-on-pull-request, apply-on-merge, drift detection and safe promotion between environments.
  • Deploy services on Cloud Run and Vertex AI Agent Engine, using containers, CI/CD and infrastructure as code.
  • Instrument agents with structured logging, tracing, token and cost tracking, and model usage reporting, and use the data to tune performance and spend.

Stakeholder Partnership and Delivery:

  • Work directly with business leaders to map workflows, define success metrics, and turn ambiguous requests into written requirements and technical designs.
  • Write design documents, decision records and deviation logs that explain trade-offs and how the system works around platform constraints.
  • Lead solutions from prototype through user acceptance testing to production, and hand over with runbooks and operational documentation.
  • Track the AI ecosystem, run focused experiments with new models, tools and frameworks, and recommend adoption based on evidence.

Qualifications & Experience:

Required:

  • 5+ years of software engineering experience, including 2+ years building and operating LLM-based applications in production.
  • Strong Python skills, including typed code, automated testing (pytest), Pydantic and modern backend development (APIs, microservices).
  • Hands-on experience building agentic systems with tool use and multi-step orchestration, using Google ADK, LangGraph, LlamaIndex or a similar framework.
  • Production experience on Google Cloud, including Vertex AI, Gemini models, Cloud Run, BigQuery, IAM and Secret Manager.
  • Experience designing evaluation for LLM systems, including golden datasets, automated checks and regression testing across model versions.
  • Working knowledge of how large language models are trained, evaluated and served, including tokenization, embeddings, fine-tuning, preference tuning and inference settings.
  • Solid fundamentals in data structures, algorithms, concurrency and failure handling, including retries, idempotency and timeouts.
  • Experience with Docker, CI/CD pipelines and infrastructure as code.
  • Ability to translate business problems into technical designs and explain trade-offs clearly to technical and non-technical audiences.

Nice to Have:

  • Experience with Vertex AI Agent Engine (Agent Platform), Gemini Enterprise and Agent Engine Memory Bank.
  • Experience building MCP servers or A2A services.
  • Experience with Claude, Perplexity or other model providers alongside Gemini, and with comparing them on cost, latency and quality.
  • Experience integrating with Microsoft 365, SharePoint, Microsoft Graph, Salesforce or Snowflake.
  • Experience with enterprise security patterns, including OAuth, Workload Identity Federation, permission-aware retrieval and audit logging.
  • TypeScript or Node.js experience, particularly for developer tooling or command line tools.
  • Experience building internal developer platforms or reusable frameworks adopted by other teams.
  • Background in agency or cross-functional product environments.

#LI-AB1

#LI-HYBRID

#HM

Horizon Media is proud to be an equal opportunity workplace.  We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements.

Salary Range

$195,000.00 - $225,000.00

A successful applicant’s actual base salary may vary based on factors such as individual’s skill sets, experience, training, education,  licensure/certifications, and qualifications for the role.  As an organization, we take an aptitude and competency-based hiring approach.  We provide a competitive total rewards package including a discretionary bonus and a variety of benefits including health insurance coverage, life and disability insurance, retirement savings plans, company paid holidays and unlimited paid time off (PTO), mental health and wellness resources, pet insurance, childcare resources, identity theft insurance, fertility assistance programs, and fitness reimbursement.

HQ

Horizon Media New York, New York, USA Office

75 Varick Street, New York, NY, United States, 10013

Similar Jobs

One Month Ago
In-Office or Remote
New York City, NY, USA
200K-360K Annually
Mid level
200K-360K Annually
Mid level
Artificial Intelligence • Machine Learning
Design and deploy generative AI and machine learning solutions for customers, spanning use-case scoping, data exploration, model development, evaluation, and deployment. Build RAG systems, fine-tuning pipelines, prompt engineering recipes, and agentic workflows. Lead customer relationships, stakeholder education, workshops, and strategic initiatives while translating recurring challenges into reusable tooling, workflows, and best practices. Collaborate with Solutions, Product, and Applied AI teams to guide roadmaps and deliver business value.
Top Skills: AirflowSparkChromaCrewaiFaissFastapiHugging Face TransformersLanggraphLlamaindexMsgspecMypyPandasPoetryPydanticPytestPythonPyTorchRayScikit-LearnWeaviate
2 Minutes Ago
Hybrid
New York, NY, USA
Junior
Junior
Fintech • Machine Learning • Software • Financial Services
Design and optimize ultra-low-latency FPGA and ASIC trading hardware using SystemVerilog, while developing supporting C++ software and testing frameworks. Responsibilities include hardware verification, timing closure, market-data analysis, Ethernet connectivity, production debugging, deployment coordination, and collaboration with traders, quants, and engineers. The role also mentors junior engineers and contributes to future hardware project planning.
Top Skills: 10G EthernetArpAsicBgpC++C++20EthernetFpgaIgmpIpPcsPythonSQLSystemverilogTcpTcpdumpTeamcityUdpVerilatorWiresharkXilinx Vivado
3 Minutes Ago
In-Office or Remote
United States
120K-140K Annually
Senior level
120K-140K Annually
Senior level
Big Data • Information Technology • Software • Analytics • Energy
Manages a seven-person team creating and maintaining intelligent 3D models for electric utility infrastructure. Performs hands-on modeling, establishes CAD and modeling standards, conducts technical reviews, develops reusable utility equipment libraries, mentors modelers, supports customer requests, and ensures model quality, accuracy, connectivity, and compatibility with SBS software. Applies electric utility engineering standards across substation, transmission, and distribution modeling projects.
Top Skills: Autodesk AutocadAutodesk InventorAutodesk RevitBimCadSbs Software

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account