Trilagen Logo

Trilagen

Agentic AI Engineer

Posted 2 Days Ago
In-Office
New York, NY, USA
Mid level
In-Office
New York, NY, USA
Mid level
Build and lead production-grade agentic AI systems for enterprise clients across AWS, OCI, and Azure. Own full-stack development, cloud deployment, CI/CD, LLM integrations, agent orchestration, memory and retrieval architectures, APIs, identity, security, and operational documentation. Engage directly with stakeholders, translate requirements into scalable systems, advise on model and cloud strategy, and help productize the company’s delivery approach.
The summary above was generated by AI

We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and LLM integrations that are model-agnostic and built to last.

You'll be deployed on client engagements as the lead technical architect and builder of agentic systems running in AWS, OCI, and Azure. You'll work directly with client stakeholders, translate complex requirements into working systems, and leave behind infrastructure clients can operate and extend. You'll also help Trilagen productize our delivery approach as we scale the practice.

If you've only ever built agents that run on your laptop, this isn't the role. If you've shipped agentic systems into production cloud environments and know exactly what breaks and why — we want to talk.

What you'll own

Full-stack agent development You design and build the entire application — not just the AI layer. This means a React or Next.js frontend with streaming, real-time agent UX; a Python or Node.js backend that orchestrates agent logic, manages state, and exposes clean APIs; and containerized, cloud-deployed services that operations teams can actually run. You own the repo, the CI/CD pipeline, the deployment, and the runbook.

Multi-cloud deployment Production agent systems on all three major clouds: AWS (Lambda, ECS/Fargate, Bedrock, API Gateway), Oracle OCI (OKE, Functions, AI Services), and Azure (AKS, Azure OpenAI Service, Azure Functions). You understand the tradeoffs between platforms and can advise clients on where to run what and why.

LLM integration and model strategy You have deep, hands-on experience with the leading LLM providers and their APIs — Anthropic Claude (Messages API, tool use, streaming, context management), OpenAI (GPT-4o, Assistants API, function calling), and Google Gemini (Gemini Pro/Flash, Vertex AI). You architect model-agnostic integration layers so clients aren't locked in, and you know how to select, swap, and benchmark models for specific agent tasks.

Agentic architecture You understand how to design systems that do real multi-step work: tool use and function calling patterns, ReAct and plan-and-execute loops, agent-to-agent orchestration and handoffs, human-in-the-loop checkpoints, retry and failure recovery strategies, and cost/latency optimization across long-running agent workflows. Frameworks like LangGraph, CrewAI, AutoGen, and the Model Context Protocol (MCP) are tools in your toolbox, not the ceiling of your knowledge.

Memory and context layer You've designed and implemented memory architectures for production agents: short-term conversational context, long-term persistent memory, RAG pipelines with vector databases (Pinecone, pgvector, OpenSearch, Weaviate), semantic search, and hybrid retrieval strategies. You know when to use each and how to keep them performant at scale.

Security and identity layer This is non-negotiable for our client base. You build the security envelope around every agent system you ship: OAuth 2.0 / OIDC authentication flows, API key lifecycle management, role-based access control enforced within agent workflows, secrets management (AWS Secrets Manager, Azure Key Vault, OCI Vault), audit logging for agent actions, prompt injection defense, and data residency controls. Familiarity with Okta or SailPoint ISC is a direct advantage on our engagements.


Requirements
  • 4+ years of software engineering experience with at least 2 years building and shipping LLM-powered or agentic applications in production cloud environments
  • Hands-on depth with at least two of the three major LLM providers: Anthropic Claude, OpenAI, and Google Gemini — at the API level, not just via wrappers
  • Full-stack proficiency: Python (FastAPI, Flask, or similar) backend, React or Next.js frontend, REST and WebSocket API design
  • Production experience on at least two of: AWS, Azure, OCI — with real deployments, not sandbox accounts
  • Demonstrated ability to design and implement agent memory and retrieval systems using vector databases and RAG
  • Strong command of AI security practices: auth, RBAC, secrets management, audit logging, and prompt-level safeguards
  • Consulting DNA — you can run a discovery session, write a technical design doc, manage client expectations, and own delivery end to end

Nice to have

  • Experience with all three LLM providers (Anthropic, OpenAI, Gemini) and model-agnostic orchestration patterns
  • Okta and/or SailPoint ISC integration experience
  • Cloud certifications: AWS Solutions Architect, Azure Solutions Architect, OCI Architect

Benefits

Benefits:

  • 401K
  • Health Insurance
  • Dental Insurance
  • Paid Time Off
  • Paid Sick Leave

Similar Jobs

Yesterday
Hybrid
New York, NY, USA
197K-246K Annually
Mid level
197K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Build and deploy foundational AI systems, including foundation model training, LLM inference, agentic workflows, vector search, guardrails, evaluation, governance, and observability. Optimize large-scale AI systems for latency, cost, throughput, scalability, and hardware utilization. Own complex architectures, reliability SLOs, security and compliance reviews, technical roadmaps, and cross-functional delivery while mentoring engineering teams.
Top Skills: Agentic AiAWSAws UltraclustersAzureC#C++CudaGoGCPGpusHugging FaceJavaKubernetesLlm InferencePythonPyTorchScalaSimilarity SearchTpusVectordbs
7 Days Ago
Hybrid
New York, NY, USA
197K-246K Annually
Mid level
197K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, deploy, and support scalable AI systems, including foundation model training, LLM inference, agentic workflows, similarity search, guardrails, evaluation, governance, and observability. Optimize AI infrastructure for cost, latency, throughput, and hardware utilization. Own complex system architecture, define reliability objectives, lead technical reviews, ensure security and compliance, contribute to long-term AI platform strategy, and mentor engineering colleagues.
Top Skills: AWSAws UltraclustersAzureC#C++CudaGoGCPGpusHugging FaceJavaPythonPyTorchScalaTpusVectordbs
7 Days Ago
Hybrid
New York, NY, USA
230K-286K Annually
Senior level
230K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, develop, optimize, deploy, and support foundational AI systems, including LLM inference, agentic workflows, vector search, model evaluation, orchestration, governance, and observability. Lead cost-performance optimization across production AI platforms, establish engineering standards, contribute to technical roadmaps, lead design reviews, and mentor senior AI engineers. Collaborate with research, engineering, program management, and product teams to deliver scalable, responsible AI products.
Top Skills: Agentic AiAWSAws UltraclustersAzureC#C++CudaGoGoGCPHugging FaceJavaLarge Language ModelsLlmsModel CompressionMulti-Agent WorkflowsPythonPyTorchRetrieval-Augmented GenerationScalaSimilarity SearchVectordbs

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account