EXL Logo

EXL

GenAI / Agentic Architect

Posted 3 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Remote
Hiring Remotely in United States
200K-280K Annually
Expert/Leader
Lead enterprise GenAI strategy and architecture across the 7-layer LLM stack. Advise C-suite, design scalable ingestion and RAG/agentic pipelines, implement observability (token tracing, drift/hallucination monitoring), enforce data protection/DLP and semantic caching, and oversee large onshore client delivery and technology trade-off decisions.
The summary above was generated by AI

Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements. 

Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation. 

Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.

Responsibilities
  • Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
  • Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
  • Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
  • Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
  • Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
Qualifications
  • Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
  • Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
  • Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
  • Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.

The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.

For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits


The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.

Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.


The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.

HQ

EXL New York, New York, USA Office

320 Park Avenue, 29th Floor, New York, NY, United States, 10022

EXL Jersey City, New Jersey, USA Office

Jersey City, United States, 0

EXL Newark, New Jersey, USA Office

Newark, United States

Similar Jobs

2 Days Ago
In-Office or Remote
3 Locations
184K-357K Annually
Senior level
184K-357K Annually
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design and deploy AI applications for telecommunications networks, focusing on generative models and infrastructure improvements, while providing technical guidance and building enterprise solutions.
Top Skills: SparkC++ElasticsearchMorpheusNemoNoSQLNvidia Data Acceleration SdksPandasPythonPyTorchRapidsSQL
11 Minutes Ago
In-Office or Remote
New York, NY, USA
Senior level
Senior level
Mobile • Software
Own and improve the data foundation for Radar's geocoding platform: model and serve location data, build large-scale ingestion and integration pipelines, improve coverage and quality, apply LLMs/agents for enrichment and labeling, work across Scala/Python/Rust and the Node.js API, operate systems at very high throughput, and engage with customers to inform product decisions.
Top Skills: AgentsAirflowAthenaAWSClaudeCodexEksFstKubernetesLlmsMaplibreMongoDBNode.jsOpenaddressesOpenstreetmapPythonRedisRocksdbRustS3ScalaTantivyTerraformTypescript
34 Minutes Ago
Remote or Hybrid
169K-200K Annually
Senior level
169K-200K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Deliver technical demonstrations, deploy proof-of-value installations, lead technical training, support marketing and conferences, troubleshoot and develop use cases, create prospect-facing documentation, and travel to support Federal customers for Armis/Veza security solutions.
Top Skills: ArmisArubaIomtIotLinuxMerakiNetworkingOtPythonServicenowVezaVirtualizationWlc

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account