Design and deploy enterprise-grade generative AI systems across the 7-layer stack, select and fine-tune models, build LLMOps pipelines and observability, integrate with cloud platforms and APIs, enforce data protection, manage hallucinations, lead technical strategy, and act as onshore client technical liaison.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
EXL New York, New York, USA Office
320 Park Avenue, 29th Floor, New York, NY, United States, 10022
EXL Jersey City, New Jersey, USA Office
Jersey City, United States, 0
EXL Newark, New Jersey, USA Office
Newark, United States
Similar Jobs
Cloud • Software
Design and build scalable, secure cloud-native platform components for ThousandEyes. Develop Java applications, event-driven systems, data pipelines, real-time enrichments, and microservices. Collaborate with product and engineering teams on planning, integration, prototypes, architecture, and implementation. Mentor junior engineers, conduct design reviews, and help ensure reliable services meet SLA targets while supporting significant platform growth.
Top Skills:
Amazon SnsAmazon SqsAWSAzureDockerGCPGradleJavaJvmKafkaKotlinKubernetesMavenMicroservicesNoSQLScalaSQL
Digital Media • Fintech • Information Technology • Machine Learning • Financial Services • Cybersecurity • Automation
Develop and manage a branch-based wealth management practice by conducting client discoveries, creating tailored financial plans, driving new business development and referrals, conducting proactive outreach, and coordinating with internal specialists for investment, insurance, estate, and financial planning services.
Artificial Intelligence • Marketing Tech • Software
Owns end-to-end client implementations for Movable Ink’s personalization platforms. Manages launch projects, develops implementation plans, configures and QA-tests campaigns, designs technical solutions, trains clients, troubleshoots issues, and coordinates with developers, engineers, architects, product teams, and stakeholders to achieve client goals and KPIs.
Top Skills:
APIsCloud Data WarehousesData LakesEmail Service ProvidersETLHTMLJavaScriptMmsMovable Ink Da VinciMovable Ink StudioPush MessagingSms
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
