Design and deploy enterprise Generative AI systems across the 7-layer stack: data ingestion, preprocessing, model selection, orchestration, inference, integration, and application. Lead model selection/tuning (commercial and open-source), establish LLMOps and observability, integrate AI with cloud platforms, enforce data protection, manage hallucinations/security, and act as onshore technical lead for client workshops and stakeholder alignment.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
EXL New York, New York, USA Office
320 Park Avenue, 29th Floor, New York, NY, United States, 10022
EXL Jersey City, New Jersey, USA Office
Jersey City, United States, 0
EXL Newark, New Jersey, USA Office
Newark, United States
Similar Jobs
Consumer Web • Real Estate • Sharing Economy • Virtual Reality • Consulting • Manufacturing
Lead and oversee daily accounting operations including GL, AP/AR, payroll, fixed assets, and reconciliations. Manage monthly/quarterly/annual close, prepare and analyze financial statements, ensure GAAP compliance, coordinate audits, maintain internal controls, and lead budgeting/forecasting. Supervise and develop accounting staff, manage ERP/accounting systems, support tax filings, and provide financial insights to senior leadership to improve profitability and efficiency.
Top Skills:
Microsoft Dynamics 365ExcelNetSuiteOraclePower BIQuickbooks EnterpriseSageSAPTableau
Digital Media • Information Technology • News + Entertainment
Manage and grow Comcast Business indirect channel sales through partner recruitment, enablement, and relationship management. Drive monthly sales, forecast pipeline in CRM, coordinate installations with regional teams, and support issue resolution. Required to travel ~50% across the Midwest and meet quota as a quota-carrying individual contributor.
Top Skills:
CRM
Digital Media • Information Technology • News + Entertainment
Lead design and delivery of advanced ML systems for recommendation and search: set technical objectives, prototype and deploy end-to-end models, perform research and data aggregation for feature engineering, evaluate partner solutions, author technical documentation, mentor engineers, and manage live optimization and decision-automation projects.
Top Skills:
Agentic AiAgentic OrchestrationAPIsGenerative Ai AgentsMachine Learning
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
