Design and deploy enterprise Generative AI systems across the 7-layer stack: data ingestion, preprocessing, model selection, orchestration, inference, integration, and application. Lead model selection/tuning (commercial and open-source), establish LLMOps and observability, integrate AI with cloud platforms, enforce data protection, manage hallucinations/security, and act as onshore technical lead for client workshops and stakeholder alignment.
Design and deploy enterprise-grade AI solutions (LLMs, RAG, agents) by selecting appropriate models, building data pipelines, and integrating them with cloud platforms (AWS, Azure, GCP). Lead technical strategies across the standard 7-layer GenAI stack (from data ingestion to application interfaces), ensure scalability, manage AI security/hallucinations, and bridge business needs with engineering teams.
Responsibilities- System Design & Architecture: Architect end-to-end Generative AI systems by operationalizing the 7-layer AI architecture (Data Sources, Preprocessing, Model Selection, Orchestration, Inference, Integration, and Application).
- Model Selection & Tuning: Evaluate and select cutting-edge commercial (e.g., GPT-4) and open-source models, and fine-tune models for domain-specific use cases.
- LLMOps, Observability & Pipelines: Establish LLMOps standards for model versioning and CI/CD. Implement foundational observability (OBS) layers using tools like Datadog, Splunk, or Prometheus to monitor system health, API latency, and basic application metrics.
- Integration & Data Protection: Integrate AI solutions with existing APIs while enforcing core data protection measures, including Role-Based Access Control (RBAC), data encryption in transit, and basic PII (Personally Identifiable Information) masking to manage hallucinations and adversarial attacks.
- Strategic Leadership: Collaborate with stakeholders to map business challenges to AI solutions and establish AI governance frameworks.
- Client Consulting: Act as the primary onshore technical liaison, facilitating client workshops, requirements gathering, and translating business pain points into technical AI blueprints.
- Consulting Skills: Exceptional client-facing communication skills; proven ability to present complex technical concepts to business stakeholders.
- Technical Expertise: Deep knowledge of NLP, Python, deep learning frameworks (PyTorch/TensorFlow), and orchestration tools (LangChain, Autogen).
- Cloud & Data Systems: Extensive hands-on experience with AI services on AWS, Azure, or GCP. Expertise in vector databases (e.g., Pinecone, Milvus) and embedding techniques.
- Qualifications: Bachelor’s / Master’s in Computer Science, AI, Data Science, or related field; 8–15 years in software engineering, ML, or AI roles, with demonstrable onshore consulting experience.
EXL New York, New York, USA Office
320 Park Avenue, 29th Floor, New York, NY, United States, 10022
EXL Jersey City, New Jersey, USA Office
Jersey City, United States, 0
EXL Newark, New Jersey, USA Office
Newark, United States
Similar Jobs
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Manages strategic insurance industry alliance partners, driving revenue through partner enablement, joint business plans, go-to-market strategies, training, and product education. Tracks partner KPIs and pipeline performance, collaborates with sales, marketing, customer experience, and product teams, represents the company at industry events, and negotiates partner contracts and incentives.
Top Skills:
AICloud SoftwareCrm SystemsSaaS
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Serve as a pre-sales technical expert for DX, partnering with Account Executives throughout the sales cycle. Lead technical discovery, evaluations, proof-of-concepts, pilots, product demonstrations, and solution design involving APIs and client engineering workflows. Advise prospects on deployment and analytics integrations, translate technical concepts into business value, and relay customer feedback to Product and Engineering teams. Manage technical follow-ups across multiple opportunities.
Top Skills:
APIsCi/CdGitGithub CliRestRubyRuby On RailsSQL
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Drive enterprise adoption of Atlassian’s Rovo AI platform through discovery workshops, custom agent design, connector configuration, production deployment, and customer enablement. Partner with enterprise teams to identify valuable AI use cases, translate business needs into technical solutions, measure outcomes, and support independent scaling. Collaborate with account teams, CSMs, product, engineering, and AI teams to improve adoption and customer value. Travel up to 15% domestically and internationally.
Top Skills:
Ai AgentsAtlassianConfluenceGitGoogle DriveJIRAPrompt EngineeringRovoRovo StudioSharepointSlackThird-Party Connectors
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
