Design and deliver GenAI solutions: prototype to production LLM services, build RAG pipelines, fine-tune models (LoRA/QLoRA/PEFT), engineer prompts/tools/memory, ensure safety and evaluation, deploy with MLOps (CI/CD, containers, IaC), optimize inference, and ensure security/compliance while collaborating with product, data, and SRE teams.
Key Responsibilities Solution Design and Delivery Translate business problems into Gen AI architectures (LLM, RAG, agentic patterns, multimodal). Build end-to-end prototypes and evolve them into reliable, secure production services. LLM Development Select and integrate foundation models (hosted APIs or open-source). Implement fine-tuning and parameter-efficient methods (e.g., LoRA/QLoRA/PEFT) where needed. Engineer prompts/system messages, tools/functions, and memory strategies. Retrieval and Data Implement RAG pipelines: chunking, embeddings, retrieval, re-ranking, and filtering. Work with vector databases and document stores; design data quality checks. Evaluation and Safety Define automated and human-in-the-loop evaluation for accuracy, toxicity, bias, and hallucinations. Implement guardrails, content filters, and policy enforcement. MLOps and Platform Package and deploy services with CI/CD, containerization, and IaC as applicable. Optimize inference for latency, throughput, and cost; monitor with observability tooling. Security, Privacy, and Compliance Handle PII securely; align with data governance, regulatory, and licensing constraints. Collaboration Partner with product, domain SMEs, data engineering, and SRE to deliver measurable outcomes. Document designs, decisions, and runbooks; share best practices.
Hexaware Technologies Iselin, New Jersey, USA Office
101 Wood Avenue South Suite, Iselin, United States, 08830
Hexaware Technologies Jamesburg, New Jersey, USA Office
1095 Cranbury S Rvr Rd St, Jamesburg, New Jersey, 08831-3411, United States, Jamesburg, United States, 08831-3411
Hexaware Technologies Jersey City, New Jersey, USA Office
Jersey City, United States
Hexaware Technologies New York, New York, USA Office
New York, United States, 0
Hexaware Technologies Secaucus, New Jersey, USA Office
Secaucus, United States
Similar Jobs
Information Technology • Consulting
Develop, test, and maintain applications using Java, Python, or Node.js. Write clean, efficient code, debug and optimize, collaborate with cross-functional teams, use data structures/algorithms, work with SQL/NoSQL databases, participate in code reviews, and stay current on AI/ML concepts, agents, and automation tools.
Top Skills:
AgentsAIAutomation ToolsJavaMachine LearningNode.jsNoSQLPythonSQL
Information Technology • Consulting
Design, build, and operate a secure, scalable GenAI platform on AWS (including Bedrock). Own platform lifecycle, enable LLM inference, RAG, Agents and guardrails, ensure observability, incident management, security, compliance, cost optimization, and reliability for production-grade regulated-financial environments. Provide Python-based development and support for microservices and REST APIs.
Top Skills:
AgentsAWSAws BedrockLlmsMicroservicesPythonRest ApisRetrieval-Augmented Generation (Rag)
Information Technology • Consulting
Design, build, and operate a secure, scalable Generative AI platform on AWS (including Bedrock) to support production LLM applications in regulated financial environments. Own platform lifecycle: architecture, deployment, operations, monitoring, incident management, reliability, and performance. Implement LLM inference, RAG, Agents, guardrails, observability, security controls, access management, compliance, and cost optimization. Provide production support, reliability engineering, and AI governance.
Top Skills:
AgentsAWSAws BedrockLlmMicroservicesPythonRagRest Apis
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
