Design, deploy, and operate a secure, scalable Generative AI platform on AWS (Bedrock) for production LLM applications. Own architecture, deployment, monitoring, incident management, reliability, governance, and cost optimization in regulated financial environments.
JD Experience – 8 + years Key Responsibilities • Design, build, and operate a secure, scalable, and cost efficient enterprise Generative AI platform on AWS, supporting production grade LLM applications in regulated environments. • Own the full GenAI platform lifecycle, including architecture, deployment, operations, monitoring, incident management, and continuous reliability and performance improvements. • Implement and run AWS Bedrock–based solutions, enabling LLM inference, RAG, Agents, and Guardrails with high availability, fault tolerance, and SLA compliance. • Establish strong operational and governance frameworks, covering observability, alerting, RCA, security controls, access management, compliance, and cost optimization. • Bring deep expertise in cloud ML platforms and financial services, with strong Python skills, AWS services knowledge, GenAI hands on experience, and a background in production support, reliability engineering, and AI governance. Required Skills • 8+ years of experience in hands on exposure to AI/ML or Generative AI systems • Strong understanding of AI evaluation techniques, including hallucination detection, factual accuracy, bias, and output consistency • Knowledge of Responsible AI principles, including fairness, transparency, and explainability • Python (must-have) and Experience with: REST APIs and microservices
Hexaware Technologies Iselin, New Jersey, USA Office
101 Wood Avenue South Suite, Iselin, United States, 08830
Hexaware Technologies Jamesburg, New Jersey, USA Office
1095 Cranbury S Rvr Rd St, Jamesburg, New Jersey, 08831-3411, United States, Jamesburg, United States, 08831-3411
Hexaware Technologies Jersey City, New Jersey, USA Office
Jersey City, United States
Hexaware Technologies New York, New York, USA Office
New York, United States, 0
Hexaware Technologies Secaucus, New Jersey, USA Office
Secaucus, United States
Similar Jobs
Information Technology • Consulting
Design, build, and operate a secure, scalable Generative AI platform on AWS (including Bedrock) for production LLM applications in regulated environments. Own platform lifecycle: architecture, deployment, operations, monitoring, incident management, reliability, and cost optimization. Implement RAG, Agents, inference, guardrails, observability, access controls, and governance, with emphasis on Responsible AI and production reliability in financial services.
Top Skills:
AgentsAWSAws BedrockLlmsMicroservicesObservability/MonitoringPythonRest ApisRetrieval-Augmented Generation (Rag)
Information Technology • Consulting
Design, build, and operate a secure, scalable enterprise Generative AI platform on AWS (including AWS Bedrock). Own platform lifecycle: architecture, deployment, operations, monitoring, incident management, reliability, and governance. Implement LLM inference, RAG, Agents, guardrails, observability, security controls, access management, compliance, and cost optimization. Support production-grade GenAI applications in regulated/financial environments.
Top Skills:
AgentsAWSAws BedrockLlmsMicroservicesPythonRest ApisRetrieval-Augmented Generation (Rag)
Information Technology • Consulting
Design and deliver GenAI solutions: prototype to production LLM services, build RAG pipelines, fine-tune models (LoRA/QLoRA/PEFT), engineer prompts/tools/memory, ensure safety and evaluation, deploy with MLOps (CI/CD, containers, IaC), optimize inference, and ensure security/compliance while collaborating with product, data, and SRE teams.
Top Skills:
Agentic PatternsChunkingCi/CdContainerizationContent FiltersDocument StoresEmbeddingsEvaluation FrameworksFilteringFoundation ModelsGuardrailsHosted ApisInfrastructure As CodeLlmLoraMultimodalObservability ToolingOpen-Source ModelsPeftPii HandlingPrompt EngineeringQloraRagRe-RankingRetrievalVector Databases
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
