The role involves designing, operating, and improving a secure, scalable Generative AI platform on AWS, focusing on LLM applications and compliance in financial services.
JD Experience – 8 + years Key Responsibilities • Design, build, and operate a secure, scalable, and cost efficient enterprise Generative AI platform on AWS, supporting production grade LLM applications in regulated environments. • Own the full GenAI platform lifecycle, including architecture, deployment, operations, monitoring, incident management, and continuous reliability and performance improvements. • Implement and run AWS Bedrock–based solutions, enabling LLM inference, RAG, Agents, and Guardrails with high availability, fault tolerance, and SLA compliance. • Establish strong operational and governance frameworks, covering observability, alerting, RCA, security controls, access management, compliance, and cost optimization. • Bring deep expertise in cloud ML platforms and financial services, with strong Python skills, AWS services knowledge, GenAI hands on experience, and a background in production support, reliability engineering, and AI governance. Required Skills • 8+ years of experience in hands on exposure to AI/ML or Generative AI systems • Strong understanding of AI evaluation techniques, including hallucination detection, factual accuracy, bias, and output consistency • Knowledge of Responsible AI principles, including fairness, transparency, and explainability • Python (must-have) and Experience with: REST APIs and microservices
Similar Jobs
Information Technology • Software
The Enterprise Account Executive will secure large partnerships by managing target accounts, engaging with prospects, negotiating contracts, and collaborating with various teams for smooth transitions and competitive offerings while traveling for conferences and prospect visits.
Top Skills:
SaaS
Food • Healthtech • Information Technology • Other
Lead the design and implementation of HIPAA-compliant systems on a healthcare platform, ensuring continuous compliance and integrating clinical data. Mentor engineers and drive innovations in health tech.
Top Skills:
.Net 10Api ManagementApp ServicesAzureC#CosmosdbEvent Grid/HubFhirFunctionsHl7Key VaultSmart On FhirSQL
Food • Healthtech • Information Technology • Other
The Senior Back-End Engineer will build cloud-native back-end services, APIs, and microservices for a health technology platform, focusing on scalability, security, and compliance.
Top Skills:
.Net 10Api ManagementAzure FunctionsC#Cosmos DbEvent GridKey VaultService BusSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory


.png)