The Senior Software Engineer - Generative AI will design, develop, and integrate AI-enabled capabilities, ensuring scalability, reliability, and adherence to security standards while mentoring less experienced engineers.
Role Summary
The Senior Software Engineer – Generative AI is a hands‑on technical contributor responsible for designing, developing, and integrating Generative AI–enabled capabilities within M&T Bank’s secure, governed enterprise environment. This role combines strong software engineering fundamentals with applied GenAI experience and partners closely with product, architecture, and engineering teams to deliver scalable, reliable, and responsible AI solutions.
Key Responsibilities
- Design, develop, and support GenAI‑enabled features including AI‑assisted coding, documentation, testing, analysis, and workflow automation
- Implement and maintain retrieval‑augmented generation (RAG) solutions, including data ingestion, embeddings, vector stores, and search pipelines
- Design and build agent‑based and tool‑invoking GenAI workflows, including multi‑step LLM interactions using approved enterprise platforms
- Develop and integrate APIs and backend services connecting LLMs to internal systems and approved third‑party tools
- Lead prompt design, testing, and iteration to improve output quality, relevance, and safety
- Participate in model testing, evaluation, and performance analysis using established enterprise frameworks
- Contribute hands‑on development using modern languages and frameworks (e.g., Java, Python, C#)
- Collaborate with Product Managers, Architects, and Engineers to translate requirements into technical solutions
- Provide technical guidance and mentoring to less experienced engineers
- Follow and promote M&T Bank SDLC, security, and responsible AI standards
Required Qualifications
- Associate’s degree and a minimum of 5 years’ systems analysis and/ or application development work experience or Bachelor's degree and a minimum of 3 years’ systems analysis and/ or application development work experience. In lieu of degree, a combined minimum of 7 years’ education and/or relevant work experience, including a minimum of 3 years’ systems analysis and/or application development work experience
- Strong foundation in software engineering principles, data structures, and algorithms
- Hands‑on experience with Java, Python, or C# in production environments
- Experience with RESTful APIs, API‑driven development, and Git‑based version control
- Working knowledge of machine learning and large language model (LLM) fundamentals
- Experience working within enterprise SDLC, security, and compliance standards
Preferred Qualifications
- Experience implementing Generative AI solutions in enterprise or regulated environments
- Hands‑on experience with RAG architectures, embeddings, and vector databases
- Familiarity with Transformer‑based models, attention mechanisms, and tokenization
- Experience with Microsoft Azure, including Azure‑based AI services and GenAI platforms
- Exposure to CI/CD pipelines, DevOps tooling, and automated testing
- Understanding of responsible AI, data privacy, and model governance principles
Similar Jobs
Insurance • Software
The Senior Software Engineer will design and implement Generative AI solutions, collaborate with teams, enhance AI applications, and mentor others in best practices.
Top Skills:
Ai Observability ToolsAi Orchestration FrameworksAngularAWSAzureDb2GCPIbmJavaJavaScriptLangchainPostgresPythonReactSQL ServerVue
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The role involves optimizing sourcing and procurement processes, providing strategic guidance, managing projects, and enhancing operational efficiency for clients. Responsibilities include data interpretation, supplier relationship management, and team oversight.
Top Skills:
Coupa
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Associate Customer Support Technician will assist customers with software and hardware inquiries while providing excellent customer service via phone, email, and chat. Responsibilities include troubleshooting, problem resolution, and escalating issues as needed.
Top Skills:
FreshdeskJIRAMicrosoft ApplicationsSalesforceTalkdesk
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory



.png)