Designs and maintains automated testing frameworks for UI, API, backend, integration, and end-to-end validation. Evaluates Generative AI, LLM, RAG, and agentic systems using benchmark datasets and quality metrics such as accuracy, groundedness, faithfulness, hallucination detection, and latency. Collaborates with developers, analysts, and DevOps teams in Agile and cloud-native environments to improve release quality, expand test coverage, and support AI-enabled software delivery.
Description and Requirements
Summary of Position Responsibilities:
An AI Testing Engineer / SDET will be responsible for strengthening software quality across Agile, cloud-native, and AI-enabled delivery teams. The role requires strong programming fundamentals, test automation expertise, and the ability to validate traditional applications as well as emerging Generative AI, RAG, and Agentic AI solutions. The engineer will work closely with software developers, system analysts, and DevOps teams to improve release quality, automate validation, reduce manual effort, and support AI-driven SDLC initiatives.
Key Responsibilities
Quality Engineering and Testing
Automation and Reliability Engineering
AI Evaluation & Agentic Validation
Candidate Qualifications
Preferable:
- Language skills ( Japanese/English bilingual )
- Insurance business knowledge
- Transformation project experience
福利厚生
メットライフ生命では、ワークライフバランスと社員の心身の健康を促進する福利厚生を提供しています。社員はフレックスタイム制度、年次有給休暇、特別連続休暇、リフレッシュ休暇等の休暇を利用できます。また、社会保険や団体保険の他、旅行や英会話教室で使える割引も提供しています。柔軟に働けるよう、オフィス勤務と在宅勤務を組み合わせた勤務形態の導入や、短時間勤務制度、また柔軟性のあるドレスコードなども設けています。
Benefits We Offer
MetLife Japan offers a comprehensive benefits package that promotes work-life balance and employee wellbeing. Employees can take advantage of flex time policy and a generous time-off policy, national holidays, annual paid leave, special consecutive leave, and refreshment leave. We also provide full social insurance coverage, a commuting expense reimbursement, group insurance, and discounts on travel and English language lessons. To support work flexibility, employees also have hybrid work options, shortened working hours for parents with children in third grade or below, and a casual dress code.
メットライフについて
メットライフは、グローバルで展開する金融サービス企業です。個人および法人のお客さまがより確かな未来を築けるよう、保険、年金、社員福利厚生給付、資産管理のサポートを提供しています。1868年に創業したメットライフは、世界40以上の市場で事業を展開し、米国、アジア、中南米、ヨーロッパ、中東において業界をリードしています。
メットライフは、New Frontier戦略の一環として、AIを活用し、人を中心に据えた未来を築いています。私たちは、AIを活用して顧客へのサービス向上、地域社会への支援、そして働き方の変革を推進していく中で、好奇心、適応力、そして成長意欲を持つ人材を求めています。メットライフにおいて、AIは、人間の判断力、創造性、継続的な改善を支える責任あるパートナーであり、信頼、インクルージョン、そして長期的な価値の構築に貢献しています。
メットライフ生命は、日本初の外資系生命保険会社として、1973年2月に国内での営業を開始しました。当社のPurpose「ともに歩んでゆく。よりたしかな未来に向けて。」は、メットライフが誇るグローバルネットワークと世界中のベストプラクティスを活かし、お客さまのニーズに応え、地域社会との信頼関係を築くという信念を表しています。
About MetLife
MetLife Inc., through its subsidiaries and affiliates (MetLife), is one of the world's leading financial services companies, providing insurance, annuities, employee benefits and asset management to help individual and institutional customers build a more confident future. Founded in 1868, MetLife has operations in more than 40 markets globally and holds leading positions in the United States, Asia, Latin America, Europe and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
MetLife Japan began operations in February 1973 as Japan's first foreign-owned life insurance company. Our purpose, "Always with you, building a more confident future," encapsulates our strong commitment to leveraging our global network and best practices worldwide to stand with our customers and build trust with our communities.
#BI-Hybrid
Summary of Position Responsibilities:
An AI Testing Engineer / SDET will be responsible for strengthening software quality across Agile, cloud-native, and AI-enabled delivery teams. The role requires strong programming fundamentals, test automation expertise, and the ability to validate traditional applications as well as emerging Generative AI, RAG, and Agentic AI solutions. The engineer will work closely with software developers, system analysts, and DevOps teams to improve release quality, automate validation, reduce manual effort, and support AI-driven SDLC initiatives.
Key Responsibilities
Quality Engineering and Testing
- Understand application architecture, APIs, databases, source code, authentication flows, cloud integrations, and business workflows.
- Design, execute, and maintain test plans, test cases, and validation strategies across unit, functional, integration, system, API, end-to-end, and regression testing.
- Identify, document, track, and verify defects while ensuring the new functionality does not impact existing features.
Automation and Reliability Engineering
- Develop and maintain reusable automation frameworks, test suites, validation scripts, and regression capabilities for UI, API, backend, and integration testing.
- Improve test coverage, release confidence, and engineering productivity by promoting automation-first quality practices.
AI Evaluation & Agentic Validation
- Creating and implementing AI agents to support end-to-end automation across software engineering processes, including task management, user story authoring, development, testing, and delivery-related activities.
- Design and execute evaluation strategies for Generative AI, LLM, RAG, and Agentic AI systems, including benchmark datasets and automated evaluation pipelines.
- Validate AI quality metrics such as accuracy, relevance, groundedness, faithfulness, hallucination detection, response quality, and latency.
- Test RAG workflows including ingestion, chunking, indexing, retrieval, ranking, response generation, prompt quality, agents, tools, workflows, and orchestration frameworks.
Candidate Qualifications
- 4 to 8 years of experience in software testing, quality engineering, test automation, reliability engineering, or similar roles.
- Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
- Strong programming skills in Java, TypeScript, JavaScript, or Python with good understanding of OOP, data structures, algorithms, and design patterns.
- Hands-on experience with automation tools such as Selenium, Playwright, Cypress, TestNG, Cucumber, RestAssured , PyTest , Postman/Newman, or similar frameworks.
- Practical experience in Agile and DevOps environments with Azure DevOps, Docker, Jenkins, Selenium Grid, TDD/BDD, and CI/CD practices.
- Exposure to frontend, backend, REST API, microservices, cloud-native applications, and database validation.
- Experience with Azure services such as App Services, Azure SQL Database, Azure Storage, Azure OpenAI, and Entra ID/OAuth is preferred.
- Knowledge of AI/LLM applications, RAG systems, LangChain , LangGraph , Semantic Kernel, Agentic AI frameworks, AI coding assistants, ML concepts, AI observability, vector databases, and performance tools such as JMeter or BlazeMeter will be a strong advantage.
Preferable:
- Language skills ( Japanese/English bilingual )
- Insurance business knowledge
- Transformation project experience
福利厚生
メットライフ生命では、ワークライフバランスと社員の心身の健康を促進する福利厚生を提供しています。社員はフレックスタイム制度、年次有給休暇、特別連続休暇、リフレッシュ休暇等の休暇を利用できます。また、社会保険や団体保険の他、旅行や英会話教室で使える割引も提供しています。柔軟に働けるよう、オフィス勤務と在宅勤務を組み合わせた勤務形態の導入や、短時間勤務制度、また柔軟性のあるドレスコードなども設けています。
Benefits We Offer
MetLife Japan offers a comprehensive benefits package that promotes work-life balance and employee wellbeing. Employees can take advantage of flex time policy and a generous time-off policy, national holidays, annual paid leave, special consecutive leave, and refreshment leave. We also provide full social insurance coverage, a commuting expense reimbursement, group insurance, and discounts on travel and English language lessons. To support work flexibility, employees also have hybrid work options, shortened working hours for parents with children in third grade or below, and a casual dress code.
メットライフについて
メットライフは、グローバルで展開する金融サービス企業です。個人および法人のお客さまがより確かな未来を築けるよう、保険、年金、社員福利厚生給付、資産管理のサポートを提供しています。1868年に創業したメットライフは、世界40以上の市場で事業を展開し、米国、アジア、中南米、ヨーロッパ、中東において業界をリードしています。
メットライフは、New Frontier戦略の一環として、AIを活用し、人を中心に据えた未来を築いています。私たちは、AIを活用して顧客へのサービス向上、地域社会への支援、そして働き方の変革を推進していく中で、好奇心、適応力、そして成長意欲を持つ人材を求めています。メットライフにおいて、AIは、人間の判断力、創造性、継続的な改善を支える責任あるパートナーであり、信頼、インクルージョン、そして長期的な価値の構築に貢献しています。
メットライフ生命は、日本初の外資系生命保険会社として、1973年2月に国内での営業を開始しました。当社のPurpose「ともに歩んでゆく。よりたしかな未来に向けて。」は、メットライフが誇るグローバルネットワークと世界中のベストプラクティスを活かし、お客さまのニーズに応え、地域社会との信頼関係を築くという信念を表しています。
About MetLife
MetLife Inc., through its subsidiaries and affiliates (MetLife), is one of the world's leading financial services companies, providing insurance, annuities, employee benefits and asset management to help individual and institutional customers build a more confident future. Founded in 1868, MetLife has operations in more than 40 markets globally and holds leading positions in the United States, Asia, Latin America, Europe and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
MetLife Japan began operations in February 1973 as Japan's first foreign-owned life insurance company. Our purpose, "Always with you, building a more confident future," encapsulates our strong commitment to leveraging our global network and best practices worldwide to stand with our customers and build trust with our communities.
#BI-Hybrid
MetLife New York, New York, USA Office
MetLife New York City, NY Office

200 Park Ave, New York, NY, United States, 10166
MetLife Bridgewater, New Jersey, USA Office
MetLife Bridgewater, NJ Office

501 Route 22, Bridgewater, NJ, United States, 08807
MetLife Whippany, New Jersey, USA Office
MetLife Whippany, NJ Office

One MetLife Way, Whippany, NJ, United States, 07981
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Develop and maintain web, API, and mobile automation frameworks; execute automated and manual testing; troubleshoot failures; support CI/CD, performance, integration, and cloud-native testing; and apply AI tools for test generation, code review, anomaly detection, defect prediction, and root-cause analysis.
Top Skills:
AgileAi Agent EvaluationAi/Ml FrameworksAppiumAzureAzure DevopsAzure Devops Test PlanBashBdd-CucumberBlazemeterBrowserstackCi/CdClaude CliCopilot Agent ModeCursorDockerDockerGitGithub CopilotGithub EnterpriseJavaJavaScriptJenkinsJmeterKaratedslLlmsMicrosoft Ai FoundryPerfectoPlaywrightPostmanPowershellPrompt EngineeringPythonRestassuredSaucelabsScaled Agile FrameworkSeleniumSelenium GridToscaTypescript
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Supports banks and securities firms as insurance distribution partners. Develops sales strategies, provides field execution support, conducts product study sessions, accompanies partner representatives, and manages recruitment compliance. The role builds long-term relationships with financial institutions, delivers presentations and training, and may involve nationwide business travel. Initial locations are Tokyo or Osaka, with hybrid work options and structured onboarding.
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Support reinsurance treaty administration, settlements, quarterly financial closing, actuarial and financial analysis, governance, regulatory inquiries, and process documentation. The role collaborates with Finance, Risk Management, Product Development, Legal, and regional actuarial teams while contributing to reinsurance, capital management, and process improvement projects.
Top Skills:
Excel
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory




