New York Life Insurance Company Logo

New York Life Insurance Company

Senior Associate - Data Engineer

Posted Yesterday
In-Office
New York, NY
95K-163K Annually
Senior level
In-Office
New York, NY
95K-163K Annually
Senior level
The Senior Data Engineer will design and implement data pipelines and manage cloud-based data solutions while collaborating with architecture and product teams.
The summary above was generated by AI
Location Designation: Hybrid - 3 days per week
We are seeking energetic and passionate Senior Data Engineer to design and execute our company's modern data management strategy. As a key member of Enterprise Data Platform team, you will work with talented engineers, architects, data scientists and end users to reimagine, design and build the next generation of Insurance solutions in the cloud leveraging nascent and modern technologies and platforms including AWS and Azure cloud, APIs, and AI. You will be responsible for the design, development and deployment of optimal data pipelines taking advantage of leading-edge technologies through experimentation and iterative refinement. You will assist other team members in building and executing automation that effectively and repeatably ensures quality, security, integrity and maintainability of our solutions. You will also be responsible for the evaluation of existing data pipeline architecture, evolve and enhance the foundation, participate in product ideation and technology stack evaluation and recommendations
What You'll Do:
  • Engages in collaborative relationships across architecture, product management, data and product delivery teams to design, implement solutions based on defined business challenges and outcomes
  • Participate on scrum teams working in short sprints and ensure on time delivery with high quality
  • Build and maintain Data engineering solutions on cloud platforms using AWS or Azure services.
  • Design, develop, and implement scalable data transformations and ETL/ELT processes using Python, PySpark, and or Data Integration tools IDMC, DBT
  • Collaborate with Data Architects and Data analysts to understand data requirements and translate them into scalable, high performant data integration and pipeline solutions.
  • Develop and maintain data models and schemas to support data integration and analysis
  • Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues
  • Optimize and tune data integration pipelines for performance, reliability, and scalability
  • Implement data quality and validation checks to ensure accuracy and integrity of data through testing
  • Build the infrastructure required for optimal ETL/ELT of data from a wide variety of data sources using SQL and AWS big data technologies
  • Develop and debug code in PySpark/Spark/Python. Strong SQL and query optimization techniques
  • Maintaining high degree of knowledge and expertise in cloud-based technologies contributing to go forward best practices, standards and patterns
  • Active participant in relevant communities of practice to exchange ideas and knowledge

What You'll Bring:
  • Eight or more years of experience in enterprise-level delivery of Data Engineering solutions.
  • Deep understanding of modern data architecture, including experience with data lakes, data warehouses, data marts, relational and dimensional modeling, data quality, and master data management.
  • Strong background in Operational Data Stores, Dimensional Modeling, and supporting application data architecture. Experience with Redshift, Snowflake, Databricks SQL, Oracle, Postgres, MySQL, and understanding of best practice architectural concepts for relational data models.
  • 8 + Years of design and implementation of ETL/ELT framework for complex warehouses/data marts.
  • Proven experience in ETL/ELT tools IDMC, DBT, AWS Glue.
  • Proficiency with languages such as Python, PySpark
  • Strong knowledge on AWS Cloud technologies.
  • Strong, demonstratable hands-on experience with data engineering and data pipelines
  • Proficient in cloud architecture and best practices, particularly with AWS Cloud tools such as Amazon RDS, Redshift, AWS DMS, AWS Glue, Amazon S3, AWS Lambda, and more.
  • Hands-on development mentality, with a willingness to troubleshoot and solve complex problems.
  • Identify, recommend, and implement ELT processes and architecture improvements.
  • Assist and verify design of solution and production of all design phase deliverables.
  • Bachelor's or Master's degree in computer science or an Engineering discipline
  • Certification in data management (structure and unstructured), and/or cloud architecture or engineering a plus
  • Certification in delivery methodologies such as Scaled Agile a plus

Pay Transparency
Salary Range: $95,000-$162,500
Overtime eligible: Exempt
Discretionary bonus eligible: Yes
Sales bonus eligible: No
Actual base salary will be determined based on several factors but not limited to individual's experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.
Company Overview
At New York Life, our 180-year legacy of purpose and integrity fuels our future. As we evolve into a more technology-, data-, and AI-enabled organization, we remain grounded in the values that drive lasting impact.
Our diverse business portfolio creates opportunities to make a difference across industries and communities-inviting bold thinking, collaborative problem-solving, and purpose-driven innovation. Here, you'll find the rare balance of long-standing stability and forward momentum, supported by an inclusive team that honors tradition while embracing progress.
As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what's next, and your growth powers it.
Our Benefits
We provide a full package of benefits for employees - and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work.Click hereto discover more about our comprehensive benefit options or visit our NYL Benefits Site.
Our Commitment to Inclusion
At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities. Click here to learn more about New York Life's leadership in this space.
Recognized as one of Fortune's World's Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.
Visit our LinkedIn to see how our employees and agents are leading the industry and impacting communities.
Visit our Newsroom to learn more about how our company is constantly evolving to meet our clients' and employees' needs.
Job Requisition ID: 92494

Top Skills

AWS
Azure
Databricks Sql
Dbt
Idmc
MySQL
Oracle
Postgres
Pyspark
Python
Redshift
Snowflake
SQL
HQ

New York Life Insurance Company New York, New York, USA Office

51 Madison Avenue, New York, NY, United States, 10010

New York Life Insurance Company Jersey City, New Jersey, USA Office

New York Life Insurance Company Jersey City, NJ Office

30 Hudson Street , Jersey City, New Jersey, United States, 07302

Similar Jobs at New York Life Insurance Company

19 Days Ago
In-Office
New York, NY, USA
121K-173K Annually
Senior level
121K-173K Annually
Senior level
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Security Data Lake Engineer will design and optimize the data lake, build data pipelines, and collaborate with security teams to enhance security analytics and machine learning capabilities.
Top Skills: Aws KinesisAws LambdaAws S3CriblElasticsearchGenerative AiJupyter NotebooksMachine LearningNatural Language ProcessingPythonScala
23 Days Ago
In-Office
New York, NY, USA
121K-173K Annually
Senior level
121K-173K Annually
Senior level
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Data Governance Engineer enhances data governance initiatives by managing metadata, governance workflows, and collaborating across teams to support data quality and compliance.
Top Skills: AtlanAws Secrets ManagerCi CdConfluenceJIRAPostgres DbPythonSharepointSQLUnity Catalog
9 Hours Ago
In-Office
New York, NY, USA
144K-206K Annually
Mid level
144K-206K Annually
Mid level
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Provide legal advice on corporate transactions, including M&A and finance, managing regulatory approvals, and drafting transaction documents.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account