Senior Data Engineer (Microsoft Fabric / Financial Data)

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

We are seeking a Senior Data Engineering (Microsoft Fabric /Financial Data) to design, develop, and support critical financial and operational data solutions that support reserving, claims, and enterprise decision-making. This role combines hands-on technical development with strong business partnership to ensure data is accurate, scalable, and aligned with financial reporting requirements.
The ideal candidate will have experience building and maintaining complex data solutions using SQL, Python, PySpark, Microsoft Fabric, or similar cloud data platforms. This individual will help automate reconciliations, improve data quality controls, reduce manual processes, and deliver reporting and analytics solutions that strengthen operational effectiveness and reduce business risk.
The Allstate internal job title for this role is Software Engineer Lead Cons.

Key Responsibilities

• Design, develop, test, deploy, and support enterprise data solutions used for financial reporting, reserving, and claims.

• Own and maintain critical data structures, transformation logic, business rules, bucketing logic, and controls within claims data.

• Develop and maintain data pipelines, transformation processes, and reporting datasets using SQL, Python, PySpark, Microsoft Fabric, or similar cloud data platforms.

• Partner with Actuarial Reserving, Accounting Operations, Product, Claims, Financial Planning and Analysis, and other business teams to understand requirements and translate them into scalable technical solutions.

• Lead and participate in end-user testing to confirm changes are implemented correctly and downstream reporting impacts are understood before production release.

• Automate reconciliations, exception monitoring, data quality checks, and control processes to improve consistency, scalability, and accuracy.

• Analyze complex business and data challenges and recommend solutions that improve reporting, decision-making, and operational efficiency.

• Review code, design, and testing work to support quality, maintainability, and development best practices.

• Provide technical guidance, coaching, and knowledge-sharing to peers and less experienced developers.

• Support production issues, investigate root causes, and implement sustainable solutions that reduce future risk.

• Identify opportunities to modernize tools, improve data governance, and introduce more efficient development practices.

Essential Qualifications

• 5  years or more of experience in data engineering, analytics engineering, application development, business intelligence development, or a related technical field. (Or Equivalent)

• 1-2 years of hands-on Microsoft Fabric experience preferred, including data engineering, data transformation, data warehousing, or analytics capabilities. (Or Equivalent)

• Equivalent experience with Azure Synapse Analytics, Databricks, Snowflake, Azure Data Factory, Redshift, BigQuery, or similar cloud data platforms will also be considered.

• Strong experience developing complex data transformation processes using SQL, Python, and/or PySpark.

• Experience designing, building, and supporting enterprise data pipelines, data models, data structures, and reporting datasets.

• Experience working with financial, claims, premium, accounting, operational, or other complex business data.

• Strong understanding of ETL/ELT development, data quality controls, reconciliation processes, and data governance concepts.

• Experience partnering directly with business stakeholders to gather requirements, clarify priorities, and deliver technical solutions.

• Strong analytical, troubleshooting, and problem-solving skills.

• Ability to manage multiple priorities and deliver high-quality solutions in a fast-paced environment.

• Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences.

Desirable Qualifications

• Experience with Microsoft Fabric Data Factory, Lakehouse, Warehouse, Power BI, or related Microsoft analytics capabilities.

• Experience within property and casualty insurance, financial services, or another highly regulated industry.

• Knowledge of reserving, claims, premium, financial reporting, accounting, or operational reporting processes.

• Experience automating reconciliations, exception reporting, data validation, and data quality monitoring.

• Experience with dashboards, automated reports, or analytics solutions using Power BI or similar reporting tools.

• Experience with Azure cloud services, DevOps practices, version control, or deployment pipelines.

• Experience leading technical initiatives or mentoring junior developers.

Why This Role Matters

This role plays an important part in ensuring the accuracy, integrity, and availability of data used for financial reporting, reserving, claims operations, and strategic decision-making. The successful candidate will help improve data controls, reduce manual work, strengthen reporting reliability, and support key enterprise initiatives through modern data engineering solutions.

Experience

• 5 or more years of experience (Preferred)

Supervisory Responsibilities

• This job does not have supervisory duties.

#LI-MF1

Skills

Azure Data Factory, Business Intelligence (BI), Data Engineering, Data Governance, Data Pipelines, Data Quality, Data Solutions, Data Structures, Data Transformation, Data Validation, Data Warehousing (DW), Enterprise Data, Extract Transform Load (ETL), Process Improvements, Python (Programming Language), Relational Data Modeling, Reporting, Structured Query Language (SQL), Technical Requirements

Compensation

Compensation offered for this role is 100,000.00 - 170,500.00 annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. One where you can shape the future of protection while supporting causes that mean the most to you. Joining our team means being part of something bigger – a winning team making a meaningful impact.

Allstate generally does not sponsor individuals for employment-based visas for this position.

Effective July 1, 2014, under Indiana House Enrolled Act (HEA) 1242, it is against public policy of the State of Indiana and a discriminatory practice for an employer to discriminate against a prospective employee on the basis of status as a veteran by refusing to employ an applicant on the basis that they are a veteran of the armed forces of the United States, a member of the Indiana National Guard or a member of a reserve component.

For jobs in San Francisco, please click “here” for information regarding the San Francisco Fair Chance Ordinance.

For jobs in Los Angeles, please click “here” for information regarding the Los Angeles Fair Chance Initiative for Hiring Ordinance.

To view the “EEO Know Your Rights” poster click “here”. This poster provides information concerning the laws and procedures for filing complaints of violations of the laws with the Office of Federal Contract Compliance Programs.

To view the FMLA poster, click “here”. This poster summarizing the major provisions of the Family and Medical Leave Act (FMLA) and telling employees how to file a complaint.

It is the Company’s policy to employ the best qualified individuals available for all jobs. Therefore, any discriminatory action taken on account of an employee’s ancestry, age, color, disability, genetic information, gender, gender identity, gender expression, sexual and reproductive health decision, marital status, medical condition, military or veteran status, national origin, race (include traits historically associated with race, including, but not limited to, hair texture and protective hairstyles), religion (including religious dress), sex, or sexual orientation that adversely affects an employee's terms or conditions of employment is prohibited. This policy applies to all aspects of the employment relationship, including, but not limited to, hiring, training, salary administration, promotion, job assignment, benefits, discipline, and separation of employment.

Allstate provides a comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse. Employees eligible to work from home also receive a monthly connectivity reimbursement to help offset internet costs.

When working from home, you must have a dedicated, private workspace free from distractions, along with appropriate desk and seating. Reliable internet is required, with minimum speeds of 50 MB download and 5 MB upload.