Designs, develops, and maintains large-scale data processing systems, including ETL processes, data models, scalable pipelines, databases, data warehouses, and cloud-based big data solutions. Uses Snowflake, Fivetran, dbt, and Airflow while applying DevOps and security practices. Optimizes distributed processing and storage systems, collaborates with data scientists and analysts, and mentors junior engineers.
This is a remote role that begins with an in-person onboarding experience at our corporate office in Providence, RI to establish strong connections and set the foundation for success. During this time, new team members will learn our systems and processes while building relationships with colleagues. We also expect team members to be onsite a few times per year for team building and key project kickoffs. Travel expenses are fully covered by AAA Northeast.
At AAA Northeast, how we work together matters. We are a highly collaborative organization that values connection, transparency, and trust. Our “cameras on” approach during virtual meetings reflects our expectation that team members are present, engaged, and actively participating, helping to build strong working relationships and a sense of shared accountability, no matter where we’re located.
Big Data Engineer III is responsible for designing, developing, and maintaining large-scale data processing systems. This role includes building and optimizing data pipelines and ETL processes, designing and maintaining data models and architectures, and conducting performance tuning and optimization of data processing systems. Collaboration with data scientists and analysts is essential to deliver actionable insights.
What you will do:
- Data Engineering: Architect and optimize ETL processes for complex data requirements. Design advanced data models to support sophisticated data processing needs. Design and manage robust, scalable data pipelines.
- Database Management: Oversee the management and optimization of databases. Utilize advanced SQL techniques for complex data operations. Oversee the implementation and management of NoSQL databases. Architect and manage data warehousing solutions.
- Big Data and Cloud Technologies: Lead the implementation and optimization of big data technologies. Manage and optimize distributed computing resources for large-scale data processing. Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow. Utilize cloud platforms for scalable data processing and storage.
- DevOps and Security: Apply DevOps practices to automate and streamline data engineering workflows. Implement containerization solutions for data processing jobs. Implement data security measures to protect sensitive information. Optimize the performance of data processing and storage systems.
- Leadership: Mentor and guide junior engineers, fostering a collaborative and innovative work environment.
Education
- Bachelor's Degree Computer science, Information Technology, Engineering, or a related field. required or
- 6-8 years of additional relevant experience required
- Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred
Experience
- 5+ years Experience in data engineering or a related field required
Licenses and Certifications
- While not required, there are a variety of certifications that prove skillset (Big data certs, Azure cloud certs, Snowflake certs)
AAA Northeast is proud of our diverse culture, fostered by the many talents, skills, passions, and expertise of our employees. We are an equal opportunity employer. We do not discriminate in recruiting, hiring, or promotion based on race, color, creed or religion, national origin, sex, age, sexual orientation, veteran’s status, gender identity or expression, disability, genetic information, marital status, pregnancy, or membership in any other protected class. We thrive when our team members bring their whole selves to work.
Similar Jobs
Information Technology
Leads a managed services engineering team responsible for AIX, Unix, and Linux service delivery. Oversees customer satisfaction, SLA performance, staffing, workload allocation, process improvement, operational procedures, budgets, vendor relationships, and technical service optimization. Manages customer reviews, support escalations, performance management, hiring, on-call schedules, and continuous service improvement while coordinating strategic and tactical technology plans across internal teams and partners.
Top Skills:
Capacity PlanningCiscoClusteringDellHigh AvailabilityHpHp-UxIbmIbm AixItilLinuxMicrosoftPatchingPerformance TuningRed Hat Enterprise LinuxSolarisStorage IntegrationSuse Linux Enterprise ServerUbuntuUnixVirtualizationVMwareWorkload Automation
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Manage the insurance tax team, assist in client relationships and business development, oversee tax compliance, and support tax strategies.
Top Skills:
AccountingInsurance TaxTax Compliance
Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Leads end-to-end quality assurance for Workday implementations, upgrades, and enhancements. Defines testing strategies, plans, frameworks, and risk mitigation; oversees functional, integration, regression, and UAT testing across Workday modules. Manages defects, test data, environments, release validation, reporting, and stakeholder sign-off. Coordinates QA activities among business teams, developers, system integrators, vendors, and delivery partners while ensuring adherence to quality standards and governance.
Top Skills:
Azure DevopsErpJIRAWorkday
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
