CapTech Logo

CapTech

Lead Data Engineer (AWS, Azure, GCP)

Posted 21 Days Ago
Be an Early Applicant
In-Office
Chicago, IL
150K-200K Annually
Senior level
In-Office
Chicago, IL
150K-200K Annually
Senior level
Lead Data Engineer responsible for designing and implementing data pipelines using cloud technologies, mentoring teams, and ensuring high availability of data systems.
The summary above was generated by AI
Company Description

CapTech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At CapTech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time. Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Job Description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.  

The Value You Deliver (or What You’ll Do) 

  • Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions. 
  • Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.  
  • Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution. 
  • Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs. 
  • Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders. 

Qualifications

 

  • Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets 
  • 5+ years of experience delivering data engineering solutions on cloud platform 
  • 5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP) 
  • Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion) 
  • Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks 
  • 5+ years of experience with SQL or NoSQL database (PostgreSQL, MySQL, SQL server, Oracle, Aurora, Presto, BigQuery) 
  • Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs) 
  • 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell) 
  • Familiarity with one or more DevOps tools (git, Jenkins, CI/CD, Jira) 
  • Fundamental understanding of big data, open source, and data streaming concepts 
  • Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs    
  • Experience providing technical leadership and mentoring other engineers in data engineering space 
  • Cloud certification on any platform a plus  

Additional Information

We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions.  You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.  Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we’ve launched extended benefits to help meet our employees’ needs. 

  • Learning & Development – Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
  • Modern Health –A mental health and well-being platform that provides 1:1 care, group support sessions, and self-serve resources to support employees and their families through life’s ups and downs
  • Carrot Fertility –Inclusive fertility and family-forming coverage for all paths to parenthood – including adoption, surrogacy, fertility treatments, pregnancy, and more – and opportunities for employer-sponsored funds to help pay for care
  • Fringe –A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them – ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
  • Employee Resource Groups – Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
  • Philanthropic Partnerships – Opportunities to engage in partnerships and pro-bono projects that support our communities. 
  • 401(k) Matching – Generous matching and no vesting period to help you continue to build financial wellness

CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness — each foundational to our core values.  We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more information about our Diversity, Inclusion and Belonging efforts, click HERE.  As part of this commitment, CapTech will ensure that persons with disabilities are provided reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please contact Laura Massa directly via email [email protected].

CapTech supports Equal Pay for all. In addition, in the State of Illinois we are committed to Equal Pay for ALL in accordance with the Illinois Equal Pay Act. The base pay range for this role is: $150,000 - $200,000k. 

At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.  

#LI-LM1 

Top Skills

Ab Initio
Alteryx
AWS
Azure
Azure Data Factory
Ci/Cd
Data Orchestration
Databricks
ETL
GCP
Git
Informatica
Java
Jenkins
JIRA
Matillion
NoSQL
Pentaho
Python
R
Redshift
Snowflake
SQL
Ssis
Talend

Similar Jobs

An Hour Ago
Hybrid
Chicago, IL, USA
143K-235K Annually
Senior level
143K-235K Annually
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Senior Counsel, Governance & Sustainability manages corporate governance operations and advises on sustainability legal matters, ensuring compliance and mitigating risks.
Top Skills: Corporate GovernanceEsgJuris Doctor
An Hour Ago
Remote or Hybrid
United States
109K-150K Annually
Senior level
109K-150K Annually
Senior level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Senior Threat Hunting Intelligence Analyst conducts intelligence-driven threat hunts, develops detection strategies, analyzes telemetry, collaborates with engineers, and communicates findings to enhance security posture.
Top Skills: EdrMitre Att&CkPythonSIEMSoarStix/Taxii
An Hour Ago
Hybrid
Northbrook, IL, USA
25-25 Hourly
Internship
25-25 Hourly
Internship
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
The internship involves conducting job safety analyses, assisting incident investigations, creating PPE assessments, and implementing EHS training.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account