Design, build, and scale Spark-based ETL/ELT pipelines and AWS data platforms. Own end-to-end data lifecycle, ensure data quality and governance, optimize performance and cost, implement CI/CD and IaC best practices, and partner with cross-functional stakeholders to deliver production-grade data solutions.
FocusKPI is looking for a Data Engineer to join our client's growing team and spearhead analyses, providing meaningful insights into their users and product.
Work Location: 100% remote and ideally able to work New York EST hours
Duration: 4 months/ 40 hrs per week
Pay Range: $45 - $55/hr
**No C2C resumes are considered**
Responsibilities:
**No C2C resumes are considered**
Work Location: 100% remote and ideally able to work New York EST hours
Duration: 4 months/ 40 hrs per week
Pay Range: $45 - $55/hr
**No C2C resumes are considered**
Responsibilities:
- Architect and scale modern data platforms on AWS — Design and build robust, scalable Spark-based ETL/ELT pipelines and data workflows supporting batch and real-time use cases.
- Own end-to-end data lifecycle management — From ingestion and transformation to modeling, orchestration, and serving layers.
- Ensure data quality, governance, and reliability — Implement testing frameworks, observability, monitoring, lineage, and data validation practices.
- Drive platform optimization and cost efficiency — Continuously improve performance, scalability, and cloud cost management across the data ecosystem.
- Establish engineering best practices — CI/CD, Infrastructure as Code, code reviews, documentation standards, and secure data handling.
- Partner cross-functionally with technical and business stakeholders to translate data needs into reliable, production-grade solutions
- Bachelor’s degree in the Computer field, which requires logical, creative thinking, STEM majors, MS degree preferred
- 5+ years of industry experience are required
- Team's Tech Stack: Spark, Scala, Python, DBT, Airflow, Kafka, AWS EMR, Hive, Redshift, Docker, Lambda, SNS, SQS, S3, Looker, DynamoDB, GitHub Actions, Terraform
- Experience with data models
- Experience with CI/CD
- Experience collaborating with and understanding the needs of stakeholders from a variety of business functions, including product, marketing, finance, and so on
- Experience in handling large-scale data with efficiency
- Strong analytical and problem-solving skills
- Experience in Financial Services or FinTech preferred
**No C2C resumes are considered**
Thank you!
FocusKPI Hiring Team
Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead data governance and cybersecurity initiatives to protect sensitive data, perform risk assessments and security audits, develop data governance frameworks, use Azure Data Factory for data architecture and flows, manage client engagements, mentor staff, and ensure compliance with security and privacy standards.
Top Skills:
Azure Data Factory
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Own and modernize Upside s analytics data platform: migrate pipelines, reduce cost, improve governance, design reusable modeling/orchestration patterns, deliver domain-critical data products, lead cross-functional initiatives, mentor engineers, and support ML and product teams.
Top Skills:
AWSCi/CdDagsterDatabricksDbtSnowflakeTerraform
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Design, build, and optimize SQL and NoSQL database solutions (PostgreSQL, Elasticsearch, DynamoDB). Develop stored procedures, functions, triggers, and complex queries. Implement CDC and AWS DMS, manage platform via GitHub/CI-CD and Terraform, monitor and tune performance, participate in Level 3 on-call, and collaborate with analysts, architects, and developers to deliver scalable data services.
Top Skills:
AWSAws MskChange Data Capture (Cdc)Ci/CdDms (Aws Database Migration Service)DynamoDBElasticsearchGitNoSQLPostgresSQLTerraform
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
