Design, build, and operate scalable Spark-based ETL/ELT pipelines and data platforms on AWS. Manage end-to-end data lifecycle, ensure data quality and observability, optimize performance and costs, enforce CI/CD and IaC best practices, and collaborate with stakeholders to deliver production-grade analytics solutions.
FocusKPI is looking for a Data Engineer to join our client's growing team and spearhead analyses, providing meaningful insights into their users and product.
Work Location: 100% remote and ideally able to work New York EST hours
Duration: 5 months/ 40 hrs per week
Pay Range: $45 - $55/hr
**No C2C resumes are considered**
Responsibilities:
**No C2C resumes are considered**
Work Location: 100% remote and ideally able to work New York EST hours
Duration: 5 months/ 40 hrs per week
Pay Range: $45 - $55/hr
**No C2C resumes are considered**
Responsibilities:
- Architect and scale modern data platforms on AWS — Design and build robust, scalable Spark-based ETL/ELT pipelines and data workflows supporting batch and real-time use cases.
- Own end-to-end data lifecycle management — From ingestion and transformation to modeling, orchestration, and serving layers.
- Ensure data quality, governance, and reliability — Implement testing frameworks, observability, monitoring, lineage, and data validation practices.
- Drive platform optimization and cost efficiency — Continuously improve performance, scalability, and cloud cost management across the data ecosystem.
- Establish engineering best practices — CI/CD, Infrastructure as Code, code reviews, documentation standards, and secure data handling.
- Partner cross-functionally with technical and business stakeholders to translate data needs into reliable, production-grade solutions
- Bachelor’s degree in the Computer field, which requires logical, creative thinking, STEM majors, MS degree preferred
- 5+ years of industry experience are required
- Team's Tech Stack: Spark, Scala, Python, DBT, Airflow, Kafka, AWS EMR, Hive, Redshift, Docker, Lambda, SNS, SQS, S3, Looker, DynamoDB, GitHub Actions, Terraform
- Experience with data models
- Experience with CI/CD
- Experience collaborating with and understanding the needs of stakeholders from a variety of business functions, including product, marketing, finance, and so on
- Experience in handling large-scale data with efficiency
- Strong analytical and problem-solving skills
- Experience in Financial Services or FinTech preferred
**No C2C resumes are considered**
Thank you!
FocusKPI Hiring Team
Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Senior Data Engineer on PwC's Managed Data, Analytics & Insights team to design, build and manage advanced data ecosystems. Responsibilities include designing data solutions and scalable pipelines, solving complex problems, mentoring junior staff, maintaining high delivery standards, and building client relationships while aligning solutions to business context.
Top Skills:
DatabricksKafka
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead design and implementation of data infrastructure, pipelines, and integrations using cloud platforms. Manage teams and client accounts, ensure data quality, security, and compliance, deploy scalable solutions (Databricks, Snowflake), mentor junior staff, and identify data-driven business opportunities.
Top Skills:
Amazon Web Services (Aws)Azure Data FactoryDatabricksSnowflake
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop data lakes/warehouses, ensure data quality and security, apply data modeling and DAGs, use Databricks, Airflow, and Hadoop, and collaborate with clients to deliver actionable insights.
Top Skills:
Apache AirflowApache HadoopAWSAzure Data FactoryDagsData LakeData WarehouseDatabricksDimensional ModelingAzure
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
