The Data Engineer is responsible for designing and developing cloud-native data pipelines, integrating machine learning models, and ensuring the reliability and scalability of data solutions in a collaborative environment.
Role: Data Engineer
Location: New York, NY
Type: Full Time - Contract
About the Role:
We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms. The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache Beam, along with strong knowledge of SQL and data warehousing concepts.
In this role, you will design and develop cloud-native data pipelines on Google Cloud, enabling reliable data processing and integration of machine learning models. You will work closely with data scientists, engineers, and cross-functional teams to build and expand our enterprise data platform while ensuring high performance, scalability, and reliability of data solutions.
The position requires strong collaboration skills, experience working in agile development environments, and familiarity with CI/CD practices, cloud infrastructure, and modern data engineering tools.
Responsibilities
- Use the latest technology to build data pipelines and integrate machine learning models
- Build and expand our data platform
- Develop applications that run on a Google Cloud-based infrastructure.
Qualifications
- 2+ years of experience in Big Data and Data Engineering, building enterprise-level applications in a public cloud, preferably Google Cloud
- Experience building cloud-native data pipelines using Python, Apache Airflow, Apache Spark, and Apache Beam.
- Working knowledge of SQL and data warehousing concepts, including PostgreSQL and BigQuery.
- Optionally, knowledge of Mongo and AlloyDB is a plus.
- Comfortable using Azure DevOps or similar CI/CD tools, Git.
- Experience with TDD, agile software development processes, and collaborating in multi-functional agile teams.
- Communicate effectively with technical teams and non-technical stakeholders.
- Bachelor's degree in Computer Science or related engineering discipline, or equivalent combination of education and experience.
- Optionally, experience building Docker images and deploying them to a Production environment. Integrate Docker container orchestration framework using Kubernetes by creating pods, config Maps, and deployments using Terraform.
- Optionally, experience with C#, .NET core, and microservices
About TechBlocks
TechBlocks is a global digital product engineering company with 16+ years of experience helping Fortune 500 enterprises and high-growth brands accelerate innovation, modernize technology, and drive digital transformation. From cloud solutions and data engineering to experience design and platform modernization, we help businesses solve complex challenges and unlock new growth opportunities.
At TechBlocks, we believe technology is only as powerful as the people behind it. We foster a culture of collaboration, creativity, and continuous learning, where big ideas turn into real impact. Whether you're building seamless digital experiences, optimizing enterprise platforms, or tackling complex integrations, you'll be part of a dynamic, fast-moving team that values innovation and ownership.
Join us and shape the future of digital transformation.
TechBlocks New York, New York, USA Office
165 Broadway, 23rd Floor, New York, City ,, New York, New York, United States, 10006
Similar Jobs
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Own and modernize Upside s analytics data platform: migrate pipelines, reduce cost, improve governance, design reusable modeling/orchestration patterns, deliver domain-critical data products, lead cross-functional initiatives, mentor engineers, and support ML and product teams.
Top Skills:
AWSCi/CdDagsterDatabricksDbtSnowflakeTerraform
Artificial Intelligence • Cloud • Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Design, build, and optimize SQL and NoSQL database solutions (PostgreSQL, Elasticsearch, DynamoDB). Develop stored procedures, functions, triggers, and complex queries. Implement CDC and AWS DMS, manage platform via GitHub/CI-CD and Terraform, monitor and tune performance, participate in Level 3 on-call, and collaborate with analysts, architects, and developers to deliver scalable data services.
Top Skills:
AWSAws MskChange Data Capture (Cdc)Ci/CdDms (Aws Database Migration Service)DynamoDBElasticsearchGitNoSQLPostgresSQLTerraform
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Design and build data infrastructure, pipelines, and integration solutions using cloud and big-data tools. Develop data lakes/warehouses, ensure data quality and security, apply data modeling and DAGs, use Databricks, Airflow, and Hadoop, and collaborate with clients to deliver actionable insights.
Top Skills:
Apache AirflowApache HadoopAWSAzure Data FactoryDagsData LakeData WarehouseDatabricksDimensional ModelingAzure
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
