EdgeQ Technologies Private Limited Logo

EdgeQ Technologies Private Limited

Data Engineer

Posted 2 Hours Ago
Be an Early Applicant
In-Office
New York, NY, USA
85K-160K Annually
Mid level
In-Office
New York, NY, USA
85K-160K Annually
Mid level
Designs and maintains scalable ETL/ELT pipelines, data warehouses, lakes, and models. Develops SQL and Python solutions, integrates diverse data sources, and uses cloud platforms and distributed processing tools. Responsibilities include data validation, quality monitoring, performance and cost optimization, troubleshooting, documentation, governance, and collaboration with data scientists, analysts, and software engineers.
The summary above was generated by AI
Data Engineer

Job Title: Data Engineer
Job Locations: Austin, TX; Dallas, TX; Seattle, WA; New York, NY; San Francisco, CA
Job Type: Full-Time
Experience Required: 2–8 Years
Work Mode: Remote / Hybrid / On-site, depending on employer
Estimated Annual Salary: $85,000–$160,000

Job Overview

We are seeking a skilled Data Engineer with 2–8 years of experience to design, develop, and maintain scalable data pipelines and data infrastructure. The ideal candidate will have strong programming skills and experience with cloud platforms, ETL/ELT processes, data warehousing, and large-scale data processing.

Key Responsibilities
  • Design, develop, and maintain scalable ETL/ELT pipelines.

  • Extract, transform, and integrate data from multiple sources.

  • Build and optimize data warehouses, data lakes, and data models.

  • Develop efficient SQL queries and Python-based data processing scripts.

  • Work with AWS, Microsoft Azure, or Google Cloud Platform.

  • Implement data validation, quality checks, and pipeline monitoring.

  • Collaborate with data scientists, analysts, and software engineering teams.

  • Optimize data processing performance, storage, and costs.

  • Troubleshoot pipeline failures and ensure data reliability.

  • Maintain technical documentation and follow data governance standards.

Required Skills
  • Strong proficiency in SQL and Python.

  • Experience with ETL/ELT development and data integration.

  • Knowledge of relational databases and data modeling.

  • Experience with Snowflake, Amazon Redshift, or Google BigQuery.

  • Familiarity with Apache Spark, Kafka, or similar technologies.

  • Understanding of cloud-based data engineering solutions.

  • Experience with Git, testing, and workflow orchestration tools.

  • Strong analytical and problem-solving abilities.

Experience & Estimated Annual Salary

ExperienceEstimated Annual Salary2–3 Years$85,000–$105,0003–5 Years$100,000–$130,0005–8 Years$125,000–$160,000

Salary estimates vary by location, employer, industry, and technical expertise.

Educational Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field preferred.

  • Equivalent professional experience and relevant technical certifications may be considered.

Preferred Qualifications
  • Experience with AWS Glue, Azure Data Factory, or Google Cloud Dataflow.

  • Familiarity with Apache Airflow, Databricks, or Delta Lake.

  • Knowledge of Docker, CI/CD pipelines, and automated testing.

  • Understanding of data security, privacy, and governance practices.

Benefits
  • Competitive salary and performance-based incentives.

  • Health, dental, and vision insurance, where offered.

  • Paid time off and company holidays.

  • Professional development and certification opportunities.

  • Opportunities to work with modern cloud and data technologies.

How to Apply

Interested candidates can submit their updated resume, highlighting relevant data engineering experience, technical skills, certifications, and project work.

Equal Opportunity Statement: We welcome qualified applicants from diverse backgrounds. Candidates must meet the applicable US work authorization requirements for the position.

Similar Jobs

Yesterday
Hybrid
Senior level
Senior level
Financial Services
Develop scalable data pipelines, analytics solutions, and full-stack applications using Java or Python, AWS, Databricks, and Spark. Analyze large datasets, design cloud-native architectures, collaborate cross-functionally, and explore Agentic AI and AI-assisted development tools.
Top Skills: Agentic AiSparkAWSDatabricksETLGenerative AiJavaPythonSQL
7 Days Ago
Hybrid
New York, NY, USA
209K-286K Annually
Senior level
209K-286K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Designs, builds, and operates scalable, resilient cloud data platforms and pipelines. Leads large-scale data initiatives, makes architectural decisions, evaluates technologies such as Snowflake and Databricks, and develops solutions using distributed data systems, relational and NoSQL databases, and cloud platforms. Collaborates with product and engineering teams, establishes reusable design patterns, communicates technical concepts, and mentors data engineers, analysts, and scientists.
Top Skills: AirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloNosql DatabasesPythonRedshiftRelational DatabasesScalaSnowflakeSparkSplunkSQL
7 Days Ago
Hybrid
New York, NY, USA
179K-246K Annually
Mid level
179K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Design, build, and support scalable cloud data platforms, pipelines, and applications. Develop distributed data solutions using Python, Spark, SQL, Databricks, Snowflake, and relational and NoSQL databases. Architect reusable engineering patterns, improve resilience and operational efficiency, enforce data security, and support real-time workloads. Collaborate with Agile teams, product managers, engineers, analysts, and data scientists while mentoring peers and communicating technical outcomes to stakeholders.
Top Skills: AirflowAWSCassandraDagsterDatabricksDynamoDBEmrGlueGCPJavaAzureMongoDBMonte CarloPythonRedshiftScalaSnowflakeSparkSplunkSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account