Brainforge Logo

Brainforge

Data Engineer

Reposted 2 Months Ago
In-Office or Remote
Hiring Remotely in NYC, NY, USA
Mid level
In-Office or Remote
Hiring Remotely in NYC, NY, USA
Mid level
Design, implement, and optimize scalable ETL pipelines and cloud data warehouses; build POCs and MVPs; collaborate with clients to gather requirements and deliver solutions; document work and communicate technical concepts; use modern data stack tools and CI/CD practices while continuously learning.
The summary above was generated by AI

Key Responsibilities

  • Data Pipeline Development:
    • Design, implement, and optimize scalable data pipelines and ETL processes to support various analytics needs.
  • Data Warehouse Management:
    • Develop and maintain robust data warehouses and analytics infrastructure on cloud platforms.
  • Client Collaboration:
    • Engage with clients to understand their data requirements and deliver customized data engineering solutions.
  • Proof-of-Concepts & MVPs:
    • Create proof-of-concepts and minimum viable products (MVPs) to test ideas and gather client feedback rapidly.
  • Documentation & Communication:
    • Write clear and comprehensive documentation.
    • Effectively communicate technical concepts to non-technical stakeholders.
  • Client Engagement:
    • Participate in client meetings, providing expertise and insights in data engineering.
  • Continuous Learning:
    • Stay abreast of the latest data engineering tools, technologies, and best practices to ensure Brainforge remains at the forefront of the industry.

Must Have Qualifications

  • Build & Own Data Systems:
    • You’ve built and maintained production-grade data pipelines using SQL, Python, and Spark
    • You use DBT as a core part of your transformation layer—not an afterthought
  • Modern Data Stack Fluency:
    • You’ve worked hands-on with at least one modern warehouse (Snowflake, BigQuery, Redshift, or Databricks) and understand how to model for it
    • You’re comfortable operating in cloud environments (AWS, GCP, or Azure)
  • Orchestration & Ingestion:
    • You’ve shipped pipelines using an orchestrator (Airflow, Dagster, or Prefect)
    • You’ve integrated data using tools like Airbyte, Fivetran, or Polytomic (or built equivalent ingestion patterns)
  • Shipping Mindset:
    • You use CI/CD tools (e.g., GitHub Actions, Terraform, or similar) to ship reliably
    • You write code that other people can read, trust, and build on

Nice to Have

  • Depth > Tools:
    • You’ve worked across multiple warehouses, orchestration, or ingestion tools—and have opinions about tradeoffs
  • Infrastructure Awareness:
    • You’re comfortable with Docker, Kubernetes, or similar infrastructure patterns
  • Data as a Product:
    • You think about data quality, governance, and reliability as first-class concerns
  • Scale & Efficiency:
    • You’ve optimized pipelines for performance, cost, and reliability in real-world environments

What We’re Looking For

  1. Innovative Prototyper: You thrive on building and iterating MVPs, turning concepts into functional products with a focus on scalability and user experience.
  2. Effective Communicator: You excel at conveying complex technical information clearly and concisely, both in writing and verbally.
  3. Passionate Builder: Your dedication to data engineering is evident through personal projects, open-source contributions, or continuous learning.
  4. Client-Centric: You enjoy engaging with clients, understanding their needs, and delivering solutions that exceed their expectations.
  5. Big Picture Thinker: You analyze data usage, comprehend competitive landscapes, and select the right metrics to drive success beyond technical implementations.
  6. Collaborative Team Member: Your positive attitude and proactive approach make you a valuable and easy-to-work-with team member.

 

About Brainforge

At Brainforge, we're on a mission to transform data into actionable insights that drive business success. As a rapidly growing data analytics consulting company, we partner with clients across various industries to deliver cutting-edge solutions that unlock the full potential of their data. Join our dynamic team and be a part of shaping the future of data analytics.

Transforming raw data into actionable insights

We help businesses boost revenue, save time, and make smarter decisions with Data and AI

Similar Jobs

8 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, enforcing security and compliance, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires extensive infrastructure and data engineering experience across cloud platforms, containers, data security, and workflow orchestration.
Top Skills: Apache AirflowApache SupersetAWSAzureCi/CdData ModelingDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
23 Days Ago
Remote or Hybrid
USA
125K-159K Annually
Mid level
125K-159K Annually
Mid level
AdTech • Automotive • Big Data • Consumer Web
Administer and enhance Edmunds’ Databricks data platform and AWS infrastructure. Build and maintain ETL pipelines, infrastructure-as-code tooling using Terraform or CDK, and operational dashboards, alerts, and reports. Collaborate with business, engineering, analytics, security, and infrastructure teams to support data platform users and AI solutions. Evaluate new technologies, troubleshoot platform issues, and improve operational, cost, and security visibility.
Top Skills: SparkAWSAws CdkDatabricksInfrastructure As Code (Iac)PythonScalaSQLTerraform
24 Days Ago
Remote or Hybrid
USA
120K-180K Annually
Senior level
120K-180K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates CrowdStrike’s data platform infrastructure and services. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and access controls, developing DBT data models, cataloging assets in OpenMetadata, writing Python automation, and mentoring engineers. The role requires cloud, container orchestration, SQL, data modeling, compliance, and AI technology expertise, along with eligibility for CJIS clearance.
Top Skills: AIApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account