E Source Logo

E Source

Databricks Data Engineer

Reposted One Month Ago
Remote
Hiring Remotely in USA
115K-145K Annually
Senior level
Remote
Hiring Remotely in USA
115K-145K Annually
Senior level
Design, build, and maintain scalable data pipelines, lakes, and infrastructure using Databricks, Spark, Python, and AWS. Collaborate with ML engineers, data scientists, and analysts to deliver data products, ensure data quality and governance, implement DevOps/SDLC practices, mentor junior engineers, and evaluate new data technologies.
The summary above was generated by AI

E Source is seeking a Databricks Data Engineer to join the Machine Learning Engineering team. This role focuses on designing, building, and maintaining scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and software-as-a-service (SaaS) solutions.

You will work closely with machine learning engineers, software engineers, data scientists, and data analysts to deliver data products for clients and to support internal data practices.

E Source is a research, data/analytics, and technology focused professional services firm focused exclusively on the utility industry in the US and Canada. We help utilities target and serve their customers more effectively, enhance and optimize their grid, and leverage operating best practices and technologies to manage their business more effectively. Headquartered in Texas, we have 450+ employees across the US and Canada. Learn more at www.esource.com.

In this role, you will:

  • Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL

  • Collaborate with cross-functional teams to translate business requirements into technical solutions

  • Provide technical guidance and mentorship to junior data engineers

  • Develop and implement data engineering standards and best practices

  • Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability

  • Research industry trends and evaluate new data technologies

  • Build and maintain data lakes to support analytics and business intelligence

  • Manage the software development life cycle and DevOps activities

  • Partner with data scientists and analysts to deliver effective data solutions

  • Develop data validation and data analysis tools

You’re likely a great fit if you:

  • Bachelor’s degree in computer science, information technology, or a related field

  • Five or more years of experience in data engineering or a related role

  • Expert proficiency in Python, SQL, Databricks, and Spark

  • Experience building cloud-based data pipelines in AWS

  • Knowledge of data governance, security, privacy, and retention practices

  • Strong communication, collaboration, and problem-solving skills

  • Experience working in agile environments using tools such as Jira

  • Proficiency with Git, Docker, and CI tools such as Jenkins

  • Passion for data and continuous improvement

Preferred qualifications:

  • Ability to work independently and proactively

  • Experience optimizing ETL workflows in Databricks

  • Knowledge of data lineage and data quality practices

  • Experience supporting data science and machine learning solutions

  • Prior experience in the energy or utility industry

  • Master’s degree in a relevant STEM field

At E Source, you’ll work alongside people who are thoughtful, curious, and deeply knowledgeable about utility and energy systems. We value clarity over jargon, substance over flash, and collaboration over ego. You’ll have the opportunity to grow your skills, contribute to meaningful work, and help shape a company that plays a real role in how the energy future unfolds.

What you can expect:

  • Excellent insurance options, including medical, dental, and vision plans; company-paid life insurance; company-paid long- and short-term disability insurance; medical and dependent-care flexible spending plans, and paid parental leave.

  • A flexible time off (FTO) policy that provides paid time away from work, approved by your manager, while ensuring business needs, workload commitments, and appropriate coverage are maintained.

  • A 401(k)/RRSP plan with a 3% employer match.

The budgeted salary for this position is $115,000-$145,000 USD + annual bonus. Actual pay will be adjusted based on experience.

This role will be 100% remote, with infrequent travel (generally 1–2 times per year).

Applicants must be authorized to work for any employer in the US. We’re unable to sponsor or take over sponsorship of employment visas at this time.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Employees of E Source are encouraged to apply. To foster a positive work environment and company culture, we support our employees in their career growth at E Source. If you are interested in similar job opportunities in the future, visit the E Source careers page for a listing of all open positions and contact Human Resources.

We contact applicants directly via email using only our designated company email addresses with the domain of @esource.com. Please do not provide personal information to anyone over email and be wary of other accounts impersonating businesses.

#LI-Remote

Similar Jobs

2 Days Ago
Remote or Hybrid
OH, USA
Senior level
Senior level
Financial Services
Build and operate scalable Databricks-on-AWS data pipelines using PySpark, Delta Lake, and lakehouse patterns. Optimize performance, implement data quality, monitoring, alerting, and automated remediation, and deliver curated datasets for BI and analytics partners. Collaborate with stakeholders on architecture and design while applying secure software engineering, CI/CD, agile, and operational stability practices. The role also uses AI-assisted development tools and supports workforce data analytics.
Top Skills: AlteryxAmazon AthenaAmazon EmrAmazon S3Apache AirflowApache IcebergSparkAutosysAWSAws CloudwatchAws GlueAws LambdaBitbucketClaudeDatabricksDatabricks WorkflowsDelta LakeDelta Live TablesGitGithub CopilotJavaJenkinsOracleParquetPysparkPythonScalaSigmaSpinnakerSQLTableau
2 Days Ago
Remote
USA
Mid level
Mid level
Software
Designs, builds, and operates scalable batch and streaming data pipelines on Databricks for federal missions. Responsibilities include developing Spark and Delta Lake solutions, managing clusters and workflows, implementing Unity Catalog governance and security, optimizing ETL/ELT processes, integrating CI/CD, supporting machine learning and advanced analytics, monitoring data quality, and collaborating with technical teams and stakeholders.
Top Skills: Amazon EmrSparkAWSAzureCi/CdDatabricksDelta LakeGgplot2GitGCPHadoopHiveKafkaMlflowNoSQLPlotlyPysparkPythonSeabornSpark SqlSpark Structured StreamingSQLUnity Catalog
4 Days Ago
In-Office or Remote
142K-213K Annually
Senior level
142K-213K Annually
Senior level
Aerospace • Logistics • Security • Software • Cybersecurity
Designs and implements Databricks Unity Catalog access controls, security architecture, identity governance, data classification, and compliance automation. Leads RBAC and ABAC models, dynamic views, row- and column-level security, masking, service principal integration, and infrastructure-as-code deployments using Terraform or Databricks Asset Bundles. Establishes security guardrails, templates, tagging standards, and scalable workflows while partnering with data, platform, and workspace engineering teams.
Top Skills: AbacColumn MaskingDatabricksDatabricks Asset BundlesDatabricks LakehouseDatabricks Unity CatalogDynamic ViewsEntra IdInfrastructure As CodePythonRbacRow-Level SecurityScimService PrincipalsSQLTerraform

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account