SunnyData Logo

SunnyData

Senior Data Engineer

Posted 11 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Design, build, deploy, and operationalize scalable data engineering solutions for customers. Responsibilities include developing pipelines, transforming and cleansing data, analyzing sources, implementing governance, security, and quality practices, testing data movement and transformation code, resolving defects and incidents, and advising customers on technical decisions. The role also supports AI, machine learning, business intelligence, and data product adoption while collaborating across teams and educating end users.
The summary above was generated by AI

At SunnyData, our mission is to help customers build a highly scalable architecture, robust data engineering pipelines, easy data consumption layers and more importantly build ML and AI applications to power their business and drive outstanding business outcomes. As a Senior Data Engineer, you will play a critical role during this customer journey. You will directly work with internal teams and customers to design, build and deploy data solutions that capture, explore, transform, and utilize data to support Artificial Intelligence, Machine Learning and business intelligence / insights.

The Impact You Will Have

  • You will be part of a team responsible for supporting new and existing customers in their data engineering needs.

  • You will guide customers to make the best technical decisions to achieve their goals

  • You will actively work across multiple customer accounts which you would need to track and report on their progress.

  • You will design, build, and operationalize complex data solutions, correct problems, apply transformations, and recommend data cleansing /quality solutions.

  • You will analyze sources to determine value and recommend data to include in analytical processes.

  • You will incorporate core data management competencies including data governance, data security and data quality.

  • You will collaborate within and across teams to support delivery and educate end users on data products / analytic environments.

  • You will perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate.

  • You will test data movement, transformation code, and data components.

What We Look For

  • 5+ years of related experience in data engineering and data product development.

  • Experience in one or more of the following:

    • Data Engineering technologies (e.g., Spark, Hadoop, Kafka)

    • Databricks platform - data engineering and/or ML ops experience would be a huge bonus

    • Data Science and Machine Learning technologies (e.g., pandas, scikit-learn, HPO)

    • Data Warehousing (e.g., SQL, OLTP/OLAP/DSS)

  • Solid understanding of the end to end data analytics workflow

  • Demonstrated track record of domain expertise including the ability to understand technical concepts and possess in-depth knowledge of immediate systems worked on

  • Proven problem solving skills including debugging skills

  • Strong verbal and written communication skills

  • Leadership - Intermediate leadership skills with a proven track record of self-motivation in identifying personal growth opportunities

  • Excellent time management and prioritization skills Knowledge of public cloud platforms AWS, Azure or GCP would be a plus

  • Nice to have: Databricks Certification

Education

  • Bachelor’s Degree in STEM related field or equivalent

Benefits

  • Health Insurance : Employees and their eligible family members including spouses, domestic partners, and children are eligible for coverage from the first day of employment.

  • Paid Time Off : Start your career at SunnyData with a minimum of 15 days Paid Time Off annually, plus nine paid company Holidays.

  • An opportunity to grow your technical and people skills, lead teams on complex customer projects that are highly innovative and cutting edge. Great opportunity to grow in your career with the right level of focus, innovation and customer centricity with a high growth consulting company dedicated to Databricks.

Compensation Overview

The annual base salary range provided for this position is a nationwide market range and represents a broad range of salaries for this role across the country. The actual salary for this position will be determined by a number of factors, including the scope, complexity and location of the role; the skills, education, training, credentials and experience of the candidate; and other conditions of employment. As part of our comprehensive compensation and benefits program, employees are also eligible for performance-based cash incentive awards.

Our Commitment to Diversity and Inclusion:

SunnyData is dedicated to building a workforce that reflects the world around us. We are an equal opportunity employer committed to unbiased hiring practices. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity, disability, veteran status, or any other protected characteristic.

Why Join SunnyData?

  • Innovative Environment: Work with cutting-edge technologies and industry leaders in data engineering and AI.

  • Customer Impact: Make a real difference in how businesses leverage data for strategic decision-making.

  • Career Growth: Opportunities for professional development and career advancement.

  • Collaborative Culture: Join a supportive team that values collaboration and knowledge sharing.

If you are passionate about data engineering and enjoy engaging with clients to solve their most challenging problems, we would love to hear from you. Apply today and become a key player in SunnyData's success story.

Similar Jobs

Yesterday
Easy Apply
Remote
United States
Easy Apply
140K-175K Annually
Senior level
140K-175K Annually
Senior level
Fintech • Insurance • Machine Learning • Analytics • Financial Services • Automation
Build and maintain production data pipelines, Airflow DAGs, Snowflake infrastructure, and Data Vault 2.0 models. Ensure data quality, observability, security, governance, reliability, and cost efficiency through automated testing and CI/CD. Lead technical projects end-to-end, collaborate with stakeholders, and support SOX-relevant reporting while developing expertise in commercial insurance data and processes.
Top Skills: Apache AirflowBigQueryCi/CdClaude CodeCursorData Vault 2.0PythonRedshiftSnowflakeSnowflake CortexSQL
4 Days Ago
Remote or Hybrid
3 Locations
110K-205K Annually
Senior level
110K-205K Annually
Senior level
Fintech • Financial Services
Designs and develops complex cloud-native data solutions, scalable batch and real-time pipelines, APIs, data models, and enterprise data platforms. Implements data governance, quality, lineage, security, observability, CI/CD, automated testing, and operational reporting capabilities. Collaborates with architects, product owners, analysts, governance, security, and platform teams on technology strategy and cloud modernization. Mentors engineers, leads technical design discussions, presents recommendations, and supports AI-ready data products and emerging development tools.
Top Skills: Ai FoundryAlationApache AirflowApi ManagementAWSAzureAzure Ai SearchAzure Container AppsAzure Data FactoryAzure DatabricksAzure DevopsAzure FunctionsAzure OpenaiAzure PurviewAzure SqlAzure StorageBigQueryCi/CdCollibraCopilot StudioCosmos DbEltErwinETLEvent HubsGCPGitGit FlowGitGithub CopilotInformatica MdmInfosphereJavaMcpMicrosoft FabricPythonScalaSnowflakeSQLTrunk-Based Development
2 Days Ago
Remote or Hybrid
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Develop and automate tests for ETL pipelines, validating data records, content, metadata, and schema alignment. Integrate data tests into CI/CD workflows using GitHub Actions, and create release test suites to monitor performance and memory degradation. Analyze edge cases, investigate pipeline issues, and log defects while working with Databricks, Python, SQL, and ETL orchestration tools.
Top Skills: AirflowAzure Data FactoryCi/CdDatabricksETLGithub ActionsPythonSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account