AgileEngine Logo

AgileEngine

Senior Data Engineer ID71671

Sorry, this job was removed at 02:19 p.m. (EST) on Thursday, Aug 20, 2026
Be an Early Applicant
In-Office
New York, NY, USA
Senior level
In-Office
New York, NY, USA
Senior level

Similar Jobs

An Hour Ago
Hybrid
Senior level
Senior level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Leads complex electrical engineering certification projects from scope definition through testing, compliance review, reporting, and client delivery. Determines test programs, develops requirements and specialized methods, coordinates laboratory and field activities, resolves technical issues, and manages project timelines and costs. Provides technical guidance to clients and staff, reviews work, trains engineers, supports continuous improvement, and may represent UL at technical industry events. Frequent travel to client sites may be required.
Top Skills: MS OfficeUl Standards And Certification Processes
2 Hours Ago
Remote or Hybrid
United States
60K-101K Annually
Mid level
60K-101K Annually
Mid level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Manage assigned client accounts to ensure satisfaction and renewals. Coach clients on SailPoint/IdentityIQ identity and access solutions, monitor usage and risks, provide strategic updates, identify expansion opportunities, and drive resolutions to customer issues.
Top Skills: IdentityiqSailpoint
2 Hours Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
120K-150K Annually
Senior level
120K-150K Annually
Senior level
Artificial Intelligence • Cloud • Security • Software • Cybersecurity
Leads legal operations programs that scale the global legal team. Responsibilities include managing major initiatives, designing technical architectures, building workflow automations and integrations, developing internal tools, connecting legal systems with company platforms, enforcing standard procedures, resolving escalated issues, and guiding analysts on configuration and automation work.
Top Skills: APIsData PipelinesProgram Management ToolsScriptsSystem IntegrationsTechnical ArchitectureWebhooksWorkflow Automation
Architect and build scalable ETL/ELT pipelines, optimize Snowflake schemas, integrate REST APIs and streaming sources, maintain orchestration (Airflow/Prefect/Dagster), implement data quality, lineage and observability, and apply DataOps practices including CI/CD, Docker, testing, and IaC patterns.
The summary above was generated by AI
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE
We are looking for a Senior Data Engineer to architect, build, and scale a modern data platform — designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices. You will orchestrate workflows using Airflow, Prefect, or Dagster, implement data quality and lineage frameworks, integrate third-party REST APIs and event-driven sources, and apply software engineering standards including CI/CD, Docker, and automated testing to data repositories. The role prioritizes clean, well-tested Python code and a deep commitment to data reliability and accessibility.

WHAT YOU WILL DO
- Data Pipeline Development: Design, build, and maintain reliable, scalable ETL/ELT workflows that process batch and streaming data from diverse sources.
- Data Warehousing & Modeling: Design efficient, production-ready schemas (normalized and denormalized) in Snowflake to optimize query performance and enable enterprise analytics.
- API & Event Integration: Connect and ingest data from third-party REST APIs, event-driven streams, and batch sources into core data storage platforms.
- Orchestration: Maintain and expand workflow orchestration pipelines using modern tools (Airflow, Prefect, or Dagster).
- Data Quality & Observability: Implement automated testing, validation, lineage tracking, and proactive alerting frameworks to guarantee data accuracy and system uptime.
- DataOps & Engineering Standards: Drive CI/CD best practices, maintain code bases using Git and Docker, and adopt basic Infrastructure-as-Code (IaC) patterns.
- Code Excellence: Apply modern software engineering standards—including design patterns, automated unit/integration testing, and clear documentation—to data repositories.

MUST HAVES
- You must be authorized to work for ANY employer in the US (e.g., Green card holders, TN visa holders, GC EAD, H4 EAD, U4U with EAD), as we are unable to sponsor or take over employment visa sponsorship at this time;
- 4+ years of experience as a Data Engineer.
- Core Python Fundamentals: Demonstrable expertise writing modular, maintainable, and well-tested Python code (OOP/functional patterns, package management, standard testing frameworks).
- Advanced SQL & Modeling: Deep knowledge of complex SQL queries, query optimization, database design principles, and normalization/denormalization patterns.
- Data Warehousing: Solid, hands-on experience building, managing, and optimizing data architectures within Snowflake.
- Workflow Orchestration: Production experience using workflow orchestration engines like Apache Airflow, Prefect, or Dagster.
- Integrations & Ingestion: Hands-on experience working with REST APIs, event-driven architectures, and both batch and streaming pipelines.
- Data Quality & Lineage: Experience building automated data quality checks, data lineage, and alerting mechanisms (e.g., using tools like dbt test, Great Expectations, or similar).
- DevOps / DataOps Practices: Strong skills in version control (Git), containerization (Docker), CI/CD automation, and familiarity with Infrastructure-as-Code basics.
- Upper-intermediate English level.

NICE TO HAVES
- Experience with dbt (data build tool) for data transformations.
- Familiarity with major cloud providers (AWS, GCP, or Azure).
- Exposure to message streaming tech like Apache Kafka or AWS Kinesis.

PERKS AND BENEFITS
- Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support: access local well-being programs and people-focused support tailored to your location

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account