NYC Parks Arsenal West Logo

NYC Parks Arsenal West

Data Engineer

Posted One Month Ago
In-Office
New York, NY, USA
120K-140K Annually
Mid level
In-Office
New York, NY, USA
120K-140K Annually
Mid level
Design, build, and maintain data models, ETL pipelines, and SQL-based solutions to support reporting and analytics. Analyze source systems for data quality, develop data integration using Databricks/Informatica/Pentaho, and produce documentation, dashboards, and BI artifacts (Power BI/OBIEE/Tableau) to support DSNY operations.
The summary above was generated by AI
Job Description

The New York City Department of Sanitation (DSNY) keeps New York City healthy, safe, and clean by collecting, recycling, and disposing of waste, cleaning City streets and vacant lots, and clearing snow and ice. DSNY is the nation's largest municipal sanitation agency, with nearly 10,000 employees, 59 district garages, and a fleet of more than 5,000 trucks, cars, and other types of equipment. The Department clears litter, snow, and ice from approximately 6,500 miles of City streets and removes debris from vacant lots as well as abandoned vehicles from City streets.
Under general supervision, with considerable latitude for the exercise of independent judgment and initiative, the incumbent will be responsible for the design, development, implementation, enhancement, documentation, and maintenance of database management systems, data integration solutions, custom applications, and related software functions supporting the Department of Sanitation's Operations Management Division (OMD).
The selected candidate will serve as a Data Engineer, performing complex data engineering, data integration, and analytical functions within a multi-platform enterprise environment. The role will support critical reporting, analytics, and operational initiatives across the DSNY Operations Management project portfolio.
Key Responsibilities:
- Perform data analysis, data profiling, data modeling, source-to-target mapping, and reporting activities for enterprise data and analytics projects.
- Develop and maintain conceptual, logical, and physical data models to support current and future operational, analytical, and reporting requirements.
- Analyze legacy and strategic source systems to assess data quality, identify inconsistencies, and recommend corrective actions to improve data integrity and governance.
- Collaborate with business stakeholders, technical teams, and external partners to design, develop, and support complex data integration pipelines using ETL tools such as Databricks, Informatica PowerCenter, Pentaho Data Integration (Kettle), and similar technologies.
- Develop, maintain, and enhance technical documentation, including data models, data dictionaries, source-to-target mapping documents, ETL specifications, process flows, and reporting artifacts.
- Develop and maintain SQL-based data solutions, including complex queries, stored procedures, database objects, and data transformation processes.
- Support business intelligence and reporting initiatives through the development of reports, dashboards, and analytical solutions utilizing platforms such as Oracle Business Intelligence Enterprise Edition (OBIEE), Power BI, and other enterprise reporting tools.
- Participate in the design and implementation of innovative data architecture and integration strategies to improve data sharing and interoperability across multiple business domains within DSNY and across City agencies.
- Support and maintain internal IT systems, applications, and databases, ensuring reliability, performance, and adherence to agency standards.
Required Qualifications:
- Strong proficiency in SQL and Python programming. Additional experience with pySpark preferred.
- Experience with data modeling, data analysis, ETL development, and database design.
- Experience with enterprise reporting and analytics platforms such as Power BI, OBIEE, Tableau, or similar tools.
- Knowledge of modern data platforms and cloud-based analytics environments; experience with Databricks is highly desirable.
Preferred Qualifications:
- Experience with Microsoft .NET technologies, including ASP.NET, C#, TypeScript, React or other modern web application framework.
- Experience with Java development and related technologies.
- Familiarity with data warehousing, data governance, cloud platforms, and enterprise data integration best practices.
-The ideal candidate will possess strong analytical and problem-solving skills, excellent communication abilities, and the capacity to work effectively with
IT INFRASTRUCTURE ENGINEER - 95714

Qualifications

1. A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
2. A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering; or,
3. Education and/or experience which is equivalent to "1" or "2" above.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.

Similar Jobs

5 Hours Ago
Easy Apply
Remote or Hybrid
United States
Easy Apply
140K-160K Annually
Senior level
140K-160K Annually
Senior level
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
Build, deploy, and operate production-grade data pipelines and data products for healthcare audiences. Design transformations, data models, and governed views using Python, SQL, Airflow, S3, Snowflake, and EMR. Implement data-quality, monitoring, and privacy-by-design controls for PHI/PII. Partner with product, analytics, and platform teams to onboard sources, support audience discovery, segmentation, activation, measurement, and troubleshoot production issues.
Top Skills: Amazon EmrAmazon S3Apache AirflowAthenaHivePythonSnowflakeSQL
2 Days Ago
Remote or Hybrid
USA
195K-290K Annually
Senior level
195K-290K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead design, build, and deploy of large-scale data platforms for LLMs, RAG, and agentic AI systems. Hands-on coding, architecting fault-tolerant pipelines, establishing MLOps/DataOps best practices, mentoring engineers, and operationalizing research into production across Exabyte-scale distributed systems.
Top Skills: AirflowAWSBigQueryDaskDevsecopsDockerFlinkGCPGoJvmKafkaKubeflowKubernetesLangchainLlamaindexLlmsMlflowOciPulsarPythonRetrieval-Augmented Generation (Rag)RustSagemakerSnowflakeSparkVertex Ai
3 Days Ago
Easy Apply
Hybrid
New York, NY, USA
Easy Apply
150K-225K Annually
Senior level
150K-225K Annually
Senior level
Fintech • Software • Financial Services
Build scalable data solutions and reconciliations to automate Compliance & Finance regulatory processes. Partner with stakeholders to translate requirements into designs, lead technical development, review code, and evolve standards for data pipelines and reporting.
Top Skills: ArgoCi/CdDockerKubernetesMetaplanePythonRest ApisRetoolSnowflakeSQL

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account