Design, build, and maintain scalable ETL/ELT data pipelines on Databricks and AWS S3; manage large geospatial and temporal datasets; productionize ML models; implement data validation, testing, and monitoring; optimize storage and processing; document workflows; collaborate cross-functionally.
About Urban SDK
Urban SDK is shaping the Future of Smart Cities. We are pioneers in geospatial AI technology, providing public leaders with insights and automation for mission-critical decisions. We equip critical public services with geospatial AI, enabling precise, data-driven decisions with efficiency and confidence.
Our Commitment to PeopleWe are committed to aligning business growth with professional outcomes for every employee. Our commitment has been recognized by Jacksonville Business Journal and Will Reed as a noted Best Places to Work.
About the role
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial traffic analytics applications. The ideal candidate will have experience with Python, Databricks, S3, and modern data engineering practices, including automated testing, CI/CD, and data quality monitoring.
Responsibilities
- Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks and cloud platforms.
- Manage large-scale geospatial and temporal datasets stored in AWS S3.
- Collaborate with data scientists to productionize machine learning models and ensure smooth data availability.
- Implement data validation, testing, and monitoring frameworks to ensure data accuracy, consistency, and reliability.
- Optimize data storage and processing strategies to handle high volumes of traffic and mobility data efficiently.
- Develop and maintain documentation for data workflows, architecture, and processes.
- Work closely with cross-functional teams to understand data requirements and ensure timely delivery.
- Stay up-to-date with the latest trends and best practices in data engineering, cloud technologies, and big data processing.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- 3+ years of experience as a data engineer or in a similar role.
- Strong proficiency in Python and associated libraries for data engineering (pandas, PySpark, etc.).
- Hands-on experience with Databricks and Spark for large-scale data processing.
- Experience with AWS services, especially S3, and knowledge of cloud-based data architectures.
- Solid understanding of data pipeline testing, version control, and CI/CD practices.
- Experience with SQL and NoSQL databases.
- Strong problem-solving skills and attention to detail.
Preferred Skills
- Familiarity with geospatial data formats and processing (GeoJSON, Shapefiles, PostGIS).
- Experience with workflow orchestration tools (Databricks, Prefect, or similar).
- Knowledge of containerization (Docker/Kubernetes) and cloud-native data solutions.
- Experience supporting machine learning pipelines in production.
Compensation
- Location: Jacksonville, FL (Town Center Area) or Remote
- Type: Full-time
- Reports to: Director of Engineering
- Salary Based on Experience
- Annual Bonus
- Medical, Vision, Dental, 401(k)
- 21 Days Vacation
- Office Lunch provided Daily
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.
Top Skills:
Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and lead production AI/ML, Generative AI, and data engineering solutions for healthcare analytics and patient safety platforms. Develop full-stack applications, microservices, APIs, data pipelines, dashboards, self-service analytics, RAG systems, and event-driven architectures using cloud-native technologies. Apply engineering best practices including testing, CI/CD, observability, security, and performance optimization. Mentor engineers, lead technical initiatives, and collaborate with product, analytics, business, and platform teams.
Top Skills:
Amazon KinesisAWSAzureAzure Event HubsCi/CdDatabricksDelta LakeGCPGenerative AiJavaJavaScriptKafkaLarge Language Models (Llms)Microsoft FabricMlopsPysparkPythonReactRest ApisRetrieval-Augmented Generation (Rag)SnowflakeSparkSpring BootSQLTypescriptVector Search
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Build and maintain automated data quality testing for customer data pipelines. Responsibilities include developing dbt, Soda, and SQL checks; validating schemas, loads, sequencing, and downstream reconciliations; detecting anomalies; managing severity levels and customer overrides; reporting quality metrics; and partnering with engineering teams to embed testing into new pipelines. The role requires strong backend testing, SQL, Python, Airflow, and Databricks experience, along with excellent debugging and communication skills.
Top Skills:
Apache AirflowCi/CdCypressDatabricksDbtDelta LakeGitPlaywrightPythonSodaSpark SqlSQL
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
