Veeda AI Logo

Veeda AI

Senior Machine Learning Engineer — Data Infrastructure

Posted 2 Days Ago
Remote or Hybrid
Hiring Remotely in California, USA
Senior level
Remote or Hybrid
Hiring Remotely in California, USA
Senior level
Design, build, and operate large-scale crawling, ingestion, and ETL/ELT pipelines for petabyte-scale image and video datasets. Optimize distributed processing (Ray/Spark/Dask), ensure dataset provenance/versioning, reduce cost/latency, and collaborate with CV engineers and ML scientists. Provide technical leadership and mentor junior engineers.
The summary above was generated by AI
About Us

Veeda AI is building the next generation of multimodal foundation world models for Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most challenging problems at the intersection of AI, robotics, and embodied intelligence. If you're excited about pushing the boundaries of what's possible with Physical AI, you'll have the opportunity to make an outsized impact from day one.

Responsibilities
  • Crawling & Ingestion at Scale: Architect and own the scraping and crawling infrastructure that acquires petabytes of image and video data — designing systems that are resilient, compliant, and able to keep pace with a fast-moving content landscape.

  • Image-Data Pipeline Design: Build and maintain production data pipelines that clean, transform, and process raw visual assets—handling format diversity, resolution variance, metadata extraction, and noise at scale.

  • ETL/ELT for Training & Evaluation: Design ETL/ELT workflows that prepare image and video datasets for ML model training and evaluation, including annotation ingestion, quality scoring, and reproducible dataset versioning.

  • Performance & Cost Optimization: Continuously profile and optimize pipelines for throughput, latency, and cloud storage/compute costs—ensuring research velocity without unnecessary overhead.

  • Distributed Processing Ownership: Select, deploy, and operate distributed data-processing frameworks (e.g., Ray, Spark, Dask) to handle compute-intensive tasks like large-batch image transformation, embedding generation, and feature extraction.

  • Cross-Functional Partnership: Work directly with Computer Vision Engineers, ML Scientists, and product teams to translate data requirements into reliable, well-documented pipelines and close the feedback loop between model performance and data quality.

  • Technical Leadership: Lead data-pipeline design reviews, mentor junior and mid-level data engineers, establish best practices for the data team, and raise the overall engineering bar.

Requirements
  • You have 5+ years of professional experience in data engineering or a closely related discipline with a strong foundation in distributed systems, database design, and handling large binary assets (images, video) at scale.

  • You possess strong programming skills in Python and SQL, with proven experience designing end-to-end production systems rather than basic scripts.

  • You have designed and operated web scraping or data ingestion systems running reliably in production at significant global scale.

  • You are hands-on with data-processing frameworks (e.g., PySpark, Pandas, Ray) and comfortable with image-processing libraries (OpenCV, Pillow, scikit-image).

  • You have built ETL/ELT pipelines for ML/CV use cases with a strong emphasis on dataset provenance, lineage, and reproducibility.

  • You have extensive experience with cloud object storage (AWS S3, GCP GCS) and understand the cost, latency, and durability trade-offs when managing petabyte-scale data assets.

  • Production Quality, Agent Velocity: Your daily workflow runs through AI coding harnesses (e.g., AI agents/assistants) without sacrificing software engineering rigor. You review agent code diffs with the same scrutiny as a team member's PR, recognize AI code generation failure modes, and ship rapidly without introducing technical debt or "slop."

Nice to Have
  • Experience with Ray for distributed data processing or ML-adjacent workflows.

  • Hands-on experience with data orchestration platforms (e.g., Airflow, Dagster, Prefect) to manage complex processing DAGs in production.

  • Familiarity with Computer Vision concepts and image annotation formats (COCO, PASCAL VOC, YOLO).

  • Practical knowledge of MLOps concepts, including data versioning (e.g., DVC, LakeFS) and experiment tracking for CV pipelines.

  • Experience with containerization (Docker) and orchestration (Kubernetes) for scaling data processing workloads.

  • Experience navigating multi-region data compliance challenges (GDPR, content licensing, and image rights across jurisdictions).

Similar Jobs

48 Minutes Ago
Remote
2 Locations
244K-244K Annually
Expert/Leader
244K-244K Annually
Expert/Leader
Information Technology
As the Director of Data Science, you'll mentor teams, oversee projects, drive data-driven decisions, and implement AI and ML solutions while enhancing our data pipeline.
Top Skills: BigQueryClickhouseDruidMlNlpPythonRedshiftSQL
50 Minutes Ago
Easy Apply
Remote
Easy Apply
79K-88K Annually
Senior level
79K-88K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Serve as Finance's single DRI for product launches with financial impact: evaluate new trade strategies, document fund flows and accounting treatments, design and implement financial controls, coordinate cross-functional stakeholders (accounting, tax, treasury, legal, operations), and partner with IT/vendors to automate and scale workflows for audit and regulatory readiness.
Top Skills: Generative Ai
50 Minutes Ago
Easy Apply
Remote
Easy Apply
95K-106K Annually
Senior level
95K-106K Annually
Senior level
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Own end-to-end regional threat case management, perform structured behavioral threat assessments (JACA, WAVR-21, CTAP-25), lead intelligence-led incident response, coordinate cross-functionally with EP, GSOC, Legal, HR/ER, and law enforcement, produce decision-ready briefings, and improve regional program maturity, tooling, playbooks, metrics, and training.
Top Skills: Generative AiOnticOsint PlatformsPublic Records ResearchSocial Media Monitoring

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account