Lead the development of tools for monitoring data quality in pipelines, including inspecting data, performance monitoring, and collaboration with AV engineering teams.
Description
The Role
As a Software Engineer on the Metrics Frameworks team, you will lead the development of tooling to monitor and improve our pipelines' data quality. These pipelines support road event monitoring, data mining and training, and simulation metrics. We are seeking an experienced software/data engineer to build telemetry, data quality inspection tooling, dashboards, and alerting that establish guardrails on data quality (e.g., delay, accuracy, completeness). Your work will increase confidence in our data and downstream metrics for internal customers. These metrics will support and accelerate feature design, prioritization, and development, as well as evaluate the impact of newly released features.
About the Organization: The Metrics Frameworks team falls within the Simulation, Evaluation, and Data organization, which is dedicated to advancing the development of autonomous vehicles through cutting-edge simulation technologies. The Metrics Frameworks team focuses on creating, maintaining, and evolving the analytics framework that supports GM's goal of safe, high-performing, and scalable driverless technology. The team delivers robust and scalable tools that facilitate data-driven decision-making throughout the AV feature development lifecycle. We collaborate closely with Simulation Evaluation, Embodied AI, and System and Test Engineering teams, enhancing productivity across the organization by developing automation tools and shared libraries. We are accountable for the performance, reliability, and scalability OKRs of the analytics framework. This includes, but is not limited to: developing customized analytics workflows; improving operational telemetry and dashboards to track relevant KPIs for prioritization; and identifying, designing, and implementing solutions to achieve key results.
What You'll Do
Your Skills & Abilities
What Will Give You A Competitive Edge
Compensation
Benefits
About GM
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
Why Join Us
We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.
Total Rewards | Benefits Overview
From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
Non-Discrimination and Equal Employment Opportunities (U.S.)
General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.
All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws.
We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire.
Accommodations
General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us [email protected] or call us at 1-800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
The Role
As a Software Engineer on the Metrics Frameworks team, you will lead the development of tooling to monitor and improve our pipelines' data quality. These pipelines support road event monitoring, data mining and training, and simulation metrics. We are seeking an experienced software/data engineer to build telemetry, data quality inspection tooling, dashboards, and alerting that establish guardrails on data quality (e.g., delay, accuracy, completeness). Your work will increase confidence in our data and downstream metrics for internal customers. These metrics will support and accelerate feature design, prioritization, and development, as well as evaluate the impact of newly released features.
About the Organization: The Metrics Frameworks team falls within the Simulation, Evaluation, and Data organization, which is dedicated to advancing the development of autonomous vehicles through cutting-edge simulation technologies. The Metrics Frameworks team focuses on creating, maintaining, and evolving the analytics framework that supports GM's goal of safe, high-performing, and scalable driverless technology. The team delivers robust and scalable tools that facilitate data-driven decision-making throughout the AV feature development lifecycle. We collaborate closely with Simulation Evaluation, Embodied AI, and System and Test Engineering teams, enhancing productivity across the organization by developing automation tools and shared libraries. We are accountable for the performance, reliability, and scalability OKRs of the analytics framework. This includes, but is not limited to: developing customized analytics workflows; improving operational telemetry and dashboards to track relevant KPIs for prioritization; and identifying, designing, and implementing solutions to achieve key results.
What You'll Do
- Lead the design, implementation, and roadmap development for tooling that monitors data quality from various sources (simulation, road, etc.) and empowers users to debug data issues and build quantitative analysis pipelines.
- Accelerate the team's effectiveness by designing and implementing scalable automation tools for inspecting data ingestion, processing, inspection, debugging, and performance monitoring.
- Build and optimize data processing pipelines to handle large volumes of testing data, enabling low-latency insights for AV testing performance.
- Collaborate with other frameworks and data infra teams to build and deploy tools that improve developer productivity and data reliability.
- Work closely with autonomous vehicle engineering teams to enable rapid iteration, model feedback, and metrics-driven decision-making.
- Maintain a high technical bar for code quality and system design through architectural and code reviews.
Your Skills & Abilities
- Experience with writing Python in a production environment (unit testing, code review, algorithm performance and tradeoffs, etc.)
- Experience with OLAP databases and SQL related technologies (e.g., Big Query, Databricks, DuckDB, etc)
- Experience with data orchestration and transformation tools like Airflow, DBT, etc
- Experience developing scalable software and data solutions used by many developers and stakeholders and capable of processing petabytes of data
- Experience with time-series data analysis and online performance monitoring tools
- Experience developing automation scripts (Python and Bash scripts)
- BS in Computer Science, Computer Engineering, Electrical Engineering, Mechanical Engineering, or Aerospace Engineering
- 5+ years of industry experience
- Strong organizational and communication skills
What Will Give You A Competitive Edge
- Familiarity with ROS, Python bindings for C++, and plotting/visualization libraries
- Experience working in the Autonomous Vehicle or Robotics industry
- Experience with full-stack languages and frameworks, such as Nest.js, React, Django, etc.
- Knowledge of machine learning frameworks and their application in testing automation and metrics generation.
- Experience building high performance framework / infrastructure and performance optimization in C++
- Experience working within a monorepo and using Bazel
Compensation
- The salary range for this role is $123,200 and $189,100. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
Benefits
- GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.
About GM
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
Why Join Us
We believe we all must make a choice every day - individually and collectively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.
Total Rewards | Benefits Overview
From day one, we're looking out for your well-being-at work and at home-so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
Non-Discrimination and Equal Employment Opportunities (U.S.)
General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.
All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws.
We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire.
Accommodations
General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us [email protected] or call us at 1-800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
Top Skills
Airflow
Big Query
Databricks
Dbt
Duckdb
Python
SQL
Similar Jobs at General Motors
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Process Controls Engineer leads technical projects in automation, collaborating with cross-functional teams to enhance manufacturing processes and solve complex problems, while managing controls projects and system integration.
Top Skills:
Andon SystemsFanuc Robot ProgrammingHmiPlcProduction Monitoring And ControlRockwell PlcsSiemens Sinumerik
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Senior Analyst manages the GM Labor Information Database, executing test cases for warranty projects, maintaining master data, and resolving dealer issues to improve warranty performance globally.
Top Skills:
SAP
8 Hours Ago
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Hardware Integration Lead provides technical leadership for hardware integration in automotive projects, ensuring requirements and validation strategies are defined, executed, and governed throughout the lifecycle.
Top Skills:
CanEcrEmergeJIRALinPrts
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

