Vertex, Inc. Logo

Vertex, Inc.

Principal AI Engineer

Reposted 28 Days Ago
Remote
Hiring Remotely in USA
160K-208K Annually
Expert/Leader
Remote
Hiring Remotely in USA
160K-208K Annually
Expert/Leader
Lead enterprise model-training strategy for Commercial AI products: fine-tune LLMs (QLoRA/LoRA/PEFT), train traditional ML models, design large-scale data pipelines, enforce data governance and PII handling, build reproducible experiment/training pipelines, optimize GPU/distributed training costs, and mentor teams to operationalize models into production.
The summary above was generated by AI

Job Description:

The Principal Engineer, AI Model Training & Data Strategy owns how Commercial AI (CAI) products train, fine-tune, and evaluate models, and how the data behind those models is sourced, curated, stored, and governed. This is primarily a model-training role with a strong secondary focus on the data management and pipelines that make high-quality training possible. The role defines the enterprise training strategy and the standards for how and where training data from Commercial AI products is stored, versioned, and reused. 

Essential Job Functions and Responsibilities 

  • Define and own the end-to-end model training strategy across CAI products, spanning traditional AI/ML models and large language models 

  • Fine-tune large language models using parameter-efficient techniques (e.g., QLoRA, LoRA, PEFT) and full fine-tuning where warranted 

  • Train, evaluate, and tune traditional AI/ML models (classification, regression, ranking, clustering, and similar) 

  • Work with large volumes of data – design and optimize pipelines for ingestion, cleaning, labeling, and feature engineering 

  • Define standards for how and where training data from Commercial AI products is stored, versioned, and accessed (data lakes/warehouses, feature stores, dataset registries) 

  • Establish data governance, lineage, quality, licensing/consent, and PII-handling practices for training data 

  • Build reproducible training pipelines and experiment tracking (datasets, hyperparameters, checkpoints, and metrics) 

  • Define evaluation methodology and benchmarks for model quality, including offline evaluation and regression testing 

  • Curate and clean training, validation, and test datasets, including synthetic data generation where appropriate 

  • Optimize training cost and compute utilization (GPU efficiency, distributed training, quantization) 

  • Partner with product and platform teams to operationalize and hand off trained and fine-tuned models to production 

  • Mentor engineers and raise model-training and data-quality maturity across teams 

Knowledge, Skills, and Abilities 

  • Strong hands-on experience training and fine-tuning both traditional AI/ML models and LLMs in production 

  • Deep experience with parameter-efficient fine-tuning (QLoRA, LoRA, PEFT), quantization, and the tradeoffs versus full fine-tuning 

  • Proficiency with ML/DL frameworks and libraries (e.g., PyTorch, Hugging Face Transformers/PEFT/TRL, scikit-learn) 

  • Experience building and operating large-scale data pipelines and platforms (e.g., Spark, Ray, dbt, or equivalents) 

  • Strong grasp of data management: dataset storage architecture, versioning, lineage, governance, and PII handling 

  • Experience with experiment tracking and reproducible ML (e.g., MLflow, Weights & Biases) 

  • Understanding of distributed training and GPU/compute optimization 

  • Ability to define strategy and standards while remaining hands-on in code 

  • Strong stakeholder collaboration and problem-solving skills 

Education and Experience 

  • Bachelor’s degree in Computer Science, Engineering, or related discipline; advanced degree in ML, AI, or Data Science preferred 

  • 12 or more years of experience in AI/ML engineering, applied ML, or data engineering, with significant hands-on model training and fine-tuning 

Disclaimer 

The above statements describe the general nature and level of work performed in this role. Other duties may be assigned. 


Vertex Values: Together We Win

We're building a team of people who are passionate about making an impact for our customers and committed to how that impact is achieved. Our values define the behaviors, mindset, and culture that make Vertex a great place to grow and do meaningful work.


Play to Win or We Don't Play — If we choose to do something, we're choosing to do it because we plan to win. That mindset raises our bar on product quality, customer outcomes, and how we show up for one another.


Work As a Team, Putting the Customer At the Core — Our customers are our true north. Whatever your role, ask: how will this help a customer succeed today? We earn trust through outcomes, not promises.


Achieve Excellence With Integrity, Speed, and Agility — The market isn't slowing down. We'll move faster, adapt quickly, and never compromise on doing things the right way — for teammates, customers, and partners.


Innovate Boldly With a Growth Mindset — Progress demands smart risk. We'll try new approaches, learn fast, and keep pushing the boundaries — especially where AI can remove friction and unlock value.


Communicate with Care, Candor and Transparency — Honest, constructive conversations make us better. Let's speak plainly about what's working and what isn't and help each other improve.

Pay Transparency Statement:

US Base Salary Range: $159,600.00 - $207,500.00

Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.

In addition, as a part of our total compensation package, this role may be eligible for the Vertex Bonus Plan (VOB), a role-specific sales commission/bonus, and/or equity grants.

Learn more about Life at Vertex and connect with your recruiter for more details regarding Vertex's compensation and benefit programs.

*In no case will your pay fall below applicable local minimum wage requirements.

Similar Jobs

13 Days Ago
In-Office or Remote
150K-242K Annually
Senior level
150K-242K Annually
Senior level
Aerospace • Artificial Intelligence • Computer Vision • Software • Analytics • Defense • Big Data Analytics
Design, develop, and deploy AI-native software products that transform large-scale geospatial data into actionable intelligence. Build multi-agent workflows using orchestration frameworks and large language models, engineer tool-using and self-refining agents, develop data ingestion pipelines, and operate secure, scalable AI systems in production. Apply DevOps, reinforcement feedback mechanisms, and AI-assisted development practices while contributing to engineering standards and documentation.
Top Skills: AWSCi/CdClaudeClaude CodeCodexDistributed SystemsDockerEmbeddingsGeminiGemini CliGoogle AdkGoogle Cloud PlatformGpt-4JavaScriptKubernetesLangchainLanggraphPythonRetrieval-Augmented GenerationVector Databases
14 Days Ago
Remote
United States
282K-371K Annually
Expert/Leader
282K-371K Annually
Expert/Leader
Healthtech • Social Impact • Software • Telehealth
Owns the strategy, architecture, and implementation of production AI and machine learning systems for personalization, search ranking, relevance, and patient-provider matching. Builds recommendation engines, retrieval models, LLM applications, and scalable ML infrastructure while establishing AI safety, evaluation, and MLOps standards. The role requires hands-on model development, technical leadership, mentoring, and responsible deployment of AI in a regulated mental healthcare environment.
Top Skills: A/B TestingAi AgentsAnthropicCollaborative FilteringData PipelinesElasticsearchFaissGdprGeminiGenerative AiGoHipaaJavaLearning-To-RankMapMilvusMlopsNdcgNlpOpenaiOpensearchPineconePythonRagSemantic Vector SearchTypescriptWeaviate
20 Days Ago
Remote or Hybrid
165K-282K Annually
Expert/Leader
165K-282K Annually
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead the architecture and end-to-end development of production-grade AI/ML systems, including training, deployment, monitoring, MLOps, deep learning, NLP, ASR, and agentic AI workflows. Translate research into scalable enterprise solutions, establish engineering and governance standards, evaluate emerging tools, communicate technical tradeoffs to leadership, and mentor engineers. The role requires expertise in Python, deep learning frameworks, cloud ML platforms, ML pipelines, statistics, and production LLM or agentic systems.
Top Skills: AsrAws SagemakerAzure MlCi/CdDistributed Data SystemsGcp Vertex AiGenerative AiLarge Language ModelsMlopsNlp/NluPythonPyTorchRetrieval-Augmented GenerationTensorFlow

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account