Vertex, Inc. Logo

Vertex, Inc.

Senior Principal AI Engineer

Reposted 4 Days Ago
Remote
Hiring Remotely in USA
230K-299K Annually
Expert/Leader
Remote
Hiring Remotely in USA
230K-299K Annually
Expert/Leader
The Software Architect will lead AI quality evaluation, design evaluation frameworks, create risk controls, and ensure compliance, partnering with various teams on AI systems.
The summary above was generated by AI

Job Description:

  • Serve as the most senior individual-contributor engineer and principal technical authority within the Commercial AI Center of Excellence (CAI CoE), owning the technical vision for AI-as-a-Service (AIaaS) enablement at enterprise scale. 

  • Operate as a full-spectrum AI engineer fluent across the entire lifecycle — data, model training and fine-tuning, retrieval, orchestration, evaluation, and production operations — able to go as deep as any specialist and to compose the pieces into coherent, production-grade systems. 

  • This role requires both traditional AI/ML, GenAI product engineering, and traditional software architecture skillsets. 

  • Establish reference architectures, paved-road patterns, and enterprise technical standards for agentic orchestration, tool and MCP design, retrieval, model training, and responsible AI across production systems. 

  • Lead the most complex, ambiguous, cross-team initiatives spanning multiple value streams, and review and influence AI designs across product teams to ensure alignment with enterprise standards. 

  • Set long-term technical direction while remaining deeply hands-on with the most critical AI infrastructure and services. 

Key Responsibilities 

  • Set the multi-year technical vision, reference architectures, and enterprise standards for AIaaS across PDD, and act as the final technical authority and escalation point for the organization's hardest AI problems. 

  • Define and own the enterprise model-training strategy across traditional AI/ML and LLMs, and personally train, fine-tune (e.g., QLoRA, LoRA, PEFT, and full fine-tuning), and evaluate models when the problem demands it. 

  • Establish standards for how and where training data from Commercial AI products is sourced, cleaned, versioned, stored, and governed (lineage, licensing/consent, and PII), and architect the large-scale data and feature pipelines behind them. 

  • Architect the orchestration and abstraction layers of the central AI system that connect LLMs to tools, data, and sub-agents, and set standards for MCP servers, tool-surface design (optimal number of tools exposed per LLM and APIs per server), and when to use specialized sub-agents versus direct tool exposure. 

  • Design retrieval/RAG systems end to end — chunking strategies, embeddings, vector stores, hybrid search, re-ranking, context assembly, and memory. 

  • Own the enterprise evaluation, observability, and safety strategy for AI systems, including offline and online evaluation, tracing, red-teaming, guardrails, and responsible-AI and compliance requirements. 

  • Drive build-versus-buy, model and vendor selection, and long-term architectural bets, anticipating where the field is heading and preparing the organization to adopt it. 

  • Optimize the performance, cost (token and inference economics), scalability, and reliability of AI workloads in partnership with Security, Cloud Platform, and SRE teams. 

  • Multiply the organization: mentor and grow Principal and Staff engineers and raise the AI engineering bar. 

Required Qualifications 

  • 15+ years in AI/ML software engineering with demonstrated Senior Principal-level (or equivalent) impact delivering production AI at enterprise scale. 

  • Full-lifecycle, hands-on mastery across both specialist domains: (a) training and fine-tuning traditional AI/ML models and LLMs — including parameter-efficient methods (QLoRA/LoRA/PEFT), quantization, distributed training, and rigorous evaluation; and (b) LLM orchestration, agentic systems, tool/MCP design, and retrieval/RAG in production. 

  • Deep expertise in distributed systems, cloud-native architecture, and large-scale data and feature pipelines. 

  • Strong command of data management and governance: dataset storage architecture, versioning, lineage, quality, PII handling, and licensing/consent for training data. 

  • Proven ability to design developer platforms, APIs, reusable SDKs, MCP servers, and multi-agent orchestrations that many teams depend on. 

  • Rigorous, demonstrated approach to AI evaluation, observability and tracing, and responsible-AI guardrails. 

  • Expertise with cloud platforms (Azure strongly preferred) and a track record of optimizing AI workload cost, performance, scalability, and reliability. 

  • Demonstrated ability to set technical strategy and influence decisions across many teams without direct authority, and to mentor Principal- and Staff-level engineers. 

  • Experience operating in regulated SaaS environments and meeting security and compliance requirements. 

Preferred Qualifications 

  • Bachelor's degree in Computer Science, Engineering, or a related discipline; advanced degree preferred. An equivalent combination of education, training, and relevant professional experience is accepted in lieu of a formal degree. 

  • Industry experience in tax or other regulated domains (insurance, fintech, or healthcare). 

  • Experience with vector databases and retrieval optimization at scale. 

  • FinOps for GenAI: experience modeling and optimizing LLM token and inference costs. 

  • Data science or classical AI background beyond prompt engineering (statistics, feature engineering, and model evaluation). 

  • Contributions to open-source AI tooling, published research, patents, or recognized technical thought leadership. 

  • Strong executive communication and technical storytelling skills. 

Disclaimer:

The above statements describe the general nature and level of work performed in this role. Other duties may be assigned.


Vertex Values: Together We Win

We're building a team of people who are passionate about making an impact for our customers and committed to how that impact is achieved. Our values define the behaviors, mindset, and culture that make Vertex a great place to grow and do meaningful work.


Play to Win or We Don't Play — If we choose to do something, we're choosing to do it because we plan to win. That mindset raises our bar on product quality, customer outcomes, and how we show up for one another.


Work As a Team, Putting the Customer At the Core — Our customers are our true north. Whatever your role, ask: how will this help a customer succeed today? We earn trust through outcomes, not promises.


Achieve Excellence With Integrity, Speed, and Agility — The market isn't slowing down. We'll move faster, adapt quickly, and never compromise on doing things the right way — for teammates, customers, and partners.


Innovate Boldly With a Growth Mindset — Progress demands smart risk. We'll try new approaches, learn fast, and keep pushing the boundaries — especially where AI can remove friction and unlock value.


Communicate with Care, Candor and Transparency — Honest, constructive conversations make us better. Let's speak plainly about what's working and what isn't and help each other improve.

Pay Transparency Statement:

US Base Salary Range: $229,800.00 - $298,700.00

Base pay offered to new hires may vary based upon factors including relevant industry and job-related skills and experience, geographic location, and business needs.* The range displayed does not encompass the full potential of the role, which allows for further growth and career progression.

In addition, as a part of our total compensation package, this role may be eligible for the Vertex Bonus Plan (VOB), a role-specific sales commission/bonus, and/or equity grants.

Learn more about Life at Vertex and connect with your recruiter for more details regarding Vertex's compensation and benefit programs.

*In no case will your pay fall below applicable local minimum wage requirements.

Similar Jobs

10 Days Ago
Remote or Hybrid
74K-112K Annually
Senior level
74K-112K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Design and build evaluation and simulation systems for generative AI agents using Dynatrace observability data. Create large-scale simulation pipelines, define metrics/datasets/judging strategies, build developer CLIs, generate adversarial scenarios, and measure agent tool-use and failure modes. Prototype, run feedback cycles, set technical strategy, and mentor engineers.
Top Skills: Agent FrameworksApmAWSAzureCi/CdCli ToolingDynatraceEvaluation FrameworksGolden DatasetsGCPLlm-As-A-JudgeLlmsObservabilityPairwise ComparisonsPrompt EngineeringTrace Ingestion
22 Days Ago
Remote
2 Locations
205K-361K Annually
Senior level
205K-361K Annually
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
Lead design, build, and scaling of Agentic AI and industry-specific solution accelerators on Genesys Cloud. Develop reusable multi-agent workflows, RAG-based knowledge orchestration, integrations with enterprise systems, prototypes, and production-grade AI applications. Provide technical leadership, mentor engineers, collaborate with product and industry SMEs, and deliver repeatable solution blueprints to accelerate deployment and time-to-value.
Top Skills: Ai SkillsAi StudioAnthropic ApisAPIsArchitectAutogenAWSAws BedrockAzureCcaasCopilotCrewaiCRMEnterprise SearchErpEvent FrameworksEvent-Driven ArchitecturesExperience OrchestrationGenesys CloudGCPJavaScriptJourney ManagementLangchainLanggraphLlm IntegrationMicroservicesMulti-Agent SystemsOpenai ApisPythonRag (Retrieval-Augmented Generation)Rest ApisSemantic KernelTypescriptVector Databases
18 Minutes Ago
Easy Apply
In-Office or Remote
United States
Easy Apply
139K-196K Annually
Senior level
139K-196K Annually
Senior level
Cloud • Security • Software • Cybersecurity • Automation
Design, maintain, and extend abuse detection and prevention systems for GitLab's SaaS platform. Serve as a core maintainer of a Ruby on Rails monolith, build anomaly detection and agentic AI mitigations, automate abuse response, collaborate with peer engineering and security teams, and produce runbooks and operational documentation.
Top Skills: Agentic AiAWSGitlabGoogle Cloud Platform (Gcp)Large Language Models (Llms)RubyRuby On RailsSaaS

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account