Phizenix Logo

Phizenix

Principal AI Engineer

Posted 2 Days Ago
Be an Early Applicant
In-Office
Manhattan, New York City, NY, USA
Expert/Leader
In-Office
Manhattan, New York City, NY, USA
Expert/Leader
Principal AI Engineer responsible for designing and governing AI/ML platforms, multi-tenant services, LLM integrations, reusable developer tooling, and secure deployment patterns. The role combines hands-on software engineering, cloud architecture, AI governance, security, CI/CD, infrastructure-as-code, and technical leadership. Responsibilities include establishing AI productization standards, mentoring engineers, partnering with security and compliance teams, and translating complex technical decisions for executives and cross-functional stakeholders.
The summary above was generated by AI

Job description

At <our consulting company>, we solve the most complex and critical challenges by moving quickly from analysis to action when it really matters; creating value that has a lasting impact on companies, their people, and the communities they serve. We hold ourselves accountable by providing space for authenticity, growth, and equity for everyone.

<Our consulting company> has embraced a hybrid work model to provide flexibility and support work-life integration. Travel is part of this position, but frequency may vary based on client, team, and individual circumstances. Relocation assistance is not available for this position.

About the Role

The Principal AI Engineer sits at the intersection of software engineering, data science, platform architecture, and AI governance. You will be the technical owner of how AI/ML engineering is designed, built, governed, and shipped across a portfolio of products serving all of <our consulting company> domains.

This is a hands-on engineering and technical leadership position. You will move fluidly between writing production code, architecting multi-tenant AI services, building internal developer tooling, leading security and governance design, and mentoring engineering teams. Your success is measured by team-level outcomes — scalable patterns that outlast your direct involvement.

 

What You'll Do


AI Productization & Platform Engineering

  • Design and own the firm's AI productization & governance playbook, covering service patterns, security/compliance standards, model evaluation rubrics, and production-readiness criteria.
  • Build and maintain reusable internal tooling, including AI service scaffolding, evaluation and monitoring tooling, and data infrastructure — designed for team adoption without ongoing hand-holding.
  • Establish AI agent governance policies covering agent permissions, code execution controls, access to internal systems, and human-in-the-loop enforcement.
  • Partner with Security, Legal, and Compliance to define SOC2/ISO-aligned AI controls, vendor DPA requirements, and prompt data classification policies.
  • Establish standardized deployment patterns using containerization, infrastructure-as-code, and CI/CD pipeline templates reusable across teams.

Developer Experience & Engineering Excellence

  • Champion AI-assisted development practices across the engineering org, including LLM-integrated development workflows, test-driven development patterns, and reusable tooling standards that scale across teams.
  • Codify modern software development standards (CI/CD, DevOps, testing, delivery quality) referenced by multiple teams as a baseline for new or re-platformed products.
  • Mentor engineers and tech leads with observable improvement in delivery consistency, design quality, and production readiness rigor.

Cross-Functional Leadership & Stakeholder Influence

  • Serve as the go-to technical authority on AI/ML, platform architecture, and engineering practices — regularly consulted by senior stakeholders at the design and strategy stages.
  • Bridge technical and non-technical stakeholders, translating complex architectural decisions, AI risk topics, and platform tradeoffs into clear, actionable guidance.

 

What You'll Need

Required

  • 15+ years in software engineering, data science, or a closely related technical field.
  • Bachelor's degree or higher in Computer Science, Engineering, or a related field.
  • Deep expertise in AI/ML frameworks and the Python ecosystem, with hands-on experience deploying models to public cloud infrastructure.
  • Demonstrated experience designing and operating multi-tenant AI services and LLM integrations in production.
  • Proven track record leading microservices architecture — decomposing monoliths, defining service contracts, and operationalizing CI/CD for distributed systems.
  • Strong hands-on command of containerization (Docker), infrastructure-as-code (Terraform), and modern DevOps practices.
  • Substantive experience with AI/LLM security — including prompt injection, data boundary enforcement, model supply chain risk, and AI-specific threat modeling.
  • Strong problem-solving skills, especially in building governance frameworks, evaluation rubrics, and reusable platform patterns at scale.
  • Excellent written and verbal communication skills in English; ability to translate complex technical topics to diverse audiences, including executive stakeholders.
  • Experience with Agile methodologies and cross-functional product team collaboration.

 

Preferred / Additional Qualifications

  • Experience applying AI/ML in business consulting, advisory, or professional services contexts.
  • Familiarity with AI service interface and gateway design patterns, including emerging AI integration protocols.
  • Contributions to open-source AI/ML projects, publications, or active involvement in technical communities.
  • Advanced certifications in AI, deep learning, cloud architecture, or security (e.g., AWS/GCP/Azure ML, CISSP).
  • Experience defining AI compliance controls for SOC2, ISO 27001, or TISAX frameworks.
  • Demonstrated enthusiasm for developer education — writing internal guides, running workshops, or building internal tooling communities.
  • Proficiency in additional languages is a plus (Go, Typescript) 
  • Demonstrated ability and enthusiasm to mentor and uplift junior team members or peers
  • Willingness to work outside of normal business hours, and in particular as unique projects/needs arise.
  • Ability to work full time in an office and remote environment; physically able to sit/stand at a computer and work in front of a computer screen for significant portions of the workday
  • Must become familiar with, and promote and abide by, our Core Values as defined by the <our consulting company> and foster an inclusive environment with people at all levels of an organization

Similar Jobs

19 Days Ago
Remote or Hybrid
US
172K-240K Annually
Expert/Leader
172K-240K Annually
Expert/Leader
Information Technology
Owns enterprise AI security assessment, architecture, and control programs. The role evaluates AI systems, vendors, platforms, and shadow AI; designs secure architectures, guardrails, identity models, sandboxes, gateways, and runtime controls; and develops detection and response capabilities for prompt injection, jailbreaks, data leakage, and tool misuse. The engineer partners with governance, identity, platform, engineering, and security operations teams, advises senior leaders, drives remediation, and mentors security professionals.
Top Skills: Ai GatewaysAi GuardrailsAi ObservabilityAi SandboxesAnthropicAWSAzureAzure Ai ServicesData Loss PreventionGCPIdentity And Access ManagementIso/Iec 42001LangchainMcpMicrosoft Copilot StudioMitre AtlasNist Ai RmfOpenaiOwasp Top 10 For Llm ApplicationsSemantic KernelZero Trust
20 Days Ago
Remote or Hybrid
212K-407K Annually
Senior level
212K-407K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Architect and engineer secure, scalable enterprise AI infrastructure for LLM training and inference, machine learning, agentic AI, and production platforms. Lead HPC, GPU, Kubernetes, cloud, networking, storage, reliability, observability, security, and automation strategies. Resolve complex performance and scalability challenges, establish engineering standards, evaluate emerging technologies, lead cross-functional initiatives, and mentor engineers in a regulated environment.
Top Skills: Accelerated ComputingAgentic AiCloud-Native PlatformsDistributed SystemsGpuHigh-Performance NetworkingHpcHybrid CloudInfrastructure AutomationKubernetesLlmsMachine LearningObservabilityPrivate CloudRack-Scale SystemsSreStorage
20 Days Ago
Remote or Hybrid
New York, NY, USA
212K-407K Annually
Senior level
212K-407K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Leads the architecture and engineering of secure, scalable enterprise AI infrastructure. Designs platforms for LLM training and inference, machine learning, agentic AI, and production workloads using HPC, GPUs, Kubernetes, hybrid cloud, networking, storage, and automation. Establishes standards for reliability, security, observability, governance, and compliance; resolves complex performance challenges; evaluates emerging technologies; leads cross-functional initiatives; and mentors engineers.
Top Skills: Accelerated ComputingAgentic AiDistributed SystemsGpu ComputingHigh-Performance NetworkingHigh-Performance StorageHpcHybrid CloudInfrastructure AutomationKubernetesLlmsMachine LearningObservabilityPrivate CloudRack-Scale SystemsResponsible AiSre

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account