HED (hed.co) Logo

HED (hed.co)

AI Platform Engineer

Posted 2 Days Ago
In-Office or Remote
Hiring Remotely in United States
120K-170K Annually
Senior level
In-Office or Remote
Hiring Remotely in United States
120K-170K Annually
Senior level
Develop and optimize production AI solutions, including LLM applications, model evaluations, RAG systems, prompt strategies, and context management. Build AI use cases, structured data models, knowledge workflows, and governed datasets while applying privacy, security, and responsible AI practices. Collaborate with developers, data engineers, and business stakeholders on architecture, testing, delivery, and adoption. Evaluate emerging generative AI and agentic technologies and contribute to technical standards and platform improvements.
The summary above was generated by AI

AI Platform Engineer

HED is hiring an AI Platform Engineer to develop, evaluate, and improve the AI capabilities that support our people and our practice. 

About HED

We are a team that is full of ideas, experience, creativity, passionate opinions, insatiable curiosity, uncompromising integrity, commitment, and skill. Our culture is about aspiration, embracing change and challenges, listening to (and learning from) each other, encouraging continual learning, and inspiring collective growth. As an inclusive, integrated architecture and engineering practice, we value the diversity of perspectives, experiences, abilities, and expertise that advance both the work we do, and the world we share.

Position Summary

At HED, we believe the most powerful solutions emerge when expertise, technology, and human insight come together. As a national integrated architecture and engineering firm, we are advancing how artificial intelligence connects knowledge, improves workflows, and empowers our people to deliver exceptional outcomes.

You will build and optimize production AI solutions, evaluate large language models, improve AI-generated responses, and transform organizational knowledge into secure, accessible, and actionable intelligence.

Working within our Data & AI team, you will own defined technical initiatives and collaborate with developers, data engineers, and business stakeholders. This role offers opportunities to influence technical decisions and grow into broader platform leadership.

Essential FunctionsAI Model Evaluation and Performance

• Develop and maintain model benchmarking, evaluation datasets, testing methods, and performance baselines across production AI applications.

• Evaluate models, prompts, and configurations against response quality, reliability, cost, latency, and risk; document findings and recommend improvements.

• Support preproduction validation of model, prompt, and application changes.

Context Engineering and AI Optimization

• Develop and optimize retrieval-augmented generation (RAG), retrieval ranking, prompt structures, context management, and caching.

• Measure answer quality, token usage, and operating costs; use results to guide improvements.

• Collaborate with application developers to improve shared AI capabilities and user experiences.

AI Solution Development and Delivery

• Deliver defined AI use cases from requirements and design through implementation, testing, documentation, adoption, and improvement.

• Help design workflows that capture and organize employee expertise, skills, and competencies for use in AI-powered applications.

• Develop structured data models, skills taxonomies, and knowledge capture workflows; partner with data engineering to integrate governed datasets.

• Work with business stakeholders to define requirements, success criteria, and practical solutions.

Data Governance and Responsible AI

• Apply privacy, security, data classification, consent, retention, and access-control requirements to AI solutions and datasets.

• Support dataset quality, lineage, ownership, documentation, and auditability.

Technical Collaboration and Innovation

• Contribute to architecture discussions, technical reviews, coding standards, automated testing, CI/CD, and code reviews.

• Use AI-assisted development tools responsibly and share technical knowledge with colleagues.

• Evaluate emerging generative AI and agentic technologies for practical application at HED.

Requirements

• Approximately 4–6+ years of experience in software engineering, machine learning engineering, data engineering, or a related technical discipline.

• Hands-on experience developing, deploying, or supporting LLM applications in production.

• Experience implementing AI evaluations, benchmarks, or performance testing.

• Working knowledge of RAG, information retrieval, prompt engineering, and context optimization.

• Proficiency in Python and SQL, Git, automated testing, and modern software development practices.

• Experience with cloud applications, APIs, and data integration workflows.

• Understanding of enterprise data governance, privacy, and security.

• Ability to independently deliver complex technical assignments and communicate effectively with technical and nontechnical stakeholders.

Preferred Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Data Science, Information Systems, or a related field, or equivalent practical experience.

• Experience with Azure OpenAI, Amazon Bedrock, Anthropic, or comparable AI platforms.

• Familiarity with Databricks, Delta Lake, Unity Catalog, MLflow, or similar platforms.

• Experience with AI agents, automated workflows, experiment tracking, or multi-model systems.

Physical Requirements

• Prolonged periods of sitting at a desk and working on a computer.

• Must be able to effectively communicate in writing and verbally via phone, video conferencing, and in person.

• Visual acuity to perform responsibilities.

Work Environment

We embrace a hybrid model that promotes both autonomy and collaboration, including the freedom to work from home, with regular in-office days to connect with teammates and build culture.

The office is a professional, open-space environment designed for collaborative and independent work.

Other Duties

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties, or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.

Similar Jobs

2 Days Ago
Remote or Hybrid
New York, NY, USA
115K-145K Annually
Senior level
115K-145K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Designs and operates governance, security, deployment, monitoring, and cost-management frameworks for enterprise AI platforms. The role builds semantic models in Snowflake and Databricks, develops CI/CD and infrastructure-as-code solutions, enables multi-environment deployments, monitors AI reliability and usage, and implements auditability, responsible AI standards, RBAC, identity controls, and policy enforcement. It also partners with data and engineering teams to manage lineage, governed metrics, model operations, and cloud consumption across AI workloads.
Top Skills: AiopsSparkAWSAzure AdDatabricksDatabricks Agent BricksDatabricks GenieDbtDockerGenerative AiGitGithub ActionsIamInfrastructure As CodeKubernetesLanggraphMcpMlopsPythonRagRbacSnowflakeSnowflake CortexSQLTerraform
2 Hours Ago
Remote
2 Locations
Senior level
Senior level
Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Lead the AI Quality engineering team while remaining hands-on building evaluation infrastructure, observability tooling, diagnostic systems, datasets, annotation workflows, and CI/CD pipelines for production AI agents. Run experiments across prompts, models, routing, caching, and agent harnesses to improve quality, latency, and cost. Partner with AI Core engineering and manage technical direction and team priorities.
Top Skills: Ai AgentsBraintrustCi/CdLangsmithLlmsPythonRuby On Rails
23 Days Ago
Remote or Hybrid
New York, NY, USA
245K-335K Annually
Senior level
245K-335K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Design and deliver enterprise-scale AI systems, including foundation model training, LLM inference, agentic workflows, vector search, guardrails, evaluation, governance, and observability. Set architecture and optimization strategies for scalable, cost-efficient, responsible AI platforms. Lead model routing, caching, orchestration, and cloud deployments while mentoring engineers, influencing stakeholders, and advancing AI research into production.
Top Skills: Ai GovernanceAWSAzureC#C++CudaGoGCPHugging FaceJavaLarge Language ModelsMachine LearningModel EvaluationMulti-Agent SystemsObservabilityPythonPyTorchScalaSimilarity SearchVectordbs

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account