Highmark Health Logo

Highmark Health

Lead AI Architect

Reposted Yesterday
Be an Early Applicant
In-Office or Remote
15 Locations
118K-197K Annually
Senior level
In-Office or Remote
15 Locations
118K-197K Annually
Senior level
Design and own end-to-end AI architecture including data pipelines, model storage, inference, and front-end integration. Select tech stack (LLMs, vector DBs, orchestration), establish MLOps best practices, ensure scalability, security, compliance (GDPR/CCPA), and cost-optimized cloud GPU/TPU usage. Lead cross-functional alignment, mentor engineers, and present architectural strategy to executives.
The summary above was generated by AI
Company :enGenJob Description : 

JOB SUMMARY

We are seeking a visionary AI Architect to serve as the technical cornerstone of our artificial intelligence strategy. While an AI Engineer builds the models, you will design the entire ecosystem they live in. You will be responsible for defining the high-level structure of our AI systems, ensuring they are scalable, secure, and seamlessly integrated with our enterprise infrastructure. As an Architect, you sit at the intersection of business value and technical feasibility, translating executive goals into robust technical blueprints.

This role involves defining the end-to-end architecture for AI solutions, encompassing data pipelines, model storage, inference engines, and front-end integration. The individual will be responsible for evaluating and selecting the optimal "tech stack," including specific LLMs, vector databases, and orchestration frameworks, to meet the company's long-term needs. Key responsibilities also include establishing best practices for MLOps to ensure consistent coding standards, model versioning, and deployment strategies across the engineering team. The architect will design scalable systems capable of handling massive data throughput and low-latency inference for real-time applications. A critical aspect of the role is architecting "Human-in-the-loop" systems and guardrails to ensure data privacy, compliance (GDPR/CCPA), and AI safety. This position requires strong cross-functional leadership, acting as the technical liaison between Data Science, DevOps, and Product teams to align the AI roadmap with infrastructure capabilities.

Candidates should possess architectural expertise, including a deep understanding of distributed systems, microservices architecture, API design, and cloud-native patterns. Proficiency in designing complex data schemas for both structured and unstructured data, as well as experience with Infrastructure as Code (IaC) tools like Terraform or Ansible to manage AI infrastructure, is required. Technical proficiencies include expert-level knowledge of cloud platforms such as AWS (SageMaker), Azure (Azure ML), or GCP (Vertex AI). Mastery of the AI lifecycle, from frameworks like PyTorch/TensorFlow to deployment tools like Kubeflow, MLflow, or BentoML, is essential. An expert understanding of Generative AI, including Transformer architectures, RAG (Retrieval-Augmented Generation), and fine-tuning methodologies, is also a key qualification.

The ideal candidate will have a proven track record of 5+ years in software engineering or data science, with at least 3 years in an architectural role. Experience in enterprise integration, particularly in migrating legacy systems to AI-augmented workflows, is highly valued. This role also demands thought leadership, including the ability to mentor senior engineers and present complex architectural decisions to the C-suite.

Essential competencies for this role include strategic thinking, with the ability to anticipate 12–24 months ahead in AI trends and prepare the infrastructure accordingly. Cost management skills, specifically optimizing cloud spend for GPU/TPU resources, are crucial. Exceptional communication skills are also required, demonstrated through the ability to document architectural patterns and lead technical design reviews.

ESSENTIAL RESPONSIBILITIES

  • Lead to provide strategic consultation to business customers in defining or designing business processes, functions and organizational structures, as well as in researching, identifying and internally marketing enabling technologies based on customer capability requirements. Facilitate development of the most complex enterprise business solutions that combine knowledge of particular business processes and issues, general technological options, and process facilitation techniques. Lead and participate in enterprise strategy development, including environmental analysis, opportunity identification, value cases and business innovation portfolio development.
  • Specify and design large or the most complex systems, solutions, networks, infrastructure elements, or processes. Select appropriate design standards, methods and tools and ensures that they are applied effectively. Lead reviews of others’ system design to ensure selection of appropriate technology, efficient use of resources and integration of multiple systems and technology. Establish policy for selection of architecture components. Evaluate and undertake impact analysis on the most complex major design options. Ensure that the system architecture balances functional, service quality and systems management requirements.
  • Use appropriate tools, including models of components and interfaces, to contribute to the development of the most complex architectures. Produce detailed component requirements, specifications and translates these into detailed solutions/designs for implementation using selected products. Provide advice on technical aspects of system development, integration (including requests for changes, deviations from specifications, etc.) and processes.  Ensure that relevant technical and business strategies, policies, standards and practices are applied correctly.
  • Select and use tools and methods to establish, clarify, and communicate the functional and non-functional requirements of system users, their characteristics, and tasks.  Identify the technical, organizational, and physical environment in which the most complex products or systems will operate. Identify, propose, initiate, and lead significant improvement programs, taking responsibility for the quality and appropriateness of the work performed and the realization of measurable business benefits. Modify existing process improvement approaches and/or develop new approaches to achieving improvement.
  • Lead the resolution of a variety of architecture and business problems and serve as a technical or business lead for highly complex project initiatives.
  • Communicate effectively will all levels of organization
  • Manage expectations of customers, partners  and management
  • Participate in customer walkthroughs and plans; design and technical walkthroughs; and problem resolution and decision making
  • Interact with departments across the organization as necessary, including the development and interpretation of highly complex requirements for peers and other staff.
  • Maintain an in-depth knowledge of specific technical aspects in area of expertise and provides expert advice regarding their application.  The area of specific expertise may be any aspect of information or communication technology, technique, method, process, product, or application area.
  • Provide leadership and mentoring in the areas of expertise and architecture to their peers, developers, management and business users including technical expertise, coaching, and ad-hoc training by:
  • Prepare presentations on complex issues on the area of expertise.
  • Present to their peers to ensure consistency to Highmark's strategic direction.
  • Other duties as assigned or requested.

EDUCATION

Required

  • Bachelor’s Degree in Information Technology or closely related field

Substitutions

  • None

Preferred

  • Master's Degree

EXPERIENCE

Required

  • 7 years in an IT discipline
  •  7 years n a Business discipline

Preferred

  • Health insurance industry business knowledge

LICENSES AND CERTIFICATIONS

Required

  • None

Preferred

  • Industry certifications such as Java Developer, DB2, Cogno, PEGA, Enterprise Architect(SCEA), Project Management

SKILLS

An Architect is not required to have experience in all of these, but is required to have those needed to support applications they are responsible for supporting. Current skill set are reviewed every other year, new skills may be required to meet changing business needs.

  • IMS
  • DB2
  • Oracle and Teradata Databases
  • Data Warehousing
  • COBAL
  • Visual Basic
  • C
  • C++
  • SAS
  • Java/JavaScript Framework
  • PEGA
  • CSS3
  • Mobile
  • JSON
  • Cognos
  • Hadoop
  • SQL
  • J2EE
  • HTML5/XML
  • Project Management Tools: Waterfall and/or Agile

SCOPE OF RESPONSIBILITY 

Does this role supervise/manage other employees?         

No

WORK ENVIRONMENT

Is Travel Required?

Yes

Disclaimer: The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees within this job title. It may not contain a comprehensive inventory of all duties, responsibilities, and qualifications required of employees to do this job.

Compliance Requirement: This position adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies.

As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at all times. In connection with this, all employees must comply with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as all data security guidelines established within the Company’s Handbook of Privacy Policies and Practices and Information Security Policy. Furthermore, it is every employee’s responsibility to comply with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements. 

Pay Range Minimum:

$118,400.00

Pay Range Maximum:

$196,800.00

Base pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations.  The displayed salary range does not reflect any geographic differential Highmark may apply for certain locations based upon comparative markets.

Highmark Health and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against all individuals based on any category protected by applicable federal, state, or local law.

We endeavor to make this site accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below.

For accommodation requests, please contact HR Services Online at [email protected]

California Consumer Privacy Act Employees, Contractors, and Applicants Notice

Similar Jobs

15 Days Ago
Remote
United States
Expert/Leader
Expert/Leader
Information Technology • Consulting
Lead AI architecture and strategy for enterprise AI transformation: design scalable platforms using LLMs, RAG, agentic AI, and advanced analytics; establish patterns, governance, and MLOps; guide teams from POC to production while aligning technical roadmaps with business objectives.
Top Skills: Ai Agents/Agentic AiAPIsAws BedrockAzure Ai ServicesAzure OpenaiCloud-NativeContainerizationData PipelinesEmbeddingsEnterprise ArchitectureGenerative AiGoogle Vertex AiKubernetesLangchainLanggraphLarge Language Models (Llms)LlamaindexLlmopsMlopsModel OrchestrationOpenai FrameworksPrompt EngineeringPythonRetrieval-Augmented Generation (Rag)Semantic KernelTogafVector DatabasesVector Search
22 Days Ago
Remote
United States
140K-175K Annually
Senior level
140K-175K Annually
Senior level
Big Data • Cloud • Hardware • Software • App development
Lead development and commercialization of Cloud Data solutions: design cloud data architectures, lead migrations and ETL/ELT, operationalize AI across clouds, support strategic sales pursuits, enable and train solution architects, secure partner co-investment, and provide steering‑committee oversight to mitigate delivery risk and drive practice growth.
Top Skills: Agentic Ai ToolsAi Coding AssistantsAmazon BedrockApache NifiAWSAws GlueAzureAzure Ai FoundryAzure Event HubData LakehouseData MeshDatabricksEltETLFinopsFlinkGCPInformaticaKafkaKinesisMedallion ArchitectureMicrosoft FabricRagSagemakerSnowflakeVertex Ai
22 Days Ago
Remote
United States
140K-175K Annually
Senior level
140K-175K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software
Lead development and commercialization of Cloud Data and AI solutions: design modern data architectures, support technical sales and strategic pursuits, enable the practice with tooling and training, oversee delivery risk and partner co-investment, and drive P&L/accountability for the offering.
Top Skills: Agentic Ai ToolsApache NifiAWSAws GlueAzureAzure Ai FoundryAzure Event HubBedrockData FabricData GovernanceData LakehouseData LineageData MeshDatabricksFinopsFlinkGCPInformaticaKafkaKinesisMedallion ArchitectureMicrosoft FabricRag ArchitectureSagemakerSnowflakeVertex Ai

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account