Hitachi Logo

Hitachi

Principal AI Platform Engineer

Posted 4 Hours Ago
Remote
Hiring Remotely in Texas, USA
100K-150K Annually
Expert/Leader
Remote
Hiring Remotely in Texas, USA
100K-150K Annually
Expert/Leader
As a Principal AI Platform Engineer, lead the design and operation of enterprise AI platforms on AWS, focusing on LLMOps frameworks, RAG architectures, and scaling AI ecosystems. Collaborate across teams to innovate AI solutions, ensuring security and governance throughout.
The summary above was generated by AI

Function

Cloud & Data EngineeringOur Company

We’re Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world’s potential. We’re people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save lives. This is a world where innovation, technology, and deep expertise come together to take our company and customers from what’s now to what’s next. We make it happen through the power of acceleration.

Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We don’t expect you to ‘fit’ every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.

Job description

Hitachi Digital Services is seeking a highly skilled Principal AI Platform Engineer to help architect and operationalize next-generation AI platforms for enterprise-scale environments.

This role is focused on building and operating agentic AI platforms on AWS, leveraging modern Generative AI services including Amazon Bedrock, Bedrock AgentCore, SageMaker, and enterprise-grade LLMOps frameworks.

You will play a key role in designing scalable AI ecosystems that power intelligent workflows, retrieval-augmented generation (RAG), conversational interfaces, and AI-driven automation while ensuring security, governance, and operational excellence.

If you are passionate about building production-ready AI systems and shaping the future of enterprise AI architecture, this is an opportunity to make significant impact within a fast-growing innovation environment.

What You’ll Do
  • Design and operationalize enterprise-scale agentic AI platforms on AWS
  • Build and manage LLMOps frameworks, including:
    • Prompt/version management
    • Model orchestration
    • Evaluation pipelines
    • Monitoring and observability
  • Develop and deploy LLM-powered applications using:
    • Amazon Bedrock
    • Bedrock AgentCore
    • SageMaker
  • Implement scalable RAG architectures and vector search solutions
  • Integrate vector databases such as:
    • OpenSearch
    • Aurora PostgreSQL with pgvector
    • Pinecone or similar platforms
  • Design AI guardrails, governance controls, and responsible AI frameworks
  • Build workflow automation using:
    • AWS Lambda
    • Step Functions
    • EventBridge
  • Establish secure, scalable, enterprise-grade infrastructure aligned with AWS best practices
  • Integrate AI platforms with APIs, enterprise systems, analytical platforms, and downstream applications
  • Collaborate with architects, product teams, engineering teams, and business stakeholders to drive AI innovation initiatives
  • Mentor engineering teams on AI platform standards and best practices
Required Qualifications
  • 10+ years of software engineering, cloud engineering, or AI platform experience
  • 5+ years designing enterprise AI/ML platforms in AWS environments
  • Hands-on experience with:
    • Amazon Bedrock
    • Bedrock AgentCore
    • SageMaker
    • Agentic AI workflows
  • Strong experience designing and implementing:
    • Retrieval-Augmented Generation (RAG)
    • Vector database architectures
    • LLMOps frameworks
  • Experience with:
    • Prompt orchestration
    • Model evaluation
    • AI monitoring frameworks
  • Strong knowledge of:
    • AWS infrastructure
    • IAM/security policies
    • Networking
    • Observability
  • Experience building scalable cloud-native applications and microservices
  • Strong Python development experience
  • Ability to translate business requirements into scalable AI platform solutions
  • Excellent communication and stakeholder engagement skills
Preferred Qualifications
  • Experience with Amazon Q (Developer / Business)
  • Experience fine-tuning or training foundation models using SageMaker
  • Experience implementing AI governance and responsible AI practices
  • Knowledge of enterprise AI security and compliance frameworks
  • Experience supporting educational, healthcare, financial, or regulated enterprise environments
  • AWS certifications preferred
About us

We’re a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today, this is the place for you.

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you

We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.

We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.

Similar Jobs

12 Days Ago
Remote
United States
190K-225K Annually
Expert/Leader
190K-225K Annually
Expert/Leader
Information Technology • Internet of Things • Software
The Principal AI Platform Engineer will architect and build AI platforms for certification workflows, integrating tools and ensuring security, stability, and scalability while mentoring other engineers.
Top Skills: AzureAzure DevopsBicepContainer AppsEntra IdGitKey VaultLangchainLanggraphPostgresPythonTerraform
22 Days Ago
Remote
United States
Senior level
Senior level
Healthtech
As a Principal Software Engineer, you will architect AI-enabled systems, mentor teams, and guide technical decisions for scalable products.
Top Skills: AWSAzureC#C++DockerGCPGoJavaKafkaKubernetesPythonScalaSQL
Yesterday
Remote
USA
179K-199K Annually
Senior level
179K-199K Annually
Senior level
Healthtech • Software
The Principal AI Platform Engineer will design and maintain the infrastructure for AI systems, ensuring integration, security, and scalability for GenAI products.
Top Skills: Ai IdesCi/CdContainer SecurityKubernetesMlflowOpentelemetryVector Databases

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account