Function
Cloud & Data EngineeringOur CompanyWe’re Hitachi Digital Services, a global digital solutions and transformation business with a bold vision of our world’s potential. We’re people-centric and here to power good. Every day, we future-proof urban spaces, conserve natural resources, protect rainforests, and save lives. This is a world where innovation, technology, and deep expertise come together to take our company and customers from what’s now to what’s next. We make it happen through the power of acceleration.
Imagine the sheer breadth of talent it takes to bring a better tomorrow closer to today. We don’t expect you to ‘fit’ every requirement – your life experience, character, perspective, and passion for achieving great things in the world are equally as important to us.
Job descriptionHitachi Digital Services is seeking a highly skilled Principal AI Platform Engineer to help architect and operationalize next-generation AI platforms for enterprise-scale environments.
This role is focused on building and operating agentic AI platforms on AWS, leveraging modern Generative AI services including Amazon Bedrock, Bedrock AgentCore, SageMaker, and enterprise-grade LLMOps frameworks.
You will play a key role in designing scalable AI ecosystems that power intelligent workflows, retrieval-augmented generation (RAG), conversational interfaces, and AI-driven automation while ensuring security, governance, and operational excellence.
If you are passionate about building production-ready AI systems and shaping the future of enterprise AI architecture, this is an opportunity to make significant impact within a fast-growing innovation environment.
What You’ll Do- Design and operationalize enterprise-scale agentic AI platforms on AWS
- Build and manage LLMOps frameworks, including:
- Prompt/version management
- Model orchestration
- Evaluation pipelines
- Monitoring and observability
- Develop and deploy LLM-powered applications using:
- Amazon Bedrock
- Bedrock AgentCore
- SageMaker
- Implement scalable RAG architectures and vector search solutions
- Integrate vector databases such as:
- OpenSearch
- Aurora PostgreSQL with pgvector
- Pinecone or similar platforms
- Design AI guardrails, governance controls, and responsible AI frameworks
- Build workflow automation using:
- AWS Lambda
- Step Functions
- EventBridge
- Establish secure, scalable, enterprise-grade infrastructure aligned with AWS best practices
- Integrate AI platforms with APIs, enterprise systems, analytical platforms, and downstream applications
- Collaborate with architects, product teams, engineering teams, and business stakeholders to drive AI innovation initiatives
- Mentor engineering teams on AI platform standards and best practices
- 10+ years of software engineering, cloud engineering, or AI platform experience
- 5+ years designing enterprise AI/ML platforms in AWS environments
- Hands-on experience with:
- Amazon Bedrock
- Bedrock AgentCore
- SageMaker
- Agentic AI workflows
- Strong experience designing and implementing:
- Retrieval-Augmented Generation (RAG)
- Vector database architectures
- LLMOps frameworks
- Experience with:
- Prompt orchestration
- Model evaluation
- AI monitoring frameworks
- Strong knowledge of:
- AWS infrastructure
- IAM/security policies
- Networking
- Observability
- Experience building scalable cloud-native applications and microservices
- Strong Python development experience
- Ability to translate business requirements into scalable AI platform solutions
- Excellent communication and stakeholder engagement skills
- Experience with Amazon Q (Developer / Business)
- Experience fine-tuning or training foundation models using SageMaker
- Experience implementing AI governance and responsible AI practices
- Knowledge of enterprise AI security and compliance frameworks
- Experience supporting educational, healthcare, financial, or regulated enterprise environments
- AWS certifications preferred
We’re a global, team of innovators. Together, we harness engineering excellence and passion to co-create meaningful solutions to complex challenges. We turn organizations into data-driven leaders that can make a positive impact on their industries and society. If you believe that innovation can bring a better tomorrow closer to today, this is the place for you.
Fostering innovation through diverse perspectivesHitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.
We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.
How we look after youWe help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.
We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.
Similar Jobs
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory



