Design and deploy production-grade AI systems using prompt engineering, LLM agents, RAG pipelines, vector search, tool calling, and orchestration frameworks. Build automated evaluation, regression testing, CI/CD, observability, and guardrail systems. Monitor model quality, semantic drift, token usage, cost, and latency while collaborating with product, data science, and software engineering teams.
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
As an AI Engineer, you will design, develop, and optimize advanced AI interactions to power production-grade software applications. You will move beyond basic prompt drafting to build robust, scalable, and reliable AI systems utilizing state-of-the-art Large Language Models (LLMs). Your role is critical in orchestrating autonomous AI agents, implementing Retrieval-Augmented Generation (RAG) pipelines, and establishing rigorous testing and observability frameworks. You will bridge the gap between complex business logic and machine intelligence, ensuring high-quality, safe, and deterministic AI behaviors.
What You Will Do:
Prompt Architecture & Tuning
Agentic Workflows & RAG Systems
Testing, Evaluation & Observability
Collaboration & Continuous Innovation
What You Have:
Top Candidates Will Have
Additional Info:
• The required location for this role is East Peoria-IL, Irving-TX
About Caterpillar -
For more than a century, Caterpillar has helped build a better, more sustainable world. With 2025 sales and revenues of $67.6 billion, Caterpillar Inc. is shaping the future as the world's leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives. Backed by one of the largest independent global dealer networks and financing services through Cat Financial, the company's primary business segments: Power & Energy, Construction Industries and Resource Industries are solving customers' toughest challenges through commercial excellence and advanced technology, driven by a highly skilled, dedicated global team. Learn more at www.caterpillar.com.
Summary Pay Range:
$97,530.00 - $158,480.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Visa Sponsorship is not available for this position.
Posting Dates:
October 27, 2026 - November 8, 2026
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
As an AI Engineer, you will design, develop, and optimize advanced AI interactions to power production-grade software applications. You will move beyond basic prompt drafting to build robust, scalable, and reliable AI systems utilizing state-of-the-art Large Language Models (LLMs). Your role is critical in orchestrating autonomous AI agents, implementing Retrieval-Augmented Generation (RAG) pipelines, and establishing rigorous testing and observability frameworks. You will bridge the gap between complex business logic and machine intelligence, ensuring high-quality, safe, and deterministic AI behaviors.
What You Will Do:
Prompt Architecture & Tuning
- Design Advanced Prompts: Architect, version, and refine highly effective system, contextual, and dynamic prompts using advanced techniques (e.g., Chain-of-Thought, Tree-of-Thoughts, ReAct, Few-Shot learning).
- Mitigate Risks: Minimize model hallucinations, jailbreaking, and prompt injections through programmatic guardrails and robust adversarial prompting strategies.
- Model Agnostic Tuning: Adapt, benchmark, and fine-tune prompt structures across diverse open-source and proprietary frontier models.
Agentic Workflows & RAG Systems
- Build AI Agents: Design and orchestrate multi-agent systems and multi-step reasoning workflows using frameworks like LangGraph, LangChain.
- Optimize RAG Pipelines: Integrate and fine-tune Retrieval-Augmented Generation architectures, managing semantic search, chunking strategies, embedding models, and vector database queries.
- Tool Execution: Implement precise function-calling and tool-use prompts enabling LLMs to interact reliably with external APIs, databases, and legacy codebases.
Testing, Evaluation & Observability
- Build automated testing suites using RAGAS and Evals frameworks to assess RAG accuracy and enable continuous validation and benchmarking of Retrieval-Augmented Generation outputs across datasets and Models .
- Agent Testing: Build automated regression testing suites and CI/CD pipelines to validate prompt stability, agent trajectory correctness, and tool-calling accuracy.
- Implement LLM Observability: Set up production monitoring and observability systems using platforms like Azure Application insights, Microsoft Foundry.
- Monitor Metrics: Track, analyze, and optimize production runtime metrics including semantic drift, token usage, cost efficiencies, and end-to-end latency.
Collaboration & Continuous Innovation
- Cross-Functional Delivery: Work alongside Product Managers, Data Scientists, and Software Engineers to translate commercial requirements into deterministic AI capabilities.
- Technology Scouting: Keep pace with rapid weekly advancements in LLM capabilities, evaluation frameworks, and orchestration libraries to sustain a competitive edge.
What You Have:
- Core Prompt Engineering: Expert-level mastery of structured prompt formats (XML, JSON wrappers), system-level steering, and context-window optimization.
- Production Programming: High proficiency in Python or TypeScript for constructing backend AI logic, processing asynchronous data streams, and handling API integrations.
- Orchestration Frameworks: Hands-on experience building apps using LangChain, LangGraph, native SDKs.
- Vector Infrastructure: Solid experience working with vector databases (e.g., Azure AI Search, AWS Open Search) and hybrid search retrieval methods.
- Data & ML Fundamentals: Strong capabilities in data manipulation (Pandas, NumPy), data cleaning, token handling, and foundational understanding of NLP transformers.
Top Candidates Will Have
- AI Observability Stacks: Prior implementation of Application Insights, OpenLLMetry, or custom evaluation/guardrail layers.
- Machine Learning Systems: Knowledge of deep learning architectures, fine-tuning frameworks (QLoRA, PEFT), and platforms like Hugging Face, PyTorch, or TensorFlow.
- Cloud Infrastructure: Experience deploying containerized AI microservices using Docker, Kubernetes, AWS, or GCP.
- Education: Bachelor's or master's degree in computer science, Data Science, Artificial Intelligence, Computational Linguistics, Mathematics, or a highly technical discipline.
- Experience: 2+ years of dedicated professional experience developing production software integrated with GenAI/LLM pipelines.
- Track Record: Proven portfolio demonstrating successfully deployed RAG systems or operational AI agents in commercial environments.
Additional Info:
• The required location for this role is East Peoria-IL, Irving-TX
About Caterpillar -
For more than a century, Caterpillar has helped build a better, more sustainable world. With 2025 sales and revenues of $67.6 billion, Caterpillar Inc. is shaping the future as the world's leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives. Backed by one of the largest independent global dealer networks and financing services through Cat Financial, the company's primary business segments: Power & Energy, Construction Industries and Resource Industries are solving customers' toughest challenges through commercial excellence and advanced technology, driven by a highly skilled, dedicated global team. Learn more at www.caterpillar.com.
Summary Pay Range:
$97,530.00 - $158,480.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
- Medical, dental, and vision benefits*
- Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
- 401(k) savings plans*
- Health Savings Account (HSA)*
- Flexible Spending Accounts (FSAs)*
- Health Lifestyle Programs*
- Employee Assistance Program*
- Voluntary Benefits and Employee Discounts*
- Career Development*
- Incentive bonus*
- Disability benefits
- Life Insurance
- Parental leave
- Adoption benefits
- Tuition Reimbursement
* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Visa Sponsorship is not available for this position.
Posting Dates:
October 27, 2026 - November 8, 2026
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.
Similar Jobs at Caterpillar
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Design, build, optimize, and maintain scalable real-time and batch data pipelines, microservices, and cloud-based ingestion systems. Develop AWS-based data workflows, integrate APIs and databases, implement automated testing and validation, and monitor distributed systems for reliability and data quality. Translate business requirements into scalable system designs while supporting CI Autonomy and collaborating in an agile environment.
Top Skills:
Amazon CloudwatchAmazon DynamodbAmazon EventbridgeAmazon KinesisAmazon S3AWSAzure DevopsCi/CdJavaJenkinsJIRAOauth 2.0PythonSQL
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Develops embedded autonomy software for machine collision mitigation and avoidance systems. Responsibilities include C++ development on embedded Linux, camera and radar processing, system requirements, sensor and hardware integration, calibration, HIL validation, Python automation, troubleshooting, safety compliance, and verification planning. The role also provides technical mentorship and coordinates with suppliers, hardware teams, and testing organizations. Full-time onsite work in Mossville, Illinois is required, with up to 25% travel.
Top Skills:
C++Camera ProcessingCanCanalyzerCanapeCanoeComputer VisionCudaEmbedded LinuxEtas IncaEthernetGtestHilMachine LearningMatlabNvidia JetsonNvidia ThorPythonRadar ProcessingRobotics MiddlewareSilSimulinkTensorrt
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Develop Python data pipelines and business data objects for digital applications. Design and implement software solutions, CI/CD pipelines, source-to-target mappings, and automated testing. Resolve complex technical problems, interpret engineering requirements, uphold software quality standards, and promote team improvement. Work with cloud services, Snowflake, Git, and AI coding tools in a large-team environment.
Top Skills:
Amazon CloudwatchAmazon DynamodbAmazon EventbridgeAmazon KinesisAmazon RdsAmazon S3Amazon SagemakerAws CloudformationAws FargateAws IamAws LambdaAzure DevopsCi/CdClaude CodeGitGithub ActionsGithub CopilotJenkinsPythonSnowflake
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

