Caterpillar Logo

Caterpillar

Sensor Rendering Engineer (NVIDIA Omniverse)

Posted 7 Hours Ago
Be an Early Applicant
Hybrid
Irving, TX
113K-183K Annually
Senior level
Hybrid
Irving, TX
113K-183K Annually
Senior level
Develop, validate, and optimize high-fidelity sensor simulation and rendering in NVIDIA Omniverse/Isaac Sim. Build physically based sensor models (camera, LiDAR, radar, depth), generate synthetic data, model environmental effects, optimize RTX rendering pipelines, integrate simulations with autonomy and ML workflows, and validate simulated outputs against real-world data for scalable digital twin and autonomy testing.
The summary above was generated by AI
Career Area:
Technology, Digital and Data
Job Description:
Your Work Shapes the World at Caterpillar Inc.
When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.
Help Build the Future of Caterpillar -
At Caterpillar, technology always has a purpose, which is to solve our customers' toughest challenges. Through Cat Technology, we are solving problems by building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. By combining deep domain expertise in physical systems with software, connectivity, autonomy, and AI, we deliver solutions that work in the real world-on real jobsites, at global scale.
Be Part of What's Next in Autonomous Construction Sites
Construction autonomy is one of the most complex challenges in applied AI, and at Caterpillar, advancements in physical AI, simulation, sensing, and edge computing are turning things that once felt impossible-intelligent machines operating in dynamic jobsites-into reality.
If this work motivates you, we invite you to join our team. Apply today to build the new era of construction autonomy at Caterpillar.
Role Definition
The Sensor Rendering Engineer is responsible for developing, validating, and optimizing high-fidelity sensor simulation and rendering capabilities within the NVIDIA Omniverse ecosystem. This role focuses on creating physically accurate virtual sensing environments that support robotics, autonomy, digital twin, and machine intelligence applications. The engineer collaborates closely with autonomy, perception, simulation, and visualization teams to ensure synthetic sensor data accurately represents real-world operating conditions and enables robust algorithm development, testing, and validation.
Key areas of ownership include sensor modeling, rendering pipeline support, synthetic data generation, environmental realism, performance optimization, and the integration of camera, LiDAR, radar, and other virtual sensors into large-scale simulation environments. The role requires expertise in real-time rendering technologies, RTX-based ray tracing, Omniverse Isaac Sim, USD workflows, and sensor fidelity validation against real-world data.
The ideal candidate combines strong software engineering skills with deep knowledge of computer graphics, physically based rendering, sensor physics, and simulation technologies to deliver scalable, accurate, and production-ready virtual sensing solutions.
Responsibilities
  • Develop and maintain high-fidelity sensor rendering solutions for camera, LiDAR, radar, depth, and other perception systems within NVIDIA Omniverse and Isaac Sim.
  • Design, implement, and validate physically based sensor models that accurately represent real-world sensor behavior and environmental interactions.
  • Create synthetic data generation pipelines to support machine learning, computer vision, perception, and autonomous system development.
  • Optimize RTX-based rendering workflows to balance sensor accuracy, scalability, and simulation performance.
  • Develop tools and automation frameworks for sensor configuration, calibration, testing, and data collection.
  • Collaborate with autonomy, perception, controls, and digital twin teams to define sensor requirements and validation criteria.
  • Build and maintain USD-based simulation assets, environments, and workflows that support enterprise-scale digital twin initiatives.
  • Model environmental effects such as lighting, weather, dust, fog, material properties, occlusions, and surface reflectance to improve simulation realism.
  • Correlate simulated sensor outputs with real-world datasets and field measurements to assess fidelity and drive continuous model improvements.
  • Integrate sensor simulation capabilities into virtual machine validation and autonomy testing frameworks.
  • Partner with software, graphics, and infrastructure engineers to deploy scalable simulation solutions across workstations, cloud, and high-performance computing environments.
  • Investigate emerging rendering technologies, AI-driven simulation techniques, and Omniverse platform capabilities to enhance sensor realism and productivity.
  • Establish best practices, standards, and documentation for sensor rendering, synthetic data generation, and simulation validation.
  • Provide technical leadership and mentorship in rendering technologies, sensor physics, computer graphics, and Omniverse development.
  • Support cross-functional teams in troubleshooting sensor-related simulation issues and improving virtual testing effectiveness.

Required Qualifications
  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, Robotics, Graphics Engineering, or a related technical discipline.
  • 5+ years of experience in software development, simulation, computer graphics, rendering, robotics, or autonomous systems development.
  • Strong proficiency in Python and C++ for developing simulation, rendering, and automation applications.
  • Hands-on experience with NVIDIA Omniverse, Isaac Sim, USD (Universal Scene Description), and RTX-based rendering technologies.
  • Deep understanding of physically based rendering (PBR), ray tracing, path tracing, and real-time graphics pipelines.
  • Experience modeling and simulating perception sensors, including cameras, LiDAR, radar, depth sensors, and inertial measurement systems.
  • Knowledge of sensor physics, sensor calibration, noise modeling, and environmental effects impacting perception systems.
  • Experience developing synthetic data generation solutions for machine learning, computer vision, or autonomous systems applications.
  • Strong understanding of 3D geometry, optics, image formation, photogrammetry, and computer vision fundamentals.
  • Experience working with large-scale simulation environments and digital twin technologies.
  • Familiarity with GPU programming concepts, rendering optimization, and performance analysis techniques.
  • Experience integrating simulation platforms with robotics, autonomy, perception, or machine learning workflows.
  • Proficiency with source control systems, CI/CD pipelines, and modern software engineering practices.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Demonstrated ability to work effectively in cross-functional teams involving software, autonomy, controls, perception, and simulation engineers.
  • Excellent verbal and written communication skills, including the ability to communicate complex technical concepts to diverse audiences.

Preferred Qualifications
  • Master's or Ph.D. in Computer Graphics, Robotics, Computer Vision, Artificial Intelligence, or a related field.
  • Experience developing digital twins for industrial, construction, mining, agricultural, or autonomous vehicle applications.
  • Familiarity with ROS/ROS2, NVIDIA Cosmos, Isaac Lab, OpenUSD, and synthetic data frameworks.
  • Experience validating virtual sensor models against real-world sensor datasets and field measurements.
  • Knowledge of machine perception, sensor fusion, localization, mapping, and autonomous navigation systems.
  • Experience with cloud-based simulation infrastructure and scalable compute environments.
  • Demonstrated technical leadership and mentoring experience.
  • Experience supporting end-to-end virtual validation programs for autonomous or intelligent machines.

Additional Details:
  • This position requires the candidate to work full-time at the Irving, TX office (Dallas)
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available with this position.

Summary Pay Range:
$112,710.00 - $183,140.00
Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.
Benefits:
Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.
  • Medical, dental, and vision benefits*
  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
  • 401(k) savings plans*
  • Health Savings Account (HSA)*
  • Flexible Spending Accounts (FSAs)*
  • Health Lifestyle Programs*
  • Employee Assistance Program*
  • Voluntary Benefits and Employee Discounts*
  • Career Development*
  • Incentive bonus*
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement

* These benefits also apply to part-time employees
This position requires working onsite five days a week.
Relocation is available for this position.
Visa sponsorship is available for eligible applicants.
Posting Dates:
Any offer of employment is conditioned upon the successful completion of a drug screen.
Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.
Not ready to apply? Join our Talent Community.

Similar Jobs at Caterpillar

7 Hours Ago
Hybrid
148K-222K Annually
Senior level
148K-222K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial
Lead strategy, architecture, and execution for next-generation connectivity platforms across satellite, cellular, edge, IoT, telematics, and cloud. Define roadmap, influence architecture, coordinate cross-functional teams, manage dependencies, and build partnerships with carriers, vendors, and cloud providers. Drive data pipelines, platform health, and platform adoption while communicating status and strategic recommendations to senior leadership.
Top Skills: 4G Lte5GCloud PlatformsCloud-NativeData PipelinesDistributed SystemsEdge ComputingEvent-Driven SystemsIndustrial IotLte-MMesh NetworkingNb-IotPrivate 5GPrivate LteSatellite CommunicationsStarlinkStreaming ArchitecturesTelematics PlatformsTelemetry PlatformsWi-Fi
7 Hours Ago
Hybrid
148K-240K Annually
Senior level
148K-240K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial
Lead design and development of the digital twin and simulation software stack. Mentor engineers, define processes and standards, drive architecture and CI/CD, translate business requirements to implementations, collaborate with robotics and cross-functional teams, and guide hiring and agile practices.
Top Skills: AngularAWSAzureCi/CdClaudeCopilotCSSCursorEslintFirebaseGisGCPGraphQLHTMLJavaJavaScriptNextjsNode.jsNoSQLNvidia OmniverseOpenlayersPlayrightPythonReactSQLTerrain MappingWebpack
7 Hours Ago
Hybrid
113K-183K Annually
Senior level
113K-183K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial
Design and build scalable, scenario-driven simulation platforms in NVIDIA Omniverse to evaluate autonomous construction systems. Develop C++/Python code, multi-threaded/networked simulation components, containerized cloud workloads, scenario tooling, and validation workflows in collaboration with autonomy, controls, and field teams.
Top Skills: Amazon S3Aws BatchC++DockerNvidia OmniverseOmniverse CodeOmniverse KitPhysxPythonUsd

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account