Lead enterprise AI architecture, strategy, and technical vision across products and business segments. Design and deploy scalable GenAI applications using LLMs, agent workflows, RAG, vector databases, NLP, and computer vision. Establish standards for AI security, monitoring, cost management, responsible AI, and documentation. Partner with product, data science, engineering, executives, customers, and vendors while mentoring teams and driving reusable AI platforms and services.
Job Description SummaryAs a Senior Principal AI Software Engineer, you will establish a technical vision, oversee and lead AI architecture, AI platform and identify reusable foundational services to accelerate AI application development. Using your AI expertise, competitive intelligence and customer knowledge to conceive, evaluate, and design Industrial AI Service offerings.
Apply a strategic understanding of the timing and rationale of AI design choices and help decide upon critical design areas early in the development process. You’ll drive new ways of thinking, across groups within business units, to improve quality, engineering productivity and responsiveness to feedback and changing priorities.
You’ll integrate LLMs, agent workflows, NLP, computer vision, RAG, and predictive analytics to build secure, high-availability and cost efficient AI based solutions.
We will count on you to tailor communication to a variety of audiences and perspectives and anticipate issues to prevent conflict. We will depend on you to choose appropriate internal or external technologies, incorporate research, and create designs that are reused across teams. We’ll count on you being an excellent judge of AI practices that work well.
You’ll partner with product, data science, engineering leaders, business executives, and CIOs. You’ll mentor teams, and raise standards in AI development, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.Job Description
#LI-Remote - This is a remote position
Apply a strategic understanding of the timing and rationale of AI design choices and help decide upon critical design areas early in the development process. You’ll drive new ways of thinking, across groups within business units, to improve quality, engineering productivity and responsiveness to feedback and changing priorities.
You’ll integrate LLMs, agent workflows, NLP, computer vision, RAG, and predictive analytics to build secure, high-availability and cost efficient AI based solutions.
We will count on you to tailor communication to a variety of audiences and perspectives and anticipate issues to prevent conflict. We will depend on you to choose appropriate internal or external technologies, incorporate research, and create designs that are reused across teams. We’ll count on you being an excellent judge of AI practices that work well.
You’ll partner with product, data science, engineering leaders, business executives, and CIOs. You’ll mentor teams, and raise standards in AI development, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.Job Description
Responsibilities
- Influence AI strategy, direction and policy.
- Oversee and lead all AI architecture and technical vision across products and solutions.
- Lead cross-team initiatives with product and data science.
- Lead architecture and support implementation on large scale AI program across business segments
- Design agent workflows, RAG architecture and develop approaches to develop custom LLMs with specific domain data.
- Represent GE Vernova as a subject-matter-expert with partners, vendors and customers.
- Apply your knowledge of AI trends to develop new practices.
- Review business requirements and help the team understand trade offs.
- Establish AI cost management, monitoring, and security standards.
REQUIRED QUALIFICATIONS
- Bachelor’s degree in Computer Science, Computer Engineering, or related technical field
- Extensively demonstrated programming experience in a relevant language using modern languages (Python preferred, Java, Node.js or Go)
- Proven experience designing and deploying production GenAI applications that use large language models at scale.
- Experience with vector databases (e.g. pgvector, Milvus, Pinecone) and advanced embedding model optimisation in production applications
- Expertise with multiple LLM providers, advanced AI orchestration frameworks (LangChain, LlamaIndex, custom frameworks), Eval frameworks and creating custom agents.
- Extensive experience leading technical teams, creating technical strategy, and providing technical mentorship
- Expert-level experience with cloud platforms (i.e AWS, GCP, or Azure) and advanced containerisation (EKS)
- Familiarity with best practices for responsible AI, including data privacy, bias mitigation, and model monitoring.
- Systematic problem-solving approach, strong communication skills, a sense of ownership and drive.
PREFERRED QUALIFICATIONS
- Extensively demonstrated experience of full software development lifecycle experience, including architecture design, technical leadership, and large-scale system optimization
- Advanced understanding of enterprise RAG architectures, semantic search optimisation, and conversation memory management at massive scale
- Experience with multi-modal AI integration, model fine-tuning, and deployment of custom AI models
- Experience with AI observability tools, cost optimisation strategies for different AI application types, and performance monitoring at enterprise scale
- Experience with cross-organisational collaboration and communicating technology strategy across a variety of stakeholders.
- Experience with technical strategy development and technology roadmap planning
Relocation Assistance Provided: Yes
GE Vernova Trevose, Pennsylvania, USA Office
Trevose, United States, 0
Similar Jobs
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Build and operate production-quality AI framework, runtime, benchmarking, performance, automation, observability, and developer-tooling systems. Optimize large language model training and inference across GPUs and Microsoft hardware, diagnose cross-stack reliability and performance issues, and improve model onboarding, hardware utilization, Azure efficiency, and deployment speed. Senior engineers own major components and projects; Principal engineers define technical direction, architecture, and multi-release strategy while leading cross-team initiatives and mentoring technical leaders.
Top Skills:
Amd GpusAzureC++CudaNvidia GpusOnnx RuntimePythonPyTorchRocmTensorFlowTriton
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Develop and operate production AI framework components, runtimes, benchmarking systems, performance tools, and integrations. Benchmark and optimize large language model training and inference across GPUs and Microsoft hardware, build automation and observability, investigate cross-stack performance and reliability issues, and deliver scalable platform improvements. Principal engineers additionally set technical direction, lead multi-team initiatives, define architectures, and mentor technical leaders.
Top Skills:
Ai FrameworksAi RuntimesAzureC++CudaGpusOnnx RuntimePythonPyTorchRocmTensorFlowTriton
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
Develop and optimize GPU kernels, compilers, runtimes, and distributed inference systems for large language model serving. Improve latency, throughput, reliability, and hardware efficiency through profiling and low-level performance optimization. Integrate scalable improvements into production systems, collaborate across model, infrastructure, compiler, and hardware teams, and mentor engineers. Principal-level contributors additionally lead cross-stack initiatives and create reusable performance capabilities across models and hardware generations.
Top Skills:
Amd GpusC++CompilersDistributed Inference SystemsGpu KernelsGpu ProgrammingLlm InferenceNvidia GpusPythonRuntimesSglangVllm
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
