Leads complex enterprise AI consulting engagements, designing and implementing generative AI, agentic AI, MLOps, model-serving, and infrastructure solutions. Advises executives, leads architecture reviews and technical governance, supports sales pursuits, develops standards and reusable offerings, and mentors technical teams. The role requires strong expertise in AI architecture, NVIDIA technologies, Python, Kubernetes, GPU infrastructure, security, operations, and client-facing consulting.
Description
The Principal AI Software Consulting Engineer ensures advanced artificial intelligence, machine learning, and MLOps solutions are designed and implemented to the client's satisfaction and approval. This client-facing role makes innovative contributions to solution design and implementation based on an understanding of AI software architecture, accelerated infrastructure, hardware-software tradeoffs, security, operations, and business outcomes. The position provides oversight and project guidance, leads complex customer engagements, advises executives and stakeholders, and helps mature the AI Factory practice through standards, repeatable offerings, reference architectures, and technical leadership.
What you will do:
* Define project strategies and technical options that balance customer goals, architectural requirements, delivery risk, operational readiness, and financial constraints.
* Provide leadership and expert advice on enterprise AI architecture, generative AI, agentic systems, MLOps, model serving, integration, governance, and accelerated infrastructure.
* Regularly interface with client technical and business executives, project leadership, partners, and internal stakeholders to communicate complex ideas, anticipate objections, and align expectations.
* Lead architecture reviews, technical governance, escalation management, solution validation, and quality oversight for complex AI engagements.
* Support strategic sales pursuits through discovery, solution shaping, proposals, SOWs, ROMs, LOEs, presentations, and executive workshops.
* Develop standards, best practices, training, and technical guidance that equip teams for consistent and successful AI software implementations.
What we expect of you:
* Bachelor's degree and 6 years of hands-on software, data, infrastructure, or AI solution experience, including three years of consulting experience with large enterprises and cross-functional projects OR 10 years of hands-on software, data, infrastructure, or AI solution experience, including three years of consulting experience with large enterprises and cross-functional projects
* Provides leadership and expert advice on AI software architecture and solution design to clients, the Hybrid Infrastructure team, and extended CDW teams.
* Recognized by clients, peers, and management as a subject matter expert who remains current in AI technologies, enterprise architecture, and industry transformation.
* Maintains client relationships as a trusted technical advisor and serves as a focal point for communication among consultants, partners, and client stakeholders.
* Demonstrated experience architecting enterprise generative AI, agentic AI, RAG, model-serving, MLOps, fine-tuning, or distributed inference solutions.
* Advanced knowledge of NVIDIA NIM, NVIDIA Blueprints, NVIDIA AI Enterprise, Python, APIs, containers, Kubernetes, CI/CD, AI observability, evaluation, security, and production operations.
* Demonstrated understanding of GPU infrastructure and the hardware software tradeoffs that affect AI performance, scalability, reliability, and cost.
* Proven ability to research advanced and complex technology solutions, evaluate alternatives, make recommendations, and present materials that meet enterprise client needs.
* Excellent written, presentation, and verbal communication skills, including demonstrated experience presenting technology recommendations from a business perspective.
* Demonstrated ability to act calmly and productively when confronted with change, ambiguity, and risk and to engage appropriate leadership proactively.
* Ability and willingness to work beyond regularly scheduled shifts, select weekends, or overtime as necessary to meet operational needs.
* Ability and willingness to travel as needed to CDW locations or client sites.
* Valid U.S. driver's license.
* Practice Leadership and Development
* Define and maintain AI Factory software engineering standards, delivery methodologies, architecture patterns, and quality practices.
* Develop and mature repeatable AI Factory service offerings, accelerators, deployment frameworks, and reference architectures.
* Evaluate emerging AI technologies, tools, and partner ecosystems to guide technical direction and investment priorities.
* Drive delivery consistency, quality, and scalability across AI software engineering engagements.
* Mentor consulting engineers, senior engineers, architects, and technical leads and collaborate on training and enablement plans.
* Partner with sales, architecture, delivery, and practice leadership to shape service strategy and go-to-market offerings.
* Represent CDW as a technical thought leader with strategic clients, partners, and industry communities.
* Experience shaping enterprise AI strategy, operating models, governance, application modernization, or large-scale AI transformation programs, a plus.
* Experience guiding partner alignment and technical strategy across NVIDIA, Microsoft, data, security, and software ecosystems, a plus.
* Experience developing consulting offerings, intellectual property, architecture standards, technical enablement, or reusable delivery of assets, a plus.
* Preferred NVIDIA certifications aligned to the role include NVIDIA-Certified Professional Generative AI LLMs (NCP-GENL) and NVIDIA-Certified Professional Agentic AI (NCP-AAI), a plus. Pay range: $164,000.00 - $240,800.00 depending on experience and skill set Annual bonus target of 10% subject to terms and conditions of plan Benefits overview: [https://cdw.benefit-info.com/](https://cdw.benefit-info.com/) Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
The Principal AI Software Consulting Engineer ensures advanced artificial intelligence, machine learning, and MLOps solutions are designed and implemented to the client's satisfaction and approval. This client-facing role makes innovative contributions to solution design and implementation based on an understanding of AI software architecture, accelerated infrastructure, hardware-software tradeoffs, security, operations, and business outcomes. The position provides oversight and project guidance, leads complex customer engagements, advises executives and stakeholders, and helps mature the AI Factory practice through standards, repeatable offerings, reference architectures, and technical leadership.
What you will do:
* Define project strategies and technical options that balance customer goals, architectural requirements, delivery risk, operational readiness, and financial constraints.
* Provide leadership and expert advice on enterprise AI architecture, generative AI, agentic systems, MLOps, model serving, integration, governance, and accelerated infrastructure.
* Regularly interface with client technical and business executives, project leadership, partners, and internal stakeholders to communicate complex ideas, anticipate objections, and align expectations.
* Lead architecture reviews, technical governance, escalation management, solution validation, and quality oversight for complex AI engagements.
* Support strategic sales pursuits through discovery, solution shaping, proposals, SOWs, ROMs, LOEs, presentations, and executive workshops.
* Develop standards, best practices, training, and technical guidance that equip teams for consistent and successful AI software implementations.
What we expect of you:
* Bachelor's degree and 6 years of hands-on software, data, infrastructure, or AI solution experience, including three years of consulting experience with large enterprises and cross-functional projects OR 10 years of hands-on software, data, infrastructure, or AI solution experience, including three years of consulting experience with large enterprises and cross-functional projects
* Provides leadership and expert advice on AI software architecture and solution design to clients, the Hybrid Infrastructure team, and extended CDW teams.
* Recognized by clients, peers, and management as a subject matter expert who remains current in AI technologies, enterprise architecture, and industry transformation.
* Maintains client relationships as a trusted technical advisor and serves as a focal point for communication among consultants, partners, and client stakeholders.
* Demonstrated experience architecting enterprise generative AI, agentic AI, RAG, model-serving, MLOps, fine-tuning, or distributed inference solutions.
* Advanced knowledge of NVIDIA NIM, NVIDIA Blueprints, NVIDIA AI Enterprise, Python, APIs, containers, Kubernetes, CI/CD, AI observability, evaluation, security, and production operations.
* Demonstrated understanding of GPU infrastructure and the hardware software tradeoffs that affect AI performance, scalability, reliability, and cost.
* Proven ability to research advanced and complex technology solutions, evaluate alternatives, make recommendations, and present materials that meet enterprise client needs.
* Excellent written, presentation, and verbal communication skills, including demonstrated experience presenting technology recommendations from a business perspective.
* Demonstrated ability to act calmly and productively when confronted with change, ambiguity, and risk and to engage appropriate leadership proactively.
* Ability and willingness to work beyond regularly scheduled shifts, select weekends, or overtime as necessary to meet operational needs.
* Ability and willingness to travel as needed to CDW locations or client sites.
* Valid U.S. driver's license.
* Practice Leadership and Development
* Define and maintain AI Factory software engineering standards, delivery methodologies, architecture patterns, and quality practices.
* Develop and mature repeatable AI Factory service offerings, accelerators, deployment frameworks, and reference architectures.
* Evaluate emerging AI technologies, tools, and partner ecosystems to guide technical direction and investment priorities.
* Drive delivery consistency, quality, and scalability across AI software engineering engagements.
* Mentor consulting engineers, senior engineers, architects, and technical leads and collaborate on training and enablement plans.
* Partner with sales, architecture, delivery, and practice leadership to shape service strategy and go-to-market offerings.
* Represent CDW as a technical thought leader with strategic clients, partners, and industry communities.
* Experience shaping enterprise AI strategy, operating models, governance, application modernization, or large-scale AI transformation programs, a plus.
* Experience guiding partner alignment and technical strategy across NVIDIA, Microsoft, data, security, and software ecosystems, a plus.
* Experience developing consulting offerings, intellectual property, architecture standards, technical enablement, or reusable delivery of assets, a plus.
* Preferred NVIDIA certifications aligned to the role include NVIDIA-Certified Professional Generative AI LLMs (NCP-GENL) and NVIDIA-Certified Professional Agentic AI (NCP-AAI), a plus. Pay range: $164,000.00 - $240,800.00 depending on experience and skill set Annual bonus target of 10% subject to terms and conditions of plan Benefits overview: [https://cdw.benefit-info.com/](https://cdw.benefit-info.com/) Salary ranges may be subject to geographic differentials
* CDW is committed to being an AI-fluent organization
* We're looking for people who bring curiosity, a learner's mindset, and a willingness to engage with ever-evolving technology and tools. We value adopting AI as a partner, openness to experimentation, and a shared interest in learning together on AI. Our goal is to create a culture where AI enhances- not replaces- human creativity and decision-making. You don't need to be an expert today; what matters is your readiness to explore, adapt, and grow with us as we integrate AI responsibly and effectively into our work.Additionally, CDW is committed to fostering an equitable, transparent, and respectful hiring process for all applicants. During our application process, our goal is to understand your experience, strengths, skills, and qualifications. As an AI forward company, we see AI not just as a tool, but as a catalyst for new ways of thinking, creating, and communicating. We encourage candidates to embrace an AI mindset, one that's curious, adaptive, and ready to explore what's possible. We welcome thoughtful use of AI to expand your perspective and elevate how you share your story, while ensuring your application remains rooted in your own background, judgment, and voice.
* About Us
* CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what's possible through technology. What makes CDW different isn't just what we do- it's how we do it. At CDW we act as one- building trust, speaking candidly, and working together to achieve more. We play to win- focusing on what matters most and delivering for our customers. And we think forward- staying curious, moving fast, and continuously learning. We believe meaningful work happens when people feel supported, heard, and empowered to contribute. That's why we think of ourselves as coworkers, not just employees- working together to solve complex challenges and deliver real impact for our customers and communities. As a full-stack, full-lifecycle technology partner, CDW brings deep expertise, strong relationships, and broad industry knowledge to help turn ideas into outcomes. When you join CDW, you become part of a collaborative environment where your work matters, your growth is supported, and your contributions help shape what's next. Together, we deliver the full promise of what technology can do.
* Together, we Make Amazing Happen.
* CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.
Similar Jobs at CDW
Information Technology
Leads the design, integration, and delivery of production-grade AI, generative AI, agentic AI, and MLOps solutions for clients. Serves as technical lead, translates requirements into scalable architectures, mentors engineers, manages technical risks and timelines, supports sales proposals, and presents recommendations to stakeholders. Responsibilities include application integration, security, observability, evaluation, model serving, documentation, testing, and operational readiness.
Top Skills:
Agentic AiAi GatewaysAPIsAutomated TestingCi/CdContainersEvaluation FrameworksGitGpu InfrastructureHugging FaceKubernetesMlopsModel Lifecycle PlatformsModel-Serving PlatformsNvidia BlueprintsNvidia NimObservability FrameworksPythonPyTorchRetrieval-Augmented GenerationVector DatabasesVector Search
Information Technology
Leads ServiceNow CSM and TPSM process design for customer service, client onboarding, managed services, account management, and technology service delivery. Facilitates discovery and future-state workshops, translates requirements into functional designs and user stories, defines onboarding workflows, and aligns stakeholders with ServiceNow best practices. Provides functional leadership across customer management, case handling, entitlements, service relationships, integrations, CSDM, and ITSM. Supports prioritization, UAT, business readiness, roadmap decisions, and traceability across a large enterprise transformation.
Top Skills:
Agent WorkspaceCmdbCsdmCustomer Service Management (Csm)IntegrationhubItomItsmService Portfolio Management (Spm)ServicenowTechnology Provider Service Management (Tpsm)
Information Technology
Leads the Customer Success and Renewals organization, defining strategy for adoption, retention, forecasting, expansion, and customer outcomes. Manages financial and operational KPIs, renewal performance, AI and digital adoption, customer segmentation, cross-functional partnerships, and talent development. Serves as a subject matter expert and executive-level leader while coaching managers and teams, improving processes, and aligning sales, finance, partners, and customer success activities.
Top Skills:
Artificial IntelligenceCoworkMicrosoft CopilotSection Coach
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
