Cloudera Logo

Cloudera

AI Solutions Architect

Reposted 2 Days Ago
In-Office or Remote
3 Locations
Senior level
In-Office or Remote
3 Locations
Senior level
As an AI Solutions Engineer, you will design and implement AI applications, optimize data pipelines, and collaborate on governance for public sector clients.
The summary above was generated by AI

Business Area:

Professional Services

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

As an AI Solutions Engineer within Cloudera’s Public Sector Consulting team, you will be the technical architect and execution lead for agencies moving from "data chaos" to "agentic autonomy." You will work directly with government organizations to design, build, and deploy mission-critical AI applications on the Cloudera Data Platform (CDP).

This is not a "theoretical" role. You will be on the front lines of Phase 2 and Phase 3 adoption journeys—helping customers clean legacy data silos, select the right model architectures, and industrialize MLOps pipelines in highly secure, often air-gapped or hybrid-cloud environments.

As the AI Solutions Engineer you will: 

1. AI Model Strategy, Selection and Implementation

  • Evaluate and select optimal model architectures (LLMs, SLMs, or traditional ML) based on mission requirements, considering tradeoffs between accuracy, latency, and cost.

  • Guide customers on "Build vs. Buy vs. Fine-tune" decisions, prioritizing open-source models (Llama, Mistral, Falcon) that can run securely within a sovereign data perimeter.

  • Experience building Agentic Workflows (AI agents that can execute API calls and multi-step tasks).

2. End-to-End Data Engineering

  • Design and implement robust data pipelines within CDP to transform "messy" legacy data into AI-ready formats.

  • Develop and optimize Vector Databases and Retrieval-Augmented Generation (RAG) architectures to ground AI responses in verified agency facts.

  • Build Data pipelines with Spark, Nifi, Kafka or other ETL tools.

3. Optimization & Performance Tuning

  • Optimize model inference for production environments using quantization, pruning, and hardware acceleration (NVIDIA GPU orchestration).

  • Implement LLMOps to monitor model performance, detect hallucination rates, and manage model versioning and drift.

4. Public Sector Advisory & Governance

  • Collaborate with the customer’s AI Center of Excellence (CoE) to establish automated guardrails for ethics, bias mitigation, and FedRAMP/IL5 compliance.

  • Translate complex technical AI concepts into mission-value briefings for GS-level stakeholders and agency leadership.

We’re excited about you if you have: (Minimum Qualifications): 

  • Experience: 5+ years in Data Engineering, Machine Learning, or Software Engineering, with at least 2 years focused on Generative AI or Deep Learning.

  • Technical Stack: Expertise in Python and deep learning frameworks (PyTorch, TensorFlow, Hugging Face).

    • Hands-on experience with Cloudera (CDP), Spark, or similar big data ecosystems.

    • Proficiency in orchestration tools like LangChain, LlamaIndex, or Haystack.

    • Experience developing visual data representations and dashboards (Django, React, or Angular)  

    • Experience using a compiled programming language, preferably one that runs on the JVM (Java, Scala, etc)

  • Data Expertise: Proven ability to build ETL/ELT pipelines and work with both SQL and NoSQL/Vector databases (e.g., Pinecone, Milvus, or PGVector).

  • Public Sector Knowledge: Understanding of government security frameworks (NIST AI RMF, FedRAMP, SRGs, STIGs).

  • Active Top Secret Security Clearance

You may also have: (Preferred Qualifications)

  • Experience fine-tuning of foundational models using techniques such as PEFT (Parameter-Efficient Fine-Tuning) and LoRA to adapt AI to domain-specific government nomenclature.

  • Experience training of specialized models on proprietary datasets while ensuring strict adherence to data privacy and sensitivity labels.

  • Experience installing and operating Cloudera Data Platform 

  • Experience installing and operating Kubernetes

  • Experience in Air-Gapped deployments and managing AI workloads in disconnected environments.

  • Advanced degree (MS or PhD) in Computer Science, Data Science, or a related field.

  • Active Counterintelligence (CI) or Full Scope (FS) Poly is highly preferred.

This role is not eligible for immigration sponsorship.

What you can expect from us:

  • Generous PTO Policy 

  • Support work life balance with Unplugged Days

  • Flexible WFH Policy 

  • Mental & Physical Wellness programs 

  • Phone and Internet Reimbursement program 

  • Access to Continued Career Development 

  • Comprehensive Benefits and Competitive Packages 

  • Paid Volunteer Time

  • Employee Resource Groups

EEO/VEVRAA

#LI-MH2

#LI-Remote

Cloudera New York, New York, USA Office

1180 Avenue of the Americas , New York, NY, United States, 10018

Cloudera New York, New York, USA Office

314-316 Dean St, New York, NY, United States, 11217

Cloudera New York, New York, USA Office

151 W 26th St, New York, NY, United States, 10001

Similar Jobs

10 Days Ago
Easy Apply
Remote
United States
Easy Apply
202K-338K Annually
Senior level
202K-338K Annually
Senior level
Cloud • Security • Software • Cybersecurity • Automation
The Principal Solutions Architect will lead technical architectures, drive AI-focused solutions, collaborate across teams, and mentor others to guide customers in maximizing GitLab’s DevSecOps platform's value.
Top Skills: AICi/CdCloud ComputingDevsecopsGitlab
18 Days Ago
Remote or Hybrid
USA
165K-220K Annually
Senior level
165K-220K Annually
Senior level
Edtech • Information Technology • Software
The AI Solutions Delivery Architect will design and implement AI-based solutions, aligning with business strategies to optimize transformation. This role includes evaluating AI platforms, leading AI deployments, and ensuring effective adoption strategies across teams.
Top Skills: AIAi Orchestration ToolsAutomation TechnologiesAWSAzureCloud PlatformsGCPLarge Language Models
2 Days Ago
Remote
US
Senior level
Senior level
Artificial Intelligence • Cybersecurity
Serve as pre-sales technical lead for federal customers, architecting and deploying AI security platform in SaaS and airgapped environments. Lead discovery workshops, scope proofs-of-value, build demos and POC AI apps, integrate SDKs/APIs, advise on AI/ML security and MLOps, deliver demos and written deliverables, and support onboarding and troubleshooting with Customer Success.
Top Skills: Aws GovcloudCi/CdDockerGgufHelmHiddenlayer Sdks And ApisHugging FaceKubernetesLlm ApisMitre AtlasMlopsNist Ai Risk Management FrameworkOnnxOpenshiftOwasp Top 10 For Llm ApplicationsPickle SerializationPrivate Container RegistriesProxmoxPythonPyTorchSafetensorsVMware

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account