SemiAnalysis Logo

SemiAnalysis

Technical Consultant

Reposted 15 Days Ago
Be an Early Applicant
Hybrid
New York, NY, USA
Entry level
Hybrid
New York, NY, USA
Entry level
Lead technical consulting and due diligence engagements for AI infrastructure and GPU cloud providers. Evaluate architecture, benchmark performance, reliability, scalability, storage, networking, and operational usability. Translate technical findings into client recommendations and investment insights, develop benchmarking and total-cost-of-ownership methodologies, author research reports, and build relationships across hyperscalers, AI labs, accelerator vendors, investors, and infrastructure companies.
The summary above was generated by AI

Employment Type: Full-Time
Work Setting: Onsite/Remote
Work Location: New York/San Francisco/Remote
Work Hours: Office Hours
Find out more here: https://semianalysis.com

About SemiAnalysis

SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. Our in-depth coverage spans the entire supply chain, from semiconductor fabrication processes to cutting-edge AI Models, software, and infrastructure. We are recognized as the leading authority on the semiconductor supply chain, with the highest concentration of industry experts within one team, and a deep-rooted passion for delving into the intricacies.
We’re a global team of over 50 analysts, each with extensive networks across the semiconductor supply chain and AI ecosystem, publishing industry shaping articles while participating in 40+ conferences annually.
Our newsletter reaches more than 200,000 subscribers worldwide, including senior management and c-suite leaders at the leading semiconductor and AI companies.
We also offer three core products:

  • Industry Models – we develop and publish industry models on accelerator shipments, datacentre demand and supply, GPU total cost of ownership, and more. We work with hyperscalers, neoclouds, many of the world’s largest hedge funds, and government agencies.

  • Core Research – our public equity markets product, geared towards financial investors, distils our deep technical research and knowledge into key insights on technology and product trends.

  • Consulting and Technical Due Diligence – We conduct custom research and project work to guide key strategic and investment decisions for the largest private equity funds, leading venture capital firms, companies across the AI ecosystem, and government agencies.

Position Overview
We are seeking a Technical Consultant to join our team working on ClusterMAX™, the industry standard GPU Cloud rating system. We are hiring at all experience levels with competitive compensation.

Responsibilities

  • Lead ClusterMAX™ consulting engagements, including technical due diligence projects related to neoclouds, AI accelerators, AI infrastructure, AI labs, and adjacent ecosystems.

  • Translate ClusterMAX™ benchmarking and testing insights into actionable recommendations and investment decisions for clients.

  • Contribute to the development of next-generation benchmarking methodologies, TCO analysis frameworks, and future ClusterMAX™ research initiatives.

  • Collaborate with executives, engineers, and technical teams across major neocloud providers, including Amazon Web Services, Microsoft Azure, Google Cloud, Oracle, CoreWeave, Nebius, Crusoe, Lambda, and Together.

  • Build and maintain relationships with AI accelerator manufacturers, OEMs, and ecosystem partners, including NVIDIA, AMD, Intel, Google, Amazon, Cerebras, Groq, Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Cisco.

  • Strengthen relationships with AI labs, investors, startups, and technical communities to better understand industry requirements and operational challenges.

  • Author detailed technical research reports evaluating architecture design, benchmark performance, reliability, scalability, and operational usability of neocloud and AI infrastructure providers.

  • Stay informed on emerging trends and technologies through participation in major industry conferences such as NeurIPS, MLSys, NVIDIA GTC, OCP, SC, and Hot Chips.

Requirements

  • Strong understanding of ML frameworks such as PyTorch and JAX.

  • Familiarity with GPU and TPU cluster environments running orchestration platforms such as Kubernetes or Slurm.

  • Understanding of distributed storage technologies including Weka, VAST, Lustre, and S3-based storage systems.

  • Knowledge of high-performance networking technologies such as InfiniBand and RoCEv2.

  • Understanding of ML systems benchmarking and performance testing tools, including GEMMs, nccl-tests, vLLM, sglang, fio, TorchTitan, Megatron, and related frameworks.

  • Experience working at a hyperscaler, neocloud provider, server OEM, AI accelerator company, or large-scale AI infrastructure environment is preferred.

  • Ability to work proactively and independently within a globally distributed team environment.

  • Strong analytical, technical communication, and problem-solving capabilities.

Growth Areas

  • Develop deep expertise in AI infrastructure, neocloud ecosystems, accelerators, and large-scale ML system benchmarking.

  • Gain exposure to technical due diligence and investment decision-making processes across frontier AI and semiconductor markets.

  • Build relationships with leading hyperscalers, AI labs, infrastructure startups, accelerator vendors, and institutional investors.

  • Contribute to industry-recognized benchmarking methodologies and technical research publications.

  • Expand technical knowledge across distributed systems, networking, storage, AI infrastructure, and performance optimization.

  • Work directly with globally recognized companies shaping the future of AI compute and infrastructure.

  • Increase visibility within the AI and semiconductor ecosystem through conferences, technical collaborations, and published research.

    SemiAnalysis LLC participates in the E-Verify program to confirm the employment eligibility of all newly hired employees. For more information, visit e-verify.gov.

    • E-Verify Poster: https://www.everify.gov/sites/default/files/everify/posters/EVerifyParticipationPoster.pdf

    • Right to Work Poster: https://www.justice.gov/crt/case-document/file/1133936/dl?inline=

Similar Jobs

Yesterday
Hybrid
New York, NY, USA
37-64 Hourly
Junior
37-64 Hourly
Junior
Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Analyze advertiser campaigns and Snap’s ad platform performance to provide technical solutions for delivery, measurement, optimization, and revenue growth. Support advertisers, agencies, and Sales teams through data-driven insights, troubleshooting, onboarding, training, and strategy planning. Communicate technical concepts clearly, maintain response quality and operational KPIs, and use tools such as Looker or Tableau to visualize campaign performance.
Top Skills: APIsCSS3HTML5JavaScriptLookerMobile Measurement PartnersProgrammatic Ad BuyingPythonTableauTracking PixelsWeb Analytics Platforms
10 Days Ago
In-Office or Remote
United States
76K-126K Annually
Junior
76K-126K Annually
Junior
Big Data • Information Technology • Software • Analytics • Energy
Configure, test, and implement Automated Utility Design software for electric utility clients. Translate client standards into software configurations, lead requirements workshops, support testing and training, troubleshoot technical issues, document solutions, and track project delivery. The role combines utility design or drafting experience with software configuration, client-facing consulting, and basic programming knowledge.
Top Skills: .NetAutocad Map 3DAutodesk AutocadC#Esri ArcgisGe SmallworldGisPythonSbs Automated Utility Design (Aud)SQL
14 Days Ago
In-Office or Remote
United States
103K-120K Annually
Entry level
103K-120K Annually
Entry level
Big Data • Information Technology • Software • Analytics • Energy
Coordinates testing, release readiness, defect management, customer training, documentation, and adoption activities for enterprise software implementations. Develops test scenarios, training materials, process guides, and release communications while collaborating with project managers, developers, quality assurance teams, and customer stakeholders. Supports end-to-end validation, knowledge transfer, change management, risk reporting, and post-implementation handoff.

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account