Top Tech Jobs & Startup Jobs in NYC, NY

24 Days AgoSaved
Hybrid
New York, NY, USA
165K-330K Annually
Entry level
165K-330K Annually
Entry level
Software
Build customer-facing enterprise products and platforms for Baseten’s AI inference infrastructure. Own features end to end, including customer discovery, design, development, launch, and iteration. Develop scalable systems supporting billing, partnerships, enterprise identity and governance, developer productivity, and agentic tooling. Collaborate closely with product, design, engineering, and go-to-market teams while prioritizing customer impact and solving ambiguous problems independently.
Top Skills: Agentic PlatformsAIBilling SystemsDeveloper ToolingIdentity And Access ManagementInference PlatformsMachine LearningObservabilityRole-Based Access Control (Rbac)
One Month AgoSaved
Hybrid
New York, NY, USA
200K-250K Annually
Senior level
200K-250K Annually
Senior level
Software
Leads partner enablement and co-sell motions across hyperscalers, AI companies, semiconductor firms, consultancies, and data platforms. Designs joint value propositions, account-mapping plays, seller training, field activations, and internal partner playbooks. Builds relationships with partner field leaders, enables Baseten sellers, supports marketplace and deal-registration processes, and measures activation, co-sell opportunities, and influenced pipeline. Collaborates across Partnerships, Sales, FDE, Marketing, and RevOps to make partner programs repeatable and effective.
Top Skills: Azure MarketplaceGpu InfrastructureMachine LearningAzureModel ServingNvidia
One Month AgoSaved
Hybrid
New York, NY, USA
Senior level
Senior level
Software
Build and lead a team of Enterprise Account Executives, recruiting and coaching sellers through complex, multi-stakeholder AI infrastructure deals. The role combines team leadership with player-coach selling, consultative AI strategy, technical evaluations, and enterprise go-to-market development. The manager will partner cross-functionally with Marketing, Product, Engineering, and Legal while shaping sales processes, territory strategy, and team culture.
Top Skills: Ai InfrastructureCloud InfrastructureDeveloper PlatformsMachine Learning
One Month AgoSaved
Remote or Hybrid
New York, NY, USA
150K-250K Annually
Senior level
150K-250K Annually
Senior level
Software
Manage and mature Baseten’s security governance, risk, compliance, privacy, audit, certification, vendor assessment, and customer assurance programs. Translate regulatory and customer requirements into technical controls and product requirements, partnering with Engineering, Product, Security, Legal, and Operations. Coordinate SOC 2, ISO, HIPAA, FedRAMP, and related audits; manage risk assessments, evidence collection, remediation, security questionnaires, training, and continuous improvement in a fast-growing AI platform company.
Top Skills: Ai/Ml SecurityAnecdotesAWSData PrivacyDrataFedrampGCPGdprHipaaIso 27001Iso 27701Model GovernanceNistSecureframeSoc 2Vanta
One Month AgoSaved
Hybrid
New York, NY, USA
240K-270K Annually
Entry level
240K-270K Annually
Entry level
Software
Leads and grows an inference performance engineering team focused on optimizing GPU-based AI workloads. Responsibilities include technical roadmap ownership, GPU profiling, inference runtime optimization, model and hardware bring-up, productionizing techniques such as quantization and speculative decoding, and measuring latency, utilization, and cost improvements. The manager partners across engineering and customer-facing teams, maintains high engineering standards, and remains hands-on in solving complex performance challenges.
Top Skills: Continuous BatchingCudaCutlassGpuKv-Cache ManagementPyTorchQuantizationSglangSpeculative DecodingTensorrtTensorrt-LlmTritonVllm
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
One Month AgoSaved
Hybrid
New York, NY, USA
180K-360K Annually
Entry level
180K-360K Annually
Entry level
Software
Develop and productionize high-performance LLM inference techniques across runtimes, scheduling, serving, routing, and GPU kernels. Profile and optimize latency, throughput, memory usage, and cost; support new models and hardware; build benchmarking frameworks; and contribute to open-source inference engines such as vLLM, SGLang, and TensorRT-LLM. The role requires strong programming, GPU architecture, ML library, and LLM optimization knowledge.
Top Skills: AwqC++CudaCutlassFp4Fp8GptqLoraPythonPyTorchSglangTensorrtTensorrt-LlmTritonVllm
One Month AgoSaved
Hybrid
New York, NY, USA
180K-360K Annually
Mid level
180K-360K Annually
Mid level
Software
Build and operate the distributed inference platform powering large-scale LLM deployments. Responsibilities include orchestration, routing, autoscaling, scheduling, Model APIs, authentication, quotas, metering, observability, benchmarking, and production reliability across Kubernetes, networking, distributed runtimes, and GPU workloads. The role owns projects end to end and partners with performance engineers to deliver efficient, scalable AI inference capabilities and strong developer experiences.
Top Skills: Api GatewaysCi/Cd SystemsGpu WorkloadsKubernetesNvidia DynamoObservability ToolingService MeshesSglangTensorrt-LlmTgiVllm
One Month AgoSaved
Hybrid
New York, NY, USA
160K-200K Annually
Mid level
160K-200K Annually
Mid level
Software
Own full-cycle recruiting for the marketing organization, including role kickoffs, sourcing, candidate experience, process improvement, and offer acceptance. Partner with marketing leaders and hiring managers to hire across product marketing, demand generation, growth, content, brand, and events. Build targeted candidate pipelines, manage multiple searches, and develop expertise in AI infrastructure and technical products while maintaining a high hiring bar.
Top Skills: Ai InfrastructureArtificial IntelligenceDeveloper ToolsMachine Learning
One Month AgoSaved
Remote or Hybrid
New York, NY, USA
205K-248K Annually
Senior level
205K-248K Annually
Senior level
Software
Own the financial economics of Training and new products, including cost-to-serve modeling, pricing, capacity planning, forecasting, annual plans, and P&L analysis. Partner with Product, Engineering, Infrastructure, and GTM leaders on business cases, launch pricing, margins, and scale decisions. Lead monthly business reviews and define success metrics for new product launches in a fast-growing AI infrastructure company.
Top Skills: Business Intelligence ToolsCloud InfrastructureGoogle SheetsGpu ComputingExcelSQL
One Month AgoSaved
Hybrid
New York, NY, USA
100K-125K Annually
Entry level
100K-125K Annually
Entry level
Software
Coordinate day-to-day workplace operations for Baseten’s New York office. Manage reception, visitors, conference rooms, office supplies, mail, deliveries, vendors, events, and physical workspace standards. Anticipate team needs, resolve workplace issues, support high-priority meetings and onboarding, and collaborate with the Office Manager to create an organized, welcoming, and efficient in-office experience.
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account