Top Tech Jobs & Startup Jobs in NYC, NY

Reposted 2 Months AgoSaved
Remote or Hybrid
New York, NY, USA
165K-330K Annually
Junior
165K-330K Annually
Junior
Software
Develop and maintain components for machine learning inference platform. Focus on Kubernetes deployments, resource management, and performance monitoring.
Top Skills: GoKubernetesPython
Reposted 2 Months AgoSaved
Hybrid
New York, NY, USA
165K-330K Annually
Mid level
165K-330K Annually
Mid level
Software
As a Software Engineer, you'll architect and lead the development of infrastructure for ML training, enhancing reliability and performance while mentoring junior engineers.
Top Skills: AWSDistributed SystemsGCPGoKubernetesMlopsPython
2 Months AgoSaved
Hybrid
New York, NY, USA
Junior
Junior
Software
Own technical outcomes for AI customers by designing, deploying, scaling, and improving inference and post-training workloads. Build proofs of concept through production, develop evaluations and benchmarks, troubleshoot mission-critical incidents, automate deployment and evaluation infrastructure, and contribute product fixes to Baseten’s codebase. Manage multiple accounts, communicate with customers and stakeholders, and participate in on-call support.
Top Skills: Distributed SystemsGpuInference InfrastructureInfinibandJaxKubernetesLlmsNetworkingPyTorchRayReinforcement LearningRoceSftSglangSlurmStorage SystemsTensorrt-LlmVllm
Reposted 3 Months AgoSaved
Hybrid
New York, NY, USA
165K-330K Annually
Senior level
165K-330K Annually
Senior level
Software
The Senior Product Engineer will design and implement features for a training platform, working through the tech stack and collaborating with research engineers to enhance model development and user experiences.
Top Skills: Api DevelopmentAxolotlDeepspeedDistributed SystemsFsdpHf TrainerKubernetesMegatronNcclNemorlPyTorchVerl
3 Months AgoSaved
Hybrid
New York, NY, USA
165K-330K Annually
Mid level
165K-330K Annually
Mid level
Software
Build an internal AI developer platform that provisions agent configs, context tooling, eval harnesses, and rollout mechanics to make AI-assisted engineering the default. Integrate LLMs and third-party coding tools, enable self-serve agent creation, embed safety and audit controls, and measure impact on developer productivity.
Top Skills: Agent FrameworksAudit LoggingCi/CdClaude CodeCodexCursorDockerGoKubernetesLlmsMcpObservabilityPython
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
Reposted 3 Months AgoSaved
Hybrid
New York, NY, USA
180K-360K Annually
Mid level
180K-360K Annually
Mid level
Software
The GPU Kernel Engineer will design and implement high-performance GPU kernels, optimize code, and collaborate with research teams to enhance AI workloads.
Top Skills: C++CudaNsight ComputeNsight SystemsPtx AssemblyTorch Profiler
Reposted 3 Months AgoSaved
Remote or Hybrid
New York, NY, USA
165K-330K Annually
Mid level
165K-330K Annually
Mid level
Software
As an AI Support Engineer, you'll manage support requests, resolve user issues, optimize ML models, and contribute to product development.
Top Skills: Tensorrt
Reposted 3 Months AgoSaved
Hybrid
New York, NY, USA
165K-330K Annually
Mid level
165K-330K Annually
Mid level
Software
Partner with Sales and customers to run technical discovery, lead demos and scoping, design repeatable ML inference deployments across modalities, benchmark inference performance, and drive POC execution and stakeholder alignment.
Top Skills: B200EmbeddingsGpu InferenceH100Image GenerationLlmsSglangTrt-LmmVideo GenerationVllmVoiceai
Reposted 3 Months AgoSaved
Hybrid
New York, NY, USA
160K-200K Annually
Mid level
160K-200K Annually
Mid level
Software
The GTM Recruiter will manage the full-cycle recruiting process for go-to-market roles, enhance candidate experience, and improve recruiting strategies while collaborating with hiring managers and analyzing recruiting metrics.
Reposted 3 Months AgoSaved
Remote or Hybrid
New York, NY, USA
165K-330K Annually
Mid level
165K-330K Annually
Mid level
Software
As a Site Reliability Engineer, you'll build and maintain infrastructure for ML models, automate processes, and collaborate cross-functionally.
Top Skills: Circle CiCloudFormationElk StackGithub ActionsGitlab CiGrafanaJenkinsKubernetesOpentelemetryPrometheusPulumiTerraform
All Filters
JobType
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account