Top Tech Jobs & Startup Jobs in NYC, NY

Build and maintain production-grade data processing systems and foundational infrastructure for enterprise AI. Collaborate with researchers and engineers, deliver end-to-end implementations, transform unstructured data into performant datasets, and use distributed processing frameworks and modern analytics tooling to inform products and strategy.

The Senior ML Systems Engineer will build and maintain the training framework for large-scale language models, focusing on distributed training and performance optimization.

Lead end-to-end technical programs for ML infrastructure (inference, serving, efficiency, endpoints). Coordinate cross-functional teams, prioritize overlapping projects, manage timelines, budgets and scope, drive incident management and continuous improvement, and communicate status to engineering and leadership.

Build and own tooling and data pipelines for synthesis, annotation, validation, and analysis of real and synthetic data to support model training and evaluation. Collaborate with researchers and engineers to align data infrastructure with experiments, maintain documented standards, and develop frameworks to identify coverage gaps and improve data quality.

Lead and mentor a team of Forward Deployed Engineers to build and deploy agentic solutions with Cohere's North platform in on‑premises enterprise environments. Own technical implementation through delivery, collaborate with Product/Engineering/Sales, drive customer relationships, and scale agent development and deployment processes.

Build and maintain integrations for North's agentic platform, own the end-to-end integration pipeline, create evals and tests to ensure reliability, tune tool descriptions, and help other engineers add and maintain integrations while using AI responsibly to improve performance and quality.

Lead and stand up executive communications for Cohere: refine strategy, manage a small team, drive executive content (speaking, op-eds, social), enable rapid response and crisis readiness, oversee speaking engagements and storytelling, partner cross-functionally to amplify executive thought leadership for regulated enterprise and government audiences.

Lead product and technology communications for Cohere by partnering with product, engineering, research, and GTM teams. Develop messaging, launch materials, thought leadership, and crisis communications; translate complex AI/technical concepts for technical and non-technical audiences; use insights to refine messaging and drive cross-functional alignment.

Build and ship LLM- and agent-powered product experiences for North, designing interfaces, evals, observability, and feedback loops to improve reliability and user outcomes. Collaborate with modelling, product, design, and customers to turn failures and feedback into measurable product and model improvements.

Lead North's integrations strategy and execution: prioritize, ship, and drive adoption of connectors and ecosystem tooling. Partner with customers and engineering to convert integrations into reusable platform capabilities (auth, connector framework, data sync, permissions). Define developer/partner experience (APIs, SDKs, plugins) and instrument analytics to measure adoption, time-to-stand-up, and retention.