BJAK Logo

BJAK

Principal Machine Learning Engineer

Reposted 17 Days Ago
Remote or Hybrid
Hiring Remotely in United States
Expert/Leader
Remote or Hybrid
Hiring Remotely in United States
Expert/Leader
Lead the development of production-grade machine learning systems, build ML pipelines, and optimize models for deployment and performance.
The summary above was generated by AI
Company

A1 is building a proactive AI smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior.

 
Role

As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company.

You operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization.

This is a hands-on, high-impact role focused on depth.

 
Focus
  • Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.

  • Design reproducible, high-performance training pipelines across GPU infrastructure.

  • Architect inference systems that balance latency, throughput, cost, and reliability at scale.

  • Design and maintain data systems for high-quality synthetic and real-world training data.

  • Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.

  • Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.

  • Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.

  • Make pragmatic trade-offs and ship improvements quickly, learning from real usage.

  • Work under real production constraints: latency, cost, reliability, and safety

 
Requirements
  • Strong background in deep learning and transformer-based architectures.

  • Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.

  • Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.

  • Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).

  • Strong software engineering fundamentals – you write robust, maintainable, production-grade systems.

  • Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.

  • Comfort owning ambiguous, zero-to-one ML systems end-to-end.

  • A bias toward shipping, learning fast, and improving systems through iteration.

 
Ideal Experience
  • Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.

  • Contributions to open-source ML or systems libraries.

  • Background in scientific computing, compilers, or GPU kernels.

  • Experience with RLHF pipelines (PPO, DPO, ORPO).

  • Experience training or deploying multimodal or diffusion models.

  • Experience with large-scale data processing (Apache Arrow, Spark, Ray).

 
Outcomes
  • ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets.

  • Models deployed to production achieve measurable quality improvements and meet user-impact goals.

  • Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis.

  • Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions.

  • Research-to-production cycles are efficient, safe, and continuously improve the product experience.

 
How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

 
Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Similar Jobs

Yesterday
Remote or Hybrid
California, USA
289K-385K Annually
Senior level
289K-385K Annually
Senior level
AdTech • Digital Media • Marketing Tech
Lead a global research organization to define scientific vision and deliver large-scale ML/optimization systems for prediction, bidding, targeting, and marketplace efficiency. Translate research into production, recruit and mentor scientists, set technical standards, partner with product and engineering, and drive measurable revenue and platform improvements through experimentation and optimization.
Top Skills: Advertising OptimizationAuction TheoryBidding SystemsCausal InferenceControl SystemsDemand-Side Platform (Dsp)Large-Scale ExperimentationMachine LearningMarketplace SystemsMulti-Objective OptimizationOperations ResearchPredictive ModelingReinforcement LearningStatistical ModelingTargeting Technologies
Yesterday
Remote or Hybrid
California, USA
289K-385K Annually
Senior level
289K-385K Annually
Senior level
Digital Media • Information Technology • News + Entertainment
Lead a global research organization to define scientific vision and build large-scale ML and optimization systems for targeting, bidding, forecasting, and marketplace efficiency. Translate research (reinforcement learning, causal inference, auction design, operations research) into production, partner with Product and Engineering, recruit and mentor scientists, drive experimentation and measurable revenue/efficiency impact, and represent the company in publications and conferences.
Top Skills: Auction TheoryBidding SystemsCausal InferenceControl TheoryDemand-Side Platforms (Dsps)Large-Scale ExperimentationMachine LearningMarketplace SystemsOperations ResearchOptimizationReinforcement Learning
Yesterday
In-Office or Remote
131K-191K Annually
Expert/Leader
131K-191K Annually
Expert/Leader
Big Data • Cloud • Digital Media • Machine Learning • Mobile • Software • Industrial
Lead architecture and delivery of production-grade applied AI systems (LLMs, retrieval, agents). Solve cross-stack technical problems, define platform direction on AWS, optimize data and database design, improve quality/QA and observability, mentor a ~20-person team, and translate ambiguous product opportunities into measurable technical outcomes.
Top Skills: Agentic/AgentsAPIsAWSBackend ServicesData PipelinesDevOpsGraph DatabasesLlmsMachine LearningObservabilityProduction OperationsPythonRelational DatabasesRetrieval (Rag)

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account