Gallatin AI, Inc. Logo

Gallatin AI, Inc.

AI Software Engineer

Posted 23 Days Ago
In-Office
New York, NY, USA
80K-210K Annually
Entry level
In-Office
New York, NY, USA
80K-210K Annually
Entry level
Build, deploy, and operate AI/ML models, scalable MLOps pipelines, and real-time inference systems. Collect and process diverse data sources, improve training data quality, monitor model reliability and drift, and validate AI features with real-world users. The role also involves documenting best practices, mentoring teammates, and staying current with emerging AI technologies, LLMs, security risks, and model-development techniques.
The summary above was generated by AI
About Gallatin

At Gallatin, we are rebuilding logistics infrastructure for the national security missions of the United States and allied partners. We build AI systems that determine how logistics decisions are made — not just how they're executed. From factory to foxhole, we operate at the layer where data becomes decisions, and decisions make the advantage.

About the Role

We’re looking for an AI/ML Software Engineer to play a foundational role in building and deploying AI-powered solutions for our core product. You’ll work across the full AI/ML lifecycle, from defining and building models to evaluating and deploying large-scale ML pipelines and real-time inference systems, while partnering with cross-functional teams to deliver impactful, real-world AI applications.

What You'll Do
  • Build and Deploy AI/ML Models

    • Own and develop an AI model aligned with our core product needs within your first three months.

    • Validate AI-driven product features through real-world testing and feedback from warfighters.

    • Establish scalable MLOps pipelines and real-time inference services to streamline model training, deployment, runtime, and monitoring.

    • Own high model reliability and uptime by implementing monitoring across your work.

  • Data Collection & Processing

    • Identify and integrate structured, unstructured, batch, and real-time data sources.

    • Work with internal logs, APIs, user interactions, and third-party datasets to improve training data quality.

  • Continuous Improvement & Best Practices

    • Stay ahead of emerging AI trends and technologies to improve model performance.

    • Document and share AI/ML development best practices.

    • Contribute to the hiring and mentoring of AI/ML talent as we grow our team.

    • Help the wider team understand the latest trends and the significance of novel approaches in AI.

What We’re Looking For
  • Strong Programming Skills

    • Expertise in at least one: Python, C++, or C.

  • ML Framework Proficiency

    • Hands-on experience with AI/ML training and fine-tuning frameworks, including:

      • PyTorch, TensorFlow, CUDA, Jupyter Notebooks

      • Large Language Models (LLMs) and Open-Source Models (Llama, Anthropic, Mistral)

      • LangChain, Retrieval-Augmented Generation (RAG), Hugging Face, Exo Labs

  • MLOps & Data Engineering Knowledge

    • Experience with data processing and pipeline frameworks such as Apache Kafka, Apache Airflow, AWS Kinesis, pandas, and dbt.

    • Understanding of AI model performance monitoring, data drift detection, and observability tools like Grafana or Kibana.

  • AI Fundamentals & Security Awareness

    • Deep understanding of deep neural networks (DNNs), LLMs, over/underfitting, prompt engineering, and LLM security (jailbreaking risks and protections).

  • Growth Mindset

    • A passion for continuous learning, staying current with the latest advancements in AI/ML, and teaching others

Bonus Points
  • Experience mentoring and upskilling junior engineers.

  • Familiarity with legacy systems and working with public sector customers.

  • Contributions to open-source (AI/ML) projects.

Mission and Identity

We are building the system that enables faster, smarter logistics decisions in contested environments, and we're doing it with a team of seasoned entrepreneurs, operators, and technologists who have built and scaled solutions in this space before. We hold ourselves to an extremely high standard. We value clear thinking, direct communication, and the kind of ownership that doesn't stop until something actually works.

Our mission is to create decision advantage when the stakes are the highest. If we succeed, the system doesn't just run; it gets smarter. We're not building AI for its own sake. We're building it because faster, smarter decisions in the most demanding environments on earth can't wait. If you want to work somewhere the stakes are real and the mission is urgent — you'll fit in here.


Why Gallatin?

The logistics infrastructure that supports America's warfighters and humanitarian disaster responders is overdue for transformation, and we are building it. From defense operations to disaster response, we're solving the hardest problems that keep missions moving when it matters most. Join a team where the mission is the point.
Compensation: Gallatin offers competitive compensation commensurate with experience. Actual compensation may vary based on experience, skills, and location. In addition to base salary, we offer a generous equity grant, full healthcare coverage, 401k, unlimited PTO, and the perks of working in a high-caliber, mission-driven environment.

Gallatin is an equal opportunity employer. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, veteran status, sexual orientation, gender identity, or any other characteristic protected by applicable federal, state, or local law.

This position may require the ability to obtain and maintain a U.S. government security clearance. The successful candidate must be able to work in a classified environment when necessary.

We comply with the United States Department of Labor's Pay Transparency provision.

Note: Due to the nature of certain government contracts held by this organization, U.S. citizenship is a requirement for all positions at Gallatin. Proof of citizenship will be required prior to employment if selected.

Similar Jobs

2 Days Ago
Hybrid
Jersey City, NJ, USA
Senior level
Senior level
Financial Services
Leads development of scalable ML and AI platforms, contributing Python code and owning delivery from architecture through production operations. Builds data transformation, feature management, orchestration, model serving, APIs, SDKs, and agentic AI capabilities. Automates infrastructure and CI/CD with AWS, Terraform, containers, and Databricks. Ensures reliability, observability, security, performance, and cost efficiency while mentoring engineers and partnering with data science, ML, and product teams.
Top Skills: Agentic Ai FrameworksAmazon EcsAmazon EksAWSCi/CdClaude CodeCloudwatchDatabricksDatadogDynatraceGithub CopilotLlm OrchestrationPythonSnowflakeTerraform
4 Days Ago
Hybrid
159K-259K Annually
Expert/Leader
159K-259K Annually
Expert/Leader
Artificial Intelligence • Cloud • Internet of Things • Software • Cybersecurity • Industrial • Industrial Equipment
Leads the architecture and development of annotation and dataset quality systems for physical AI and autonomous machines. Defines data quality frameworks, labeling standards, validation metrics, governance, active-learning feedback loops, and human-in-the-loop workflows. Provides technical direction across multiple engineering teams while contributing hands-on software development in Python or Java. Partners with ML, autonomy, data, platform, and DevOps teams to build scalable, reliable cloud-native systems.
Top Skills: Active LearningAuto-LabelingAutomated TestingAWSAzureBatch Data ProcessingCi/CdCloud-Native ArchitectureComputer VisionCvatDistributed SystemsGoogle Cloud PlatformInfrastructure As CodeJavaLabelboxLidarPythonSensor SystemsStreaming Data ProcessingSuperannotateTelemetry
6 Days Ago
Hybrid
Jersey City, NJ, USA
Senior level
Senior level
Financial Services
Lead the design, development, and deployment of production-grade AI applications, including LLM workflows, RAG systems, and agentic solutions. Establish AI engineering standards, architecture practices, observability, governance, security, and risk controls. Build automation and secure Python services, evaluate vendors and emerging technologies, and partner across product, engineering, legal, and risk teams. Mentor teams through documentation, workshops, and technical reviews while delivering reliable, scalable, cost-effective AI capabilities.
Top Skills: Ai AgentsAWSCi/CdContainerized DeploymentsCrewaiDatabricksDjangoElasticFastapiLangchainLlamaindexLlmsOpensearchPgvectorPineconePythonReactRetrieval-Augmented Generation (Rag)Semantic KernelTerraformWeaviate

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account