IOMETE Logo

IOMETE

AI Software Engineer

Posted 12 Days Ago
Remote
Hiring Remotely in United States
Senior level
Remote
Hiring Remotely in United States
Senior level
Build and maintain AI services for a sovereign data lakehouse, including MCP servers, model gateways, SQL AI functions, and Spark troubleshooting agents. Develop AI platform integrations, agent frameworks, evaluation harnesses, and Kubernetes deployments. Collaborate with customer engineering teams, troubleshoot integrations, contribute to architecture, and produce tests, documentation, and release notes. The role requires production experience with LLM systems, distributed systems, and software engineering, primarily using Python or Go.
The summary above was generated by AI
About us

IOMETE is the sovereign data platform for the AI era. Enterprises run our data lakehouse, built on Apache Spark and Apache Iceberg, in their own trusted environment: on-premises, in their own cloud, or hybrid. It is built for regulated industries such as financial services, healthcare and government. Customer data never leaves the customer's trust perimeter, and the AI we build on it stays inside that perimeter too.

Position overview

We are seeking a highly skilled and motivated AI Software Engineer to join our team. We tackle a variety of exciting challenges, from connecting AI tools and models to the lakehouse to diagnosing Spark applications and troubleshooting failures. You'll build agents that run inside the customer's environment, on LLMs the customer provides or, later, on custom models we train for Spark tuning and troubleshooting. You'll also build the framework that defines those agents and the harness that runs, limits, traces and evaluates them.

The AI team

We are building the AI platform for the lakehouse — Lakehouse Intelligence. The team's roadmap includes, but is not limited to, the MCP Server for AI Agents, which lets AI tools query the lakehouse; the Model Gateway, through which IOMETE's AI features call models; agents for Spark application diagnosis, troubleshooting and onboarding; and SQL AI Functions, which run language models from inside a query. Down the road, you'll also get to fine-tune and build custom models for our platform's specific needs, small enough to run inside a customer's deployment.

What you'll do
  • Contribute to and maintain IOMETE's AI services, including the MCP Server for AI Agents, the Model Gateway, SQL AI Functions, and lakehouse-specific agents (such as Spark Application Diagnosis) and their harness.

  • Build AI enablers: extend the IOMETE lakehouse and platform to support more AI-powered features, for example by making Spark job logs, query history and table metadata available to them.

  • Be hands-on with Kubernetes, including the Helm charts that ship our AI services into each customer's deployment.

  • Collaborate closely with external customer engineering teams to support integrations, troubleshoot complex issues and provide guidance for successful adoption of our platform.

  • Participate in design discussions about agents, model access, evaluation, and overall systems architecture.

  • Write the tests, docs and release notes for what you build. A feature is done when it has shipped with all of them.

  • Review your teammates' work and provide feedback.

What we're looking for
  • 5+ years of professional experience in software engineering (we’re open to exceptional candidates with less experience who demonstrate deep systems knowledge and impact).

  • Deep understanding of LLM-based systems in production – tool calling, structured output, retrieval, evaluation, and how they fail.

  • Our AI features are written mostly in Python and Go. The data platform is built on the JVM, in Kotlin and Java, and new platform features are being built in Go. Production experience with any of these languages is a big plus, but we know strong engineers learn a new language fast.

  • Familiarity with distributed systems and their challenges (e.g., data consistency, fault tolerance, scheduling).

  • Fluency in English, both written and verbal — this role involves working with international customers and partners.

  • Based in a time zone that overlaps Amsterdam working hours (CET/CEST).

Preferred qualifications
  • Hands-on experience across the AI stack: agents and their evaluation, tool protocols such as MCP, model routing and serving, and fine-tuning.

  • Prior exposure to data platforms like Snowflake, Databricks, etc.

  • Experience with Apache Spark (especially tuning Spark jobs), Apache Iceberg, or contributing to open-source compute engines.

  • Hands-on experience with Kubernetes and Helm.

What we offer
  • Exciting projects and challenges.

  • Opportunity to work with cutting-edge technology.

  • Ability to play a key role in shaping the direction, culture, and architecture of a young & growing engineering organization.

  • Competitive compensation and stock options.

Hiring process
  1. Introduction call — 30 mins max

  2. Technical conversation (with a challenge) — 90 mins

  3. Team interview — 60 mins

  4. Offer

Similar Jobs

2 Days Ago
Remote
United States
150K-190K Annually
Expert/Leader
150K-190K Annually
Expert/Leader
Software
Designs and deploys AI-powered features and scalable AI/ML services across SaaS products. Responsibilities include translating business problems into AI solutions, integrating large language models, preparing data, evaluating model performance, writing Python, building secure deployment infrastructure, and collaborating with product, data, and cloud operations teams. The role requires production AI/ML experience, scalable data infrastructure expertise, AWS familiarity, and modern DevOps practices.
Top Skills: Ai/Ml Evaluation ToolingAWSDevOpsLarge Language Models (Llms)Llm FrameworksPythonSaaS
2 Days Ago
Remote or Hybrid
US
107K-150K Annually
Senior level
107K-150K Annually
Senior level
Information Technology
Leads the design, integration, and delivery of production-grade AI, generative AI, agentic AI, and MLOps solutions for clients. Serves as technical lead, translates requirements into scalable architectures, mentors engineers, manages technical risks and timelines, supports sales proposals, and presents recommendations to stakeholders. Responsibilities include application integration, security, observability, evaluation, model serving, documentation, testing, and operational readiness.
Top Skills: Agentic AiAi GatewaysAPIsAutomated TestingCi/CdContainersEvaluation FrameworksGitGpu InfrastructureHugging FaceKubernetesMlopsModel Lifecycle PlatformsModel-Serving PlatformsNvidia BlueprintsNvidia NimObservability FrameworksPythonPyTorchRetrieval-Augmented GenerationVector DatabasesVector Search
3 Days Ago
In-Office or Remote
115K-150K Annually
Senior level
115K-150K Annually
Senior level
Fintech
Build and operate enterprise AI platforms, semantic routing, model gateways, agentic workflows, evaluation harnesses, and production AI services. Develop secure, compliant integrations for regulated financial services, optimize AI workload economics, and establish observability, governance, and reliability standards. Prototype emerging capabilities, create reusable architecture components, mentor engineers, lead technical learning, and partner with security, risk, compliance, and data governance teams.
Top Skills: Agentic WorkflowsAIClaude CodeDistributed TracingEmbeddingsEvent-Driven ArchitectureGithub CopilotHipaaInference OptimizationIso/Iec 42001LlmsMachine LearningMcpModel HostingModel ServingMulti-Agent OrchestrationNist Ai RmfOcrOnaOpen-Weight ModelsRest ApisSemantic RoutingSoc 2

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account