Design, build, and productionize Generative AI applications (document intelligence, RAG, semantic search). Implement LLM fine-tuning, vector search, agentic workflows, and MLOps on GCP; collaborate with clients to translate requirements into scalable, reliable AI services.
About Egen:
Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights. We are committed to being a place where the best people choose to work so they can apply their engineering and technology expertise to envision what is next for how data and platforms can change the world for the better. We are dedicated to learning, thrive on solving tough problems, and continually innovate to achieve fast, effective results. If this describes you, we want you on our team.
Want to learn more about life at Egen? Check out these resources in addition to the job description.
Meet Egen
Life at Egen
Culture and Values at Egen
Career Development at Egen
Benefits at Egen
About the opportunity:
As a Senior AI Engineer, you will be at the forefront of our Generative AI initiatives. We treat AI as a software engineering discipline. You will be responsible for the full lifecycle of our AI features—specifically document intelligence and RAG pipelines—taking them from initial prototype to robust, scalable production services. You will solve for real-world constraints like latency, error handling, and cost optimization.
You’ll collaborate with a diverse range of clients to translate business needs into high-performance AI architectures. This role requires a blend of deep technical expertise in LLMs and a disciplined Software Engineering approach to ensure our solutions are robust, ethical, and scalable.
What You Will Do:
- Architect & Build: Design and implement end-to-end GenAI applications using Python, LangChain, and LlamaIndex on Google Cloud.
- Engineer for Precision: Develop advanced RAG (Retrieval-Augmented Generation) pipelines and Semantic Search systems using GCP Vector Search or Pinecone.
- Optimize Models: Lead efforts in LLM and Embedding fine-tuning to improve domain-specific performance.
- Agentic Ops: Build and manage agentic workflows that automate complex multi-step reasoning tasks.
- Collaborate & Innovate: Work directly with customers to understand requirements, suggest novel features, and implement state-of-the-art AI techniques.
- Productionize: Apply MLOps best practices to ensure models are served efficiently, monitored, and continuously improved.
Your Technical Toolkit:
- Core Languages: Mastery of Python and shell scripting.
- AI/LLM Ecosystem: Extensive experience with Google Gemini, GPT-4, or LLaMA; deep knowledge of Prompt Engineering and Fine-tuning.
- Data & Search: Expertise in Vector Databases (Vertex AI Vector Search, pgvector, etc.) and implementing Semantic Search.
- Infrastructure: Hands-on experience with GCP (Vertex AI) and building scalable software architectures.
- Frameworks: Proficiency in LangChain, LlamaIndex, or similar orchestration layers.
- Mindset: A strong software engineering foundation—you write clean, maintainable code and understand the full SDLC.
Basic Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
- Proven track record of deploying GenAI products to a production environment.
- Experience with Classic Machine Learning (neural nets, training, tuning) is a strong plus.
- Knowledge of Data Engineering and SQL.
Personal Attributes:
- Ownership: You take pride in your code and see projects through from concept to deployment.
- Curiosity: The AI landscape changes weekly; you are a lifelong learner who stays ahead of the curve.
- Consultative Spirit: You enjoy interacting with clients and can translate technical complexity into business value.
- Ethics: You prioritize responsible AI development and data privacy.
Compensation & Benefits:
This role is eligible for our competitive salary and comprehensive benefits package to support your well-being:
- Comprehensive Health Insurance
- Paid Leave (Vacation/PTO)
- Paid Holidays
- Sick Leave
- Parental Leave
- Bereavement Leave
- 401 (k) Employer Match
- Employee Referral Bonuses
Check out our complete list of benefits here - >https://egen.ai/people/#benefits
Important: All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks.
EEO and Accommodations:
Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.
Top Skills
Fine-Tuning
GCP
Google Gemini
Gpt-4
Langchain
Llama
Llamaindex
Mlops
Pgvector
Pinecone
Prompt Engineering
Python
Semantic Search
Shell Scripting
SQL
Vector Databases
Vertex Ai
Vertex Ai Vector Search
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Senior AI ML Engineer will develop AI systems, ensure model quality, lead architecture governance, and manage observability for healthcare solutions.
Top Skills:
Apache AirflowAWSAzure AiDockerGrafanaKerasKubeflowKubernetesOpentelemetryPrometheusPythonPyTorchScikit LearnShellSQLTensorFlowVertex AiXgboost
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
The Senior AI/ML Capacity Engineer will develop capacity planning models, design analytical tools, and collaborate with teams to optimize costs and efficiencies.
Top Skills:
Bi PlatformsBigQueryGitLinuxLookerNumpyPandasPythonSQL
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Design, develop, and deploy AI solutions focusing on Generative AI and autonomous systems. Collaborate with teams to optimize AI pipelines and drive innovation.
Top Skills:
AirflowAWSBedrockGoKafkaPythonSagemakerSnowflake
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
