Defense Unicorns Logo

Defense Unicorns

Senior Data Engineer

Reposted Yesterday
Easy Apply
Remote
Hiring Remotely in United States
149K-201K Annually
Mid level
Easy Apply
Remote
Hiring Remotely in United States
149K-201K Annually
Mid level
The Data Engineer will design and implement data workflows, manage data streaming solutions, and ensure compliance with regulations. They will work with teams to improve and automate infrastructure in cloud environments and support sensitive data exchange.
The summary above was generated by AI
EMPLOYER IS A CONTRACTOR FOR THE U.S. GOVERNMENT. THIS POSITION WILL REQUIRE U.S. CITIZENSHIP.Responsibilities: 
  • Designing data workflows, pipelines, and pathways to support ETL/ELT, while ensuring data-quality and exchange of sensitive information across AWS cloud and on-prem environments. 
  • Implementing systems engineering principles to ensure the reliability, scalability, and maintainability of data layer systems, including backup and recovery strategies
  • Architecting, deploying, and operating data streaming technologies (Kafka, Redpanda, Kinesis, etc ) on Kubernetes with an emphasis on declarative definitions to reduce complexity in day-2 operations
  • Working with a platform team to implement best practices for configuration management, security, and performance optimization within Kubernetes and AWS environments
  • Working with a platform team to automate infrastructure provisioning, monitoring, and scaling using tools such as Terraform working with cybersecurity SMEs to incorporate best practices and techniques to defend our data layer against potential threats
  • Ensuring that our data layer systems are compliant with industry and DoD regulations, standards, and best-practices
  • Staying up-to-date with industry trends and emerging technologies related to Kubernetes, containerization, and data engineering

Travel Expectations/Requirements: 6-10 times per year

The listed responsibilities are not exhaustive and additional responsibilities may be assigned based on the evolving needs of the organization. We are seeking a dynamic individual who is able to adapt and take on new responsibilities as they arise. 
*
Preferred Experience and Qualifications:

  • Demonstrated experience (minimum 5 years) in building and maintaining production data pipelines, databases, and data exchange services on Kubernetes Experience in designing, deploying, and operating Kafka / Redpanda data streaming solutions on Kubernetes
  • Experience in creating data pipelines from scratch with the ability to process data in large volumes and manage data stores
  • Experience with containerization technologies such as Docker and container orchestration systems like Kubernetes
  • Knowledge of systems engineering principles to ensure the reliability, scalability, and maintainability of data layer systems Familiarity with API Security, Container Security, AWS Cloud Security Familiarity with cybersecurity principles and best practices for securing data layer systems
  • Excellent problem-solving skills, with the ability to work independently and as part of a team
  • Excellent communication skills, with the ability to convey complex ideas to both technical and non-technical team members
  •  The selected candidate will be subject to a pre-employment background check ("CBI") and must be able to obtain and maintain a Secret-level DoD security clearance 
  • Experience with machine learning and generative AI models

Full compensation packages are based on candidate experience. Compensation ranges are established using national benchmarking data and apply across all geographic locations within the United States. 

Remote - USA
$148,750$201,250 USD
Who We Are

Defense Unicorns delivers mission value by streamlining software delivery so our customers can focus on the most important challenges. We share a vision of freedom and security for the advancement of progress and innovation. Our commitment to this vision, and to our mission-driven customers, means a commitment to speed, user experience and optionality, without compromising security. Our team is composed of innovators, software engineers, and veterans with decades of experience delivering technology programs across the federal market.

What We Do

We create and deliver secure solutions for continuous software integration and delivery. Defense Unicorns consolidates the best practices for security pipelines, testing, and deployment automation in order to meet the high security requirements valued by mission owners. Our solutions are agnostic by design and we believe that growing a robust ecosystem of secure, cloud-native software solutions can help enterprise customers inside and outside the federal market buy and integrate software more easily.

Who We Serve

Defense Unicorns’ customers are mission-focused leaders across public and private enterprises. We proudly support defense and civil agencies across the U.S. government and we work closely with the creators of leading-edge software solutions to deliver value to the mission-owner by improving the security and consumability of commercial software products.

What We Work On
  • Kubernetes
  • Cloud Environments (AWS/GCP and Azure)
  • Infrastructure-as-code (like Terraform/Pulumi)
  • Continuous Delivery and automation tooling
  • GitOps
  • Containers
  • CNCF projects and open source products and packages
  • Helm/Kustomize-Value Stream Mapping
  • Building and improving security delivery
  • Building Kubernetes and cloud native applications
Benefits Our Unicorns EnjoyHealth:
  • Medical/Dental/Vision
  • Premiums are 100% Company Paid
  • Health Reimbursement Account
  • Life Insurance
  • Disability Insurance
Financial:
  • 401k Retirement Plan
  • Company Stock Options
  • Home Office Budget
Leave:
  • Unlimited paid time off, with a mandatory 10 days off on top of 11 federal government holidays, week of Thanksgiving, last two weeks of December (including New Year’s Day)
  • Paid Parental Leave
Learning:
  • Reimbursement for approved trainings/subscriptions
  • Conferences (travel, lodging, and fees)

Don’t have all the preferred experience or qualifications? Studies show that underrepresented groups like women and people of color are less likely to apply to jobs if they don't meet every requirement listed. 

At Defense Unicorns, we're committed to diversity. If you're enthusiastic about the role but don't match every criteria, we encourage you to apply. You could be the perfect fit for this or another role! Defense Unicorns is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, disability, sex, sexual orientation, gender identity or expression, age, national origin, veteran status, genetic information, union status and/or beliefs, or any other characteristic protected by federal, state, or local law.

CCPA DISCLOSURE

Top Skills

AWS
Docker
Kafka
Kubernetes
Redpanda
Terraform

Similar Jobs

Yesterday
Remote or Hybrid
New York, NY, USA
140K-180K Annually
Senior level
140K-180K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Lead engineering and automation for a data collaboration ecosystem: design secure, scalable Snowflake/Databricks clean room architectures, build ELT pipelines (Snowpark/PySpark), implement MLOps and AI/LLM integrations, enforce RBAC and privacy controls, drive observability, cost optimization, onboarding, and operational excellence for partner-facing data products.
Top Skills: Python,Sql,Snowflake,Snowpark,Databricks,Pyspark,Liveramp,Airflow,Dbt,Great Expectations,Langchain,Llamaindex,Vector Databases,Snowflake Cortex,Rag,Llms
3 Days Ago
In-Office or Remote
Minnetonka, MN, USA
92K-164K Annually
Senior level
92K-164K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and maintain scalable batch and streaming data pipelines using Python/PySpark on Databricks or Snowflake. Implement data models (OLTP/OLAP), develop advanced SQL, orchestrate workflows with Airflow, enforce governance via Microsoft Purview, build data quality frameworks, support cloud/DevOps practices, monitor production pipelines, and lead technical design and code reviews.
Top Skills: Python,Pyspark,Databricks,Snowflake,Sql,Apache Airflow,Microsoft Purview,Azure,Aws,Gcp
4 Days Ago
Easy Apply
Remote or Hybrid
USA
Easy Apply
130K-165K Annually
Senior level
130K-165K Annually
Senior level
Artificial Intelligence • Insurance • Machine Learning • Software • Analytics
Lead design and implementation of scalable, HIPAA-compliant data pipelines and platforms for healthcare ML. Build ETL, orchestration, and tooling for processing EHR, claims, pharmacy, and bioinformatics data; collaborate with data scientists to produce modeling-ready datasets and ensure data quality, reliability, and operational excellence.
Top Skills: Python,Sql,Apache Spark (Pyspark),Databricks,Snowflake,Airflow,Dagster,Prefect,Terraform,Docker,Kubernetes,Aws,Dbt,Ci/Cd

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account