Capital One Logo

Capital One

Distinguished Data Engineer - Enterprise Data Technology

Posted 3 Days Ago
Hybrid
McLean, VA
269K-335K Annually
Senior level
Hybrid
McLean, VA
269K-335K Annually
Senior level
Lead the design of scalable data architectures, optimize data processing workloads, and mentor talent while promoting modern technologies and engineering excellence.
The summary above was generated by AI
Distinguished Data Engineer - Enterprise Data Technology
Distinguished Data Engineers are individual contributors who strive to be diverse in thought so we visualize the problem space. At Capital One, we believe diversity of thought strengthens our ability to influence, collaborate and provide the most innovative solutions across organizational boundaries. Distinguished Engineers will significantly impact our trajectory and devise clear roadmaps to deliver next generation technology solutions.
About the team
The Data Operations Center (DOC) serves as the backbone of our enterprise data ecosystem, ensuring the stability and scalability of our core e-data platforms. As a horizontal organization, we manage a diverse tech stack including Snowflake, Databricks, DynamoDB, File Transfers and legacy systems like Ab Initio to provide a high-performance foundation for the entire enterprise while housing an internal AI,ML Engineering team focused specifically on our evolution. By integrating AI,ML directly into our operations, we are transforming our model from reactive maintenance to a predictive, self-healing, and automated platform architecture. This collaborative structure ensures that the organization continuously evolves its support mechanisms, moving from reactive to predictive and automated operations.
Responsibilities
  • Lead the design and implementation of highly scalable, fault-tolerant, and cost-effective data architectures that seamlessly integrate Databricks (for complex processing,ML) and Snowflake (for warehousing,ETL).
  • Drive performance engineering and optimization for large-scale data ingestion and processing workloads across the Databricks,Snowflake,AWS data pipeline.
  • Provide technical leadership for the design, development, testing and deployment of agentic workflows across Capital One.This position requires a combination of strategic thinking, technical expertise in AI,ML and strong leadership to align the platform with business goals
  • Deep technical experts and thought leaders that help accelerate adoption of the very best engineering practices, while maintaining knowledge on industry innovations, trends and practices
  • Evangelists, both internally and externally, helping to elevate the Distinguished Engineering community and establish themselves as a go-to resource on given technologies and technology-enabled capabilities
  • Build awareness, increase knowledge and drive adoption of modern technologies, sharing consumer and engineering benefits to gain buy-in
  • Strike the right balance between lending expertise and providing an inclusive environment where others' ideas can be heard and championed; leverage expertise to grow skills in the broader Capital One team
  • Promote a culture of engineering excellence, using opportunities to reuse and innersource solutions where possible
  • Operate as a trusted advisor for a specific technology, platform or capability domain, helping to shape use cases and implementation in an unified manner
  • Lead the way in creating next-generation talent for Tech, mentoring internal talent and actively recruiting external talent to bolster Capital One's Tech talent

Basic Qualifications:
  • Bachelor's Degree
  • At least 7 years of experience in data engineering
  • At least 3 years of experience in data architecture
  • At least 2 years of experience building applications in AWS
  • At least 5 years of experience of Python, SQL or Scala
  • At least 3 years of experience developing AI and ML algorithms or technologies

Preferred Qualifications:
  • Masters' Degree
  • 5+ years of experience in data engineering (Hadoop,AWS,Snowflake,ETL etc.)
  • 5+ years of experience in Data Governance, Data Governance Platforms, Data Standardization, and Data Modeling
  • 5+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud)
  • Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang
  • Deep proficiency and strategic experience with Databricks (e.g., Delta Lake, Unity Catalog, MLflow, performance tuning Spark workloads).
  • Deep proficiency and strategic experience with Snowflake (e.g., Data Sharing, Snowpipe, external tables, security features, cost governance, advanced SQL, Stored Procedures).

Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
The minimum and maximum full-time annual salaries for this role are listed below, by location. Please note that this salary information is solely for candidates hired to perform work within one of these locations, and refers to the amount Capital One is willing to pay at the time of this posting. Salaries for part-time roles will be prorated based upon the agreed upon number of hours to be regularly worked.
McLean, VA: $269,100 - $307,200 for Distinguished Data Engineer
San Francisco, CA: $293,600 - $335,100 for Distinguished Data Engineer
Candidates hired to work in other locations will be subject to the pay range associated with that location, and the actual annualized salary amount offered to any candidate at the time of hire will be reflected solely in the candidate's offer letter.
This role is also eligible to earn performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives could be discretionary or non discretionary depending on the plan.
Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well-being. Learn more at the Capital One Careers website . Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug-free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries, including, to the extent applicable, Article 23-A of the New York Correction Law; San Francisco, California Police Code Article 49, Sections 4901-4920; New York City's Fair Chance Act; Philadelphia's Fair Criminal Records Screening Act; and other applicable federal, state, and local laws and regulations regarding criminal background inquiries.
If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation, please contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected] . All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
For technical support or questions about Capital One's recruiting process, please send an email to [email protected]
Capital One does not provide, endorse nor guarantee and is not liable for third-party products, services, educational tools or other information available through this site.
Capital One Financial is made up of several different entities. Please note that any position posted in Canada is for Capital One Canada, any position posted in the United Kingdom is for Capital One Europe and any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).

Top Skills

AI
AWS
Databricks
Ml
Python
Scala
Snowflake
SQL

Capital One New York, New York, USA Office

With locations in the heart of Manhattan, as well as on Long Island, there’s a workspace to fit everyone. We have two locations in the Flatiron district, on 5th Ave and W 19th St, convenient for an easy commute. Our 299 Park Ave location is just a few blocks from Grand Central Station.

Similar Jobs at Capital One

13 Hours Ago
Hybrid
179K-225K Annually
Senior level
179K-225K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead a team of developers to create solutions for regulatory needs, utilizing various technologies and collaborating with product managers.
Top Skills: AnsibleApache MesosSparkAWSDockerGoJavaJenkinsKubernetesMarathonPythonRubySQLTerraform
13 Hours Ago
Hybrid
88K-110K Annually
Senior level
88K-110K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
The Senior Risk Associate supports risk reporting, participates in operational risk assessment, and collaborates on risk management strategies with leadership.
Top Skills: Enterprise Reporting PlatformsQuicksightTableau
13 Hours Ago
Hybrid
99K-124K Annually
Mid level
99K-124K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
The Principal Associate, Learning Experience Designer develops innovative learning solutions, leveraging data and design thinking to enhance learning effectiveness across various audiences. This role focuses on crafting immersive experiences, elevating learning strategies, and driving behavioral change within the organization.
Top Skills: Adobe IllustratorAdobe PhotoshopAdobe PremiereArticulate 360Camtasia

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account