Treliant Logo

Treliant

Databricks Engineer

Posted 5 Days Ago
Be an Early Applicant
In-Office
New York, NY, USA
160K-200K Annually
Entry level
In-Office
New York, NY, USA
160K-200K Annually
Entry level
Build and support a Databricks-based cloud data platform for cashflow aggregation at a global bank. Responsibilities include collecting real-time and batch data, cleaning and enriching datasets, storing aggregated results in Delta Lake, supporting migration and integration, managing costs and use-case prioritization, and collaborating with data providers and consumers. The role also requires financial-services domain knowledge, communication, and leadership during the bank’s transition to Databricks.
The summary above was generated by AI
Overview

Treliant is a global consulting firm serving banks, mortgage originators and servicers, FinTechs, and other companies providing financial services. We are led by practitioners from the industry and the regulatory community who bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges. We provide data-driven, technology-enabled advisory, implementation, and staffing solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of our clients. Founded in 2005, Treliant is headquartered in Washington, DC, with offices in New York, London, Belfast, Northern Ireland and Łódź, Poland. For more information visit www.treliant.com.


Treliant is committed to fostering a diverse, equitable and inclusive environment that values and embraces all races, religions, ages, abilities, genders, sexual orientations, ethnicities, languages, nationalities, political parties, socioeconomic groups and other characteristics that inform an individual's worldview, experiences and system of beliefs (“the principles”). We believe in championing every voice and ensuring everyone’s full potential.


Our Capital Markets business unit is looking for two Databricks Engineers to join our existing team at a large, global bank.  Successful candidates will work among a mixture of bank and Treliant staff in a hybrid role in the Greater New York City metro area.  


---

Primary Location: Hybrid - Greater New York City metro area

Primary Location Salary Range: $160,000 - $200,000

Responsibilities

The client, a large bank, is in the process of centralizing its key reporting and aggregation processes on cloud platforms. 


In 2024, the intention is to centralize cashflow aggregation onto a platform based on Databricks technologies (Databricks and Deltalake). 


The project involves collecting both actual and forecast cashflows from both real-time and batch data sources, cleaning and enriching the data, and storing the resulting aggregated data in Deltalake for use in reporting.

Qualifications

Technical skills:

Successful candidates will have played an important role in at least one Databricks platform implementation.  Experience in data migration, data integration, and delivery of data warehouses is also advantageous.

  • Databricks: the candidate should be familiary with ETL/ELT in Databricks, with Medallion architecture and with Deltalake.
  • Other relevant technologies include:
    • Streaming technologies such as Kafka
    • Delta Share and Deltalake Connector
    • SQL, Python and PySpark

Domain knowledge:

The successful candidate will have a background in financial products and processes.  Relevant areas of domain knowledge include:

  • Cashflow forecasting and liquidity management
  • Financial products including securities such as swaps, and banking products such as loans
  • Reference data including counterparty and business hierarchy data
  • Regulatory and risk management reporting needs
  • Experience of the challenges of aggregating data in bulk across business units and asset classes

Other capabilities:

This role is likely to have an element of communication and leadership, rather than being purely a technical role within the team.

  • The bank is at a relatively early stage in implementing the transition to Databricks. 
  • The role will involve guiding and understanding aspects of the migration such as cost management and use case prioritization.
  • The role will involve communicating with data providers and data consumers to understand the requirements and to source and map the needed data fields.
Benefits

Treliant offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefit package that reflects our commitment to creating a diverse and supportive workplace.  In addition to a competitive base salary, candidate is eligible for incentive pay as well as a full range of health benefits, vacation plan, and 401k plan.If you want to be part of a dynamic team of professionals, we invite you to join the team at Treliant.  We invest in people, and challenge you to advance your career while achieving your aspirations and goals.  Here at Treliant, we pride ourselves on our collaborative team culture, where we embrace diversity of thought and innovation.  If you strive for excellence and seek an inclusive environment apply on line www.treliant.com and follow us on LinkedIn. 

   

Treliant LLC is an Equal Opportunity Employer and does not discriminate on the basis of race, color, national origin, sex, sexual orientation, genetic information, religion, age, disability, or military status in employment or provision of services. When contacted for an interview, an applicant who requires special accommodations due to a disability should notify the office so that proper arrangements can be made.

Similar Jobs

10 Days Ago
Hybrid
New York, NY, USA
179K-246K Annually
Mid level
179K-246K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead data engineering efforts by designing, developing, testing, and supporting scalable data pipelines and movement solutions. Build cloud-based systems using Python, SQL, Spark, Kafka, Snowflake, and Databricks; optimize data models, quality, governance, and performance; collaborate with Agile teams and product managers; conduct code reviews and testing; and mentor engineers while applying emerging technologies and interactive AI tools.
Top Skills: AgileAmazon EmrApache KafkaSparkAWSAws GlueCassandraClaude CodeDatabricksGithub CopilotHadoopHiveMapreduceMongoDBMySQLNoSQLPythonRedshiftShell ScriptingSnowflakeSQLUnix/Linux
10 Days Ago
Hybrid
New York, NY, USA
179K-246K Annually
Senior level
179K-246K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead data engineering role responsible for designing, developing, testing, implementing, and supporting cloud-based data solutions. The position uses Python, Java, Scala, SQL, distributed computing, streaming technologies, data warehouses, NoSQL databases, and public cloud platforms. Responsibilities include collaborating with Agile and product teams, building scalable systems, conducting code reviews and unit tests, optimizing performance, tracking technology trends, and mentoring engineers.
Top Skills: AgileSparkAWSCassandraDatabricksEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMongoDBMySQLNoSQLPythonRdbmsRedshiftScalaShell ScriptingSnowflakeSQLUnix
14 Days Ago
Hybrid
New York, NY, USA
179K-246K Annually
Senior level
179K-246K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead development of scalable data pipelines and cloud-based data solutions using Python, SQL, Spark, Kafka, Snowflake, and Databricks. Responsibilities include data modeling, data quality, governance, testing, performance optimization, technical design, collaboration with Agile teams and product managers, and mentoring engineers. The role supports omnichannel marketing and messaging platforms while encouraging adoption of emerging technologies and interactive AI tools.
Top Skills: AgileAmazon EmrApache KafkaSparkAWSAws GlueCassandraDatabricksGenaiHadoopHiveLinuxMapreduceMongoDBMySQLNoSQLPythonRdbmsRedshiftShell ScriptingSnowflakeSQLUnix

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account