Lead the development of scalable data pipelines using PySpark, manage client data integrations, ensure data quality, and collaborate with stakeholders to optimize performance.
Get to Know Us:
It's fun to work in a company where people truly believe in what they're doing!
At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications.
Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial close process. Our vision is to modernize the finance and accounting function to enable greater operational effectiveness and agility, and we are committed to delivering innovative solutions and services to empower accounting and finance leaders around the world to achieve Modern Finance.
Being a best-in-class SaaS Company, we understand that bringing in new ideas and innovative technology is mission critical. At BlackLine we are always working with new, cutting edge technology that encourages our teams to learn something new and expand their creativity and technical skillset that will accelerate their careers.
Work, Play and Grow at BlackLine!
Make Your Mark:
We're looking for a Lead Data Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven accounting agents. You'll lead the development of scalable, high-performance data infrastructure while collaborating closely across teams.
You'll Get To:
What You'll Bring:
Years of Experience in Related Field: 3+ years of experience as a Data Engineer or a similar role
Education: Bachelor's degree in Computer Science, Engineering or a related field
Technical/Specialized Knowledge, Skills, and Abilities:
We're Even More Excited If You Have:
Thrive at BlackLine Because You Are Joining:
BlackLine is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity or expression, race, ethnicity, age, religious creed, national origin, physical or mental disability, ancestry, color, marital status, sexual orientation, military or veteran status, status as a victim of domestic violence, sexual assault or stalking, medical condition, genetic information, or any other protected class or category recognized by applicable equal employment opportunity or other similar laws.
BlackLine recognizes that the ways we work and the workplace itself have shifted. We innovate in a workplace that optimizes a combination of virtual and in-person interactions to maximize collaboration and nurture our culture. Candidates who live within a reasonable commute to one of our offices will work in the office at least 2 days a week.
Salary Range:
USD $193,000.00/Yr. - USD $242,000.00/Yr.
Pay Transparency Statement:
Placement within this range depends upon several factors, including the applicant's prior relevant job experience, skill set, and geographic location. In addition to base pay, BlackLine also offers short-term and long-term incentive programs, based on eligibility, along with a robust offering of benefit and wellness plans.
BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.
Accommodations:
BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.
It's fun to work in a company where people truly believe in what they're doing!
At BlackLine, we're committed to bringing passion and customer focus to the business of enterprise applications.
Since being founded in 2001, BlackLine has become a leading provider of cloud software that automates and controls the entire financial close process. Our vision is to modernize the finance and accounting function to enable greater operational effectiveness and agility, and we are committed to delivering innovative solutions and services to empower accounting and finance leaders around the world to achieve Modern Finance.
Being a best-in-class SaaS Company, we understand that bringing in new ideas and innovative technology is mission critical. At BlackLine we are always working with new, cutting edge technology that encourages our teams to learn something new and expand their creativity and technical skillset that will accelerate their careers.
Work, Play and Grow at BlackLine!
Make Your Mark:
We're looking for a Lead Data Engineer to design, build, and optimize data pipelines that power our next-generation AI-driven accounting agents. You'll lead the development of scalable, high-performance data infrastructure while collaborating closely across teams.
You'll Get To:
- Lead data pipeline development: Build and maintain PySpark ETL pipelines with high data quality and performance
- Manage integrations: Establish robust connections to client data sources via APIs and tools like FiveTran, Plaid, and BlackLine's own internal connector ecosystem
- Ensure reliability: Monitor pipeline performance, automate testing, and validate data accuracy
- Optimize for scale: Implement performance improvements (e.g., CDC mechanisms, indexing strategies) for large-scale datasets
- Collaborate & innovate: Work with business stakeholders to refine data requirements and integrate cutting-edge AI and big data technologies
What You'll Bring:
Years of Experience in Related Field: 3+ years of experience as a Data Engineer or a similar role
Education: Bachelor's degree in Computer Science, Engineering or a related field
Technical/Specialized Knowledge, Skills, and Abilities:
- Technical skills: Expertise in PySpark and data transformation pipelines. Familiarity with AI technologies and cloud platforms (AWS, Azure) is a plus
- Communication: Strong communication skills and a proactive, ownership-driven mindset
- Adaptability: Thrive in a fast-paced, in-office-first startup environment
We're Even More Excited If You Have:
- Understanding of data privacy and security best practices particularly in the age of AI
- Strong analytical and problem-solving skills
- Experience in fin-tech or financial services industry a plus
Thrive at BlackLine Because You Are Joining:
- A technology-based company with a sense of adventure and a vision for the future. Every door at BlackLine is open. Just bring your brains, your problem-solving skills, and be part of a winning team at the world's most trusted name in Finance Automation!
- A culture that is kind, open, and accepting. It's a place where people can embrace what makes them unique, and the mix of cultural backgrounds and varying interests cultivates diverse thought and perspectives.
- A culture where BlackLiner's continued growth and learning is empowered. BlackLine offers a wide variety of professional development seminars and inclusive affinity groups to celebrate and support our diversity.
BlackLine is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity or expression, race, ethnicity, age, religious creed, national origin, physical or mental disability, ancestry, color, marital status, sexual orientation, military or veteran status, status as a victim of domestic violence, sexual assault or stalking, medical condition, genetic information, or any other protected class or category recognized by applicable equal employment opportunity or other similar laws.
BlackLine recognizes that the ways we work and the workplace itself have shifted. We innovate in a workplace that optimizes a combination of virtual and in-person interactions to maximize collaboration and nurture our culture. Candidates who live within a reasonable commute to one of our offices will work in the office at least 2 days a week.
Salary Range:
USD $193,000.00/Yr. - USD $242,000.00/Yr.
Pay Transparency Statement:
Placement within this range depends upon several factors, including the applicant's prior relevant job experience, skill set, and geographic location. In addition to base pay, BlackLine also offers short-term and long-term incentive programs, based on eligibility, along with a robust offering of benefit and wellness plans.
BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.
Accommodations:
BlackLine is committed to creating an inclusive and accessible experience for all candidates. If you require a reasonable accommodation that would better enable your success during the application or interview process, please complete this form.
Top Skills
APIs
AWS
Azure
Fivetran
Plaid
Pyspark
BlackLine New York, New York, USA Office
250 West 34th Street, New York, NY, United States, 10119
Similar Jobs at BlackLine
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Responsible for building, securing, and operating systems for WiseLayer's production environment, including CI/CD pipelines, cloud services, and security hardening initiatives.
Top Skills:
AnsibleAws CloudformationBashCircleCIDockerElk StackGCPGitlab CiGrafanaIstioJenkinsKubernetesLinkerdMongoDBMySQLPostgresPowershellPrometheusPythonRedisSQLTerraform
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Senior Platform Engineer will design and maintain a fin-tech AI platform, optimize backend logic, integrate AI models, and collaborate on feature implementation.
Top Skills:
AnsibleAWSAzureDockerGCPGrafanaHibernateJaegerJavaKubernetesNoSQLPrometheusSpring BootSpring Data JpaSpring FrameworkSQLTerraformZipkin
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
As an AI Staff Engineer at BlackLine, you'll develop and refine AI features, collaborate on integrating solutions, and enhance AI capabilities for financial applications, requiring extensive experience with LLMs and production systems.
Top Skills:
AnthropicData PipelinesEltETLGoogleJavaJavaScriptLlm ApisOpenaiRagReact
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

