Data Platform Engineer, Streaming Compute
We’re Coinbase. We’re the world’s most trusted way to join the crypto revolution, serving more than 89 million accounts in more than 100 countries.
Our mission is to increase economic freedom around the world, and we couldn’t do this without hiring the best people. We’re a group of hard-working overachievers who are deeply focused on building the future of finance and Web 3.0 for our users across the globe, whether they’re trading, storing, staking or using crypto. Know those people who always lead the group project? That’s us.
There are a few things we look for across all hires we make at Coinbase, regardless of role or team. First, we look for candidates who will thrive in a culture like ours, where we default to trust, embrace feedback, and disrupt ourselves. Second, we expect all employees to commit to our mission-focused approach to our work. Finally, we seek people who are excited to learn about and live crypto, because those are the folks who enjoy the intense moments in our sprint and recharge work culture. We’re a remote-first company looking to hire the absolute best talent all over the world.
Ready to #LiveCrypto? Who you are:
- You’ve got positive energy. You’re optimistic about the future and determined to get there.
- You’re never tired of learning. You want to be a pro in bleeding edge tech like DeFi, NFTs, DAOs, and Web 3.0.
- You appreciate direct communication. You’re both an active communicator and an eager listener - because let’s face it, you can’t have one without the other. You’re cool with candid feedback and see every setback as an opportunity to grow.
- You can pivot on the fly. Crypto is constantly evolving, so our priorities do, too. What you worked on last month may not be what you work on today, and that excites you. You’re not looking for a boring job.
- You have a “can do” attitude. Our teams create high-quality work on quick timelines. Owning a problem doesn’t scare you, but rather empowers you to take 100% responsibility for achieving our mission.
- You want to be part of a winning team. We’re stronger together, and you’re a person who embraces being pushed out of your comfort zone.
The Data Platform team builds and operates systems to centralize all of Coinbase's internal and third-party data, making it easy for teams across the company to access, process, and transform that data for analytics, machine learning, and powering end-user experiences. As an engineer on the team you will contribute to the full spectrum of our systems, from managing foundational processing and data storage, to building and maintaining scalable pipelines, to developing frameworks, tools, and internal applications to make that data easily and efficiently available to other teams and systems.
We have a number of open roles within the Data Platform team, each with a different focus area; read on to see if you’ll be a good fit for Streaming Compute!
What you’ll be doing:
- Support and operate our MSK clusters by integrating services and features as necessary to make it fully self-service and self-managing.
- Become an expert at operating and managing our Databricks clusters, ensuring it as a stable, secure platform for large volume streaming data processing and analysis.
- Build and maintain the infrastructure needed to support a wide range of streaming use cases both within the team and externally.
- Work closely with other teams to evangelize best practices through documentation, tutorials, examples, and complete implementations
To succeed in this role, we also look for:
- Extensive experience building streaming applications and streaming platforms, both as a client and as an operator.
- Well-versed in industry best practices, and you are as comfortable discussing and communicating architectural designs and patterns as you are implementing them.
- Hands-on experience building streaming data systems using Spark on Kafka.
- Hands-on experience building change data capture pipelines using open-source systems such as Debezium and Databricks.
- Hands-on experience standing up, operating, and maintaining Kafka and Spark clusters.
Requirements:
- 3+ years of relevant work experience; 7+ years for a senior role.
- Strong Python or Java backend development skills.
- General experience working with data systems or data pipelines
- Leverage your Python, Airflow, and Looker expertise to scale our Airflow data pipelines to the next 10x level
Preferred (not required):
- Experience with core AWS services and concepts (S3, IAM, autoscaling groups), or devops experience.
Notice for Colorado applicants as required by sb19-085 (8-5-20). Target annual salary for this role performed in Colorado is either $140,250 or $175,000 + target bonus + target equity + benefits (including medical, dental, vision and 401(k)).
ID: G1926
Coinbase is committed to diversity in its workforce and is proud to be an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, sex, gender expression or identity, sexual orientation or any other basis protected by applicable law. Coinbase will also consider for employment qualified applicants with criminal histories in a manner consistent with applicable federal, state and local law. For US applicants, you may view Pay Transparency, Employee Rights and Equal Employment Opportunity is the Law notices by clicking on their corresponding links. Additionally, Coinbase participates in the E-Verify program in certain locations, as required by law.
Coinbase is also committed to providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to accommodations[at]coinbase.com and let us know the nature of your request and your contact information. For quick access to screen reading technology compatible with this site click here to download a free compatible screen reader (free step by step tutorial can be found here).
Global Data Privacy Notice for Job Candidates and Applicants
Depending on your location, the General Data Protection Regulation (GDPR) and California Consumer Privacy Act (CCPA) may regulate the way we manage the data of job applicants. Our full notice outlining how data will be processed as part of the application procedure for applicable locations is available here. By submitting your application, you are agreeing to our use and processing of your data as required.