Senior Data Engineer

Sorry, this job was removed at 7:23 p.m. (EST) on Tuesday, January 28, 2020
Find out who's hiring in Greater NYC Area.
See all Data + Analytics jobs in Greater NYC Area
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Transfix, named one of Forbes' "Next Billion-Dollar Startups" in 2018, is the leading freight marketplace that's transforming the $800 billion trucking industry, connecting shippers to a national network of reliable carriers. Fortune 500 companies such as Anheuser-Busch, Unilever, and Target rely on Transfix to handle their most important FTL freight needs. With instant pricing tools, guaranteed capacity, data-driven insights, and reliable service, Transfix is changing the world of transportation one load at a time. Join us, and leave a positive impact on the environment as we help reduce the carbon footprint caused by the 65 billion wasted miles on the road.

Based in New York City, Transfix is backed by top VC firms including New Enterprise Associates (NEA), Canvas Ventures, and Lerer Hippeau.

The problems we solve everyday are real and require creativity, grit, and determination. We are building a culture that challenges norms while fostering experimentation and personal growth. We're hiring team members who are passionate and are energized by the vision to simplify and transform one of the largest and most complex industries through technology, data and a strong commitment to customers. 

What you'll do:

  • Design and plan the implementation of data-based architectural frameworks that power logistics business from a data-driven perspective
  • Build algorithms and software against his designs and architecture documents.
  • Assure the quality and performance of data products by using unit tests, integration tests, and monitoring and alerting tools to catch in-flight errors and exceptions.
  • Design, implement, and scale the architecture of Transfix’s data warehouse, including associated data marts.
  • Build and maintain a variety of scalable ETL workflows and event pipelines for pushing data from our production applications and online databases into the warehouse.
  • Write scripts that read from, and write to, external APIs and disparate sources of data (e.g. S3, scrapes of market data, customer APIs, and vendor APIs like Salesforce and Netsuite).
  • Design and maintain appropriate development and testing environments and Continuous Integration / Continuous Delivery (CI/CD) processes that increase safety of changes to our production environment.
  • Manage backup and recovery schedules for production databases.
  • Detect, triage, and resolve issues with production data warehouse and ETLs.
  • Like all engineers on the team, you take part in on-call rotations for your domain area.

About You:

  • Bachelor’s degree in mathematics or a related field plus 4 years of experience in data engineering.
  • 4 years of experience with data storage systems and big data processing frameworks.
  • 4 years of experience with agile software development methodologies.
  • 3 years of data engineering experience designing data warehouses and data pipelines using database replication, ETL, event streaming, and reporting tools.
  • 6 months of administering reporting/analytics tools such as Looker or Tableau.
  • 3 years of experience with Python, Ruby, SQL
  • 6 months of experience with Snowflake and Cloud Based development.
  • 6 months of experience establishing CI/CD processes for automated testing, making frequent changes to production, and managing schema migrations.
  • Must successfully complete competency-based interview.

To all recruitment agencies: Transfix does not accept unsolicited agency resumes and will not be held responsible for any fees related to unsolicited resumes.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

Transfix's NYC HQ is steps from the Oculus and Fulton Center, with access to subway train lines. We are close to tons of restaurants, shops. We are on the top floor so have wonderful light and breathtaking views, including a spectacular view of One World Trade from our outdoor rooftop deck!

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about TransfixFind similar jobs