Data Engineer

Sorry, this job was removed at 12:42 p.m. (EST) on Tuesday, July 9, 2019
Find out who's hiring in Greater NYC Area.
See all Data + Analytics jobs in Greater NYC Area
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

Transfix, named one of Forbes' "Next Billion-Dollar Startups" in 2018, is the leading freight marketplace that's transforming the $700 billion trucking industry, connecting shippers to a national network of reliable carriers. Fortune 500 companies such as Anheuser-Busch, Unilever, and Target rely on Transfix to handle their most important FTL freight needs. With instant pricing tools, guaranteed capacity, data-driven insights, and reliable service, Transfix is changing the world of transportation one load at a time. Join us, and leave a positive impact on the environment as we help reduce the carbon footprint caused by the 65 billion wasted miles on the road.

Based in New York City, Transfix is backed by top VC firms including New Enterprise Associates (NEA), Canvas Ventures, and Lerer Hippeau. The company has raised more than $78.5 million in funding.

The problems we solve everyday are real and require creativity, grit, and determination. We are building a culture that challenges norms while fostering experimentation and personal growth. We're hiring team members who are passionate and are energized by the vision to simplify and transform one of the largest and most complex industries through technology, data and a strong commitment to customers. 

Our Data Engineers build mission-critical data pipelines and warehouses that power forecasting models (e.g. pricing, capacity, matching) and business insights.

If you’re excited about transforming an industry, being part of an innovative culture, and making a positive impact on the environment, send us your resume.

What you'll do

  • Design, build, and scale our data warehouse.
  • Collaborate with Data Scientists, BI Analysts, Engineers, and Product Managers to gather requirements for specific datasets, reports, and model training.
  • Research new data warehouse and data pipeline solutions. Identify requirements, build prototype implementations, propose adoption, and plan migration paths.
  • Implement data pipelines that aggregate data from various sources and write to a variety of internal and external platforms. (Examples include S3, NetSuite, Salesforce, customer APIs.)
  • Identify and resolve performance bottlenecks in SQL queries, workflows, and model training.
  • Ensure availability of our production data stores and pipelines through building resilient systems, monitoring, alerting, team-wide on-call rotations, and triaging and resolving issues.
  • Participate in blameless post-mortems and retrospectives that enable us to learn from both failures and successes in order to improve team process and software design.
  • Our current data storage infrastructure is comprised of RedShift, PostgreSQL (Amazon RDS), DynamoDB, and Redis. We are hosted on AWS and leverage a variety of their services. We use Ruby and Python heavily throughout our production application and data infrastructure, along with bits of Java. We use Airflow to manage our ETL workflows and Amazon’s Database Migration Service for moving data around.
  • Code review and continuous integration are important parts of all our production code, including data architecture. We use Github and CircleCI and write automated tests using RSpec and unittest.

About you

  • Bachelor’s degree in a STEM or quantitative field, or have equivalent training or work experience.
  • Minimum of 2-years professional software engineering experience (strong preference for experience in data engineering roles or data-intensive environments).
  • Fluency in at least one programming language (Python, Ruby, C++, Java, or Go preferred).
  • Proficiency with SQL, schema design, and query optimization.
  • Experience with Linux command line and shell scripts.
  • Working knowledge of data warehouses, data pipelines, and schedulers.
  • Experience with cloud infrastructure on AWS, Google Cloud, or Azure.
  • You take pride in your work and the quality of products you build.
  • You value collaboration and enjoy teaching and learning from peers.
  • You speak up when you see something wrong and support your opinions with data.

To all recruitment agencies: Transfix does not accept unsolicited agency resumes and will not be held responsible for any fees related to unsolicited resumes.

Read Full Job Description
Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.

Location

Transfix's NYC HQ is steps from the Oculus and Fulton Center, with access to subway train lines. We are close to tons of restaurants, shops. We are on the top floor so have wonderful light and breathtaking views, including a spectacular view of One World Trade from our outdoor rooftop deck!

Similar Jobs

Apply Now
By clicking Apply Now you agree to share your profile information with the hiring company.
Learn more about TransfixFind similar jobs