Intersection is revolutionizing the way information is shared in public spaces to ease and enrich people’s journeys through their cities and connect them to their communities. We connect brands with people where they are via relevant and impactful experiences, and we earn the trust of our partners through our shared mission, working together to build the foundation for a connected future.

We are looking for a Data Engineer who will work to collect, store, process, enhance, secure and analyze small to large datasets. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company and working with different business units and their analysts to properly gain intelligence from disparate data.

Responsibilities:

• Help to select and integrate tools and frameworks required to provide requested capabilities.
• Design and implement a secure data pipeline architecture.
• Implement ETL processes that utilize the full line of AWS services.
• Monitor performance and advise about any necessary infrastructure changes to improve performance.
• Help define policies for the data engineering group.
• Implement security best practices across the whole data engineering architecture

 Skills and Qualifications:

• Proficient understanding of distributed computing principles
• Production experience with tools such as Hadoop, AWS Kinesis, Kafka, AWS EMR. Experience architecting pipelines with these tools.
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming 
• Some knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Spark.
• Experience integrating data from multiple data sources
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, DynamoDB, CosmosDB
• Experience with RDBMs databases, with a strong preference for Postgresql and Redshift.
• Knowledge of various ETL techniques and frameworks, such as Flume
• Experience with various messaging systems, such as Kafka or RabbitMQ
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Proven ability to take data analyst requirements and translate it to a data pipeline that meets the analyst's needs.

About Intersection:

We are revolutionizing the way information is shared in public spaces.

Intersection connects the digital and physical worlds to ease and enrich people’s journeys through their cities. Whether offering public services like free Wi-Fi and calling, providing people with useful information to get where they’re going, or simply brightening their day with native content that can be interactive and location-specific, our products help people engage with their communities and the cities around them.

Our wide-ranging expertise includes technology and design solutions; advertising innovation, production, and sales; and operations, maintenance, and support. We pair our human-centered methodology with cutting-edge technology, from virtual and augmented reality to machine learning, conversational commerce, and more. Whether partnering with private developers to create unforgettable experiences in neighborhoods and districts, with urban transit systems to revolutionize commuting and travel, or with municipalities and city agencies to transform how they connect with residents and visitors, our solutions are scalable platforms on which our clients can build the future.

Intersection was formed in 2015 as a merger between Titan, the largest municipal out of home company, and Control Group, a leader in technology and design innovation. We are backed by Sidewalk Labs, Alphabet’s urban technology company.

Intersection is an Equal Opportunity Employer.