Senior Data Engineer
Greater NYC Area
2 weeks ago
Work with industry standard and/or open source software such as PostgreSQL, Kafka, Airflow, Hive, etc.Implement and maintain a data management and governance framework.
Support machine learning and application teams by setting up custom data solutions.
Design, maintain, and scale Kensho’s data pipeline and document processing platform.
Build event and batch driven ingestion systems for stand-alone software products, machine learning R&D, and API services.
Develop and administer databases, knowledge bases, and distributed data stores.
Create and use systems to clean, integrate, or fuse datasets to produce data products.
Perform continuous and periodic studies on systems cost efficiency, performance, and overall health
Establish and monitor data integrity and value through visualization, profiling, and statistical tools.
Implement and maintain a data management and governance framework.