Data Engineer & Insights Analyst - Contract - Remote

Role: Data Engineer & Insights Analyst 

Location: Harrisburg,PA

Work Mode:  Remote 

Employment Type: Contract

Interview Mode: First Video then In Person

• Job Description:

  We are looking for an experienced Data Engineer & Insights Analyst with 10+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS services, Python, SQL, ETL processes, and Big Data technologies.

  The candidate will be responsible for collecting, integrating, transforming, and analyzing large and complex datasets to support business intelligence, reporting, and data-driven decision-making. The role also involves developing data architecture, improving data quality, and collaborating with data scientists, analysts, and business teams.

  Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and data architecture.

  • Build cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Lambda, and RDS.

  • Develop and optimize ETL/ELT processes using Python, SQL, Java, or Scala.

  • Integrate, transform, and manage large datasets from multiple sources.

  • Work with Big Data technologies such as Apache Spark, Hadoop, and Kafka.

  • Build and manage data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.

  • Develop and maintain relational and NoSQL databases.

  • Create data models, dashboards, reports, and analytical solutions to support business decision-making.

  • Implement data quality checks, monitoring, logging, and validation processes.

  • Ensure data governance, security, privacy, and compliance standards.

  • Support data migration, conversion, and system modernization projects.

  • Collaborate with data scientists, research analysts, and business stakeholders to deliver reliable data solutions.

• Required Skills & Qualifications:

  • Minimum 10+ years of experience in Data Engineering, Data Integration, or related roles.

  • Strong hands-on experience with AWS cloud services, including S3, Glue, Redshift, EMR, Lambda, and Athena.

  • Proficiency in programming languages such as Python, Java, Scala, or R.

  • Advanced knowledge of SQL and relational/NoSQL databases such as Oracle, MS SQL Server, PostgreSQL, and Cassandra.

  • Experience with Big Data technologies including Apache Spark, Hadoop, and Kafka.

  • Hands-on experience with ETL tools such as Informatica, MuleSoft, Talend, or TIBCO.

  • Knowledge of Apache Airflow, Luigi, Azkaban, or similar workflow management tools.

  • Experience with Git, CI/CD pipelines, REST APIs, and data integration.

  • Strong understanding of data modeling, dimensional modeling, Star/Snowflake schemas, and Data Vault.

  • Knowledge of data governance, metadata management, data lineage, and data quality frameworks.

  • Strong analytical, problem-solving, project management, and communication skills.

• Preferred Experience:

  • Experience working with higher education or student-level datasets.

  • Knowledge of integrating education data with employment and wage records.

  • Experience handling large, complex, and confidential datasets.

  • Experience developing analytics solutions, dashboards, and reports for business or government organizations.

• Ideal Candidate Profile:

  A strong Data Engineer with a combination of AWS cloud expertise, Python/SQL programming, ETL development, and Big Data experience, along with the ability to transform complex datasets into meaningful insights and support data-driven decision-making.