Xperteez Technology Logo

Xperteez Technology

Big Data Engineer | Remote - Contract

Posted 9 Hours Ago
Remote
Hiring Remotely in United States
Entry level
Remote
Hiring Remotely in United States
Entry level
Design, build, and maintain scalable big data pipelines, architectures, distributed databases, and storage systems. Use Python and frameworks such as Hadoop, Spark, or Flink for data integration, transformation, and processing. Ensure system performance, availability, security, governance, and data quality while collaborating with cross-functional teams and documenting technical solutions.
The summary above was generated by AI

Job Title: Big Data Engineer

Job Type: Contract

Location: Remote

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Required Skills

  • big data

  • Python

  • databases

  • data engineering

Key Responsibilities:

  • Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.

  • Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.

  • Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.

  • Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.

  • Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.

  • Enforce data quality, security, and governance standards across all solutions.

  • Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

  • Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.

  • Advanced proficiency in Python for data processing, automation, and integration.

  • Deep understanding of relational and NoSQL databases, including optimization and management techniques.

  • Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).

  • Strong foundation in data modeling, ETL processes, and data warehousing principles.

  • Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.

  • Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred Qualifications:

  • Prior experience in fast-paced or startup-like environments supporting global teams.

  • Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).

  • Familiarity with machine learning operations and data science workflows is a plus.

Similar Jobs

8 Minutes Ago
In-Office or Remote
141K-176K Annually
Senior level
141K-176K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead secure design reviews, threat modeling, and security risk assessments for products and features. Partner with engineers, product managers, and designers to develop secure architectures, provide remediation guidance, promote security culture through training and mentoring, oversee vulnerability management, and explain security events. Build security tooling, automate secure development practices, and establish architectural patterns and processes that reduce security risk across DigitalOcean’s engineering organization.
Top Skills: CContainerizationContinuous DeliveryContinuous IntegrationGoJavaScriptOwasp Top TenRustVirtualization
8 Minutes Ago
In-Office or Remote
141K-176K Annually
Senior level
141K-176K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead and evolve the insider threat program by engineering detection, automating investigation workflows, tuning UEBA/SIEM/DLP/UAM/SOAR detection content, conducting threat hunting and DFIR, collaborating with HR/Legal, and using data analytics (e.g., Pandas) to investigate anomalous activity and reduce internal risk.
Top Skills: BashCloud InfrastructureDlpGoKubernetesLinuxmacOSMitre Att&CkNistPandasPythonSIEMSoarUamUebaWindows
10 Minutes Ago
Remote
United States
141K-176K Annually
Senior level
141K-176K Annually
Senior level
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Assess product and application architectures, develop threat models, identify security risks, and guide engineering teams on remediation. Promote security culture through training, mentoring, vulnerability management, and internal security initiatives. Build security tooling, automation, patterns, and workflows that embed secure-by-design practices across engineering. Partner with product managers, designers, and engineers to secure complex, large-scale cloud systems.
Top Skills: CContainerizationContinuous DeliveryContinuous IntegrationGoJavaScriptOwaspRustVirtualization

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account