Sequoia Connect Logo

Sequoia Connect

Data Infrastructure Architect

Posted 3 Days Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Atlanta, GA
Expert/Leader
In-Office or Remote
Hiring Remotely in Atlanta, GA
Expert/Leader
Design and implement scalable batch and near-real-time data pipelines and storage on AWS. Define data architecture, ensure observability, optimize performance, lead production troubleshooting and migrations, enforce CI/CD and deployment best practices, and collaborate with stakeholders and platform teams to align solutions with business needs.
The summary above was generated by AI
Description

At Sequoia Connect, we are a Talent-First Technology Ecosystem that redefines how elite professionals interact with the global digital landscape. We move beyond traditional models to act as a catalyst for the top 1% of global talent, connecting human potential with complex industrial execution. By joining our inner circle, you are not simply taking a position; you are aligning with a strategic partner dedicated to updating your "Human OS" and accelerating your growth through world-class, high-impact projects.

We are currently partnering with a rapidly growing, automation-led powerhouse that serves 31 Fortune 500 companies across the financial, healthcare, and manufacturing sectors. With a global workforce of over 32,000 employees and a presence in 28 countries, our client is a titan of digital transformation. Their "Automate Everything, Cloudify Everything" strategy ensures you will be working at the absolute forefront of AI-driven automation and cloud solutions.

This is your chance to thrive in a "Customer Success, First and Always" environment that prizes continuous learning and radical ownership. You will collaborate within an international network of expertise across 39 delivery centers worldwide, gaining exposure to complex engineering challenges that redefine industrial standards. If you are a driven professional looking for a dynamic, forward-thinking workplace where your growth is the priority, this is where you belong.

We are currently searching for a Data Infrastructure Architect:

The Challenge (Responsibilities)

  • Architect and implement scalable batch and near-real-time data pipelines using Python, PySpark, Glue, EMR, Lambda, and Step Functions.
  • Define data storage, transformation, and access patterns across S3, Redshift, Athena, RDS, and DynamoDB.
  • Design event-driven and integration solutions using SNS, SQS, Kinesis, and APIs.
  • Establish standards for data quality, observability, monitoring, logging, and failure recovery.
  • Optimize data processing, storage, and query performance across AWS platforms.
  • Lead troubleshooting of production issues and drive root cause analysis and corrective actions.
  • Support cloud migration, data migration, and modernization initiatives.
  • Review solution designs, code quality, and production readiness across projects.
  • Collaborate with architects, platform teams, and business stakeholders to align technical solutions with business needs.
  • Drive best practices for CI/CD, deployment automation, and documentation.

Your Profile (Requirements)

  • Degree holders for the visa application process.
  • 12+ years of software development experience with a solid IT background.
  • Experience as an application developer for projects similar in scope and responsibility.
  • Advanced knowledge of AWS services and architecture.
  • Strong experience with Python object-oriented programming, PySpark, SQL, and ETL frameworks.
  • Deep experience with AWS services including Glue, EMR, Redshift, RDS, Athena, Lambda, Step Functions, SNS, SQS, S3, CloudWatch, and CloudTrail.
  • Strong understanding of enterprise data architecture, migration, and support models.
  • Experience with GitLab and Terraform and release/deployment practices.
  • High-Performance Mindset: Resilience, emotional intelligence, and a focus on agile delivery.
  • Technologist DNA: A deep understanding of the difference between "coding" and "engineering."

Desired

  • Experience with Kinesis, ECS, Batch, Beanstalk, and DynamoDB.
  • Exposure to infrastructure-as-code and reusable platform patterns.
  • Have a good understanding of performance engineering of code pipelines and near real-time systems.
  • Good understanding of Agents and MCP.
  • Familiarity with cloud-native foundations or AI coding assistants.

Languages

  • Advanced Oral English: For seamless collaboration with global teams.
  • Advanced Spanish.

Special Notes

  • None specified.

Work Arrangement

We value flexibility to support your lifestyle. This position is available as:

  • Remote

If you meet these qualifications and are pursuing new challenges, start your application on our website to join an award-winning employer. Explore all our job openings | Sequoia Career’s Page: https://www.sequoia-connect.com/careers/

Requirements
  • Solid IT background and experience.
  • Experience as an application developer for projects similar in scope and responsibility.
  • Advanced knowledge of AWS services and architecture.
  • Strong experience with Python object-oriented programming, PySpark, SQL, and ETL frameworks.
  • Deep experience with AWS services including Glue, EMR, Redshift, RDS, Athena, Lambda, Step Functions, SNS, SQS, S3, CloudWatch, and CloudTrail.
  • Strong understanding of enterprise data architecture, migration, and support models.
  • Experience with GitLab and Terraform and release/deployment practices.

Similar Jobs

3 Days Ago
Remote
United States
Expert/Leader
Expert/Leader
Information Technology • Consulting
Design and implement scalable batch and near-real-time data pipelines and storage across AWS. Define event-driven integrations, ensure data quality and observability, optimize performance, lead production troubleshooting and migrations, review designs and CI/CD practices, and collaborate with architects and stakeholders to align solutions to business needs.
Top Skills: Amazon AthenaAmazon DynamodbAmazon EmrAmazon KinesisAmazon RdsAmazon RedshiftAmazon S3Amazon SnsAmazon SqsAPIsAws BatchAws CloudtrailAws CloudwatchAws GlueAws LambdaAws Step FunctionsEcsElastic BeanstalkEtl FrameworksGitlabPysparkPythonSQLTerraform
47 Minutes Ago
Remote or Hybrid
USA
200K-280K Annually
Senior level
200K-280K Annually
Senior level
Edtech • Information Technology • Software
Drive new business and expand existing enterprise accounts by managing full sales cycles, developing territory and account plans, researching customer priorities, applying Pluralsight's sales framework, partnering cross-functionally, and closing complex, multi-stakeholder SaaS deals. Travel to customer sites as needed to advance partnerships and revenue.
Top Skills: SaaS
An Hour Ago
Remote or Hybrid
US
156K-241K Annually
Expert/Leader
156K-241K Annually
Expert/Leader
Information Technology
Lead design and implementation of scalable Databricks Lakehouse solutions using Delta Lake, Unity Catalog, and MLflow. Advise stakeholders, drive cloud data platform modernization across Azure/AWS/GCP, ensure data governance and quality, optimize performance and cost, and mentor teams. Support presales, deliver billable consulting, and champion AI/ML-enabled data solutions to translate platform capabilities into business outcomes.
Top Skills: AWSAzureBatch StreamingData CatalogingData GovernanceData LineageDatabricksDelta LakeEltETLGCPMaster Data ManagementMlflowPysparkPythonRbacScalaSQLUnity Catalog

What you need to know about the NYC Tech Scene

As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.

Key Facts About NYC Tech

  • Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
  • Key Industries: Artificial intelligence, Fintech
  • Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
  • Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account