Similar Jobs
Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.
The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).
We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.
Key Responsibilities
Architecture Design
- Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Control-plane: API, authorization, billing, quotas, monitoring
- Infrastructure: microservices, Docker/K8s, CI/CD, observability
Development Leadership
- Team building: participate in hiring backend, browser, DevOps, and QA engineers
- Establish development and release processes
- Code quality control and technical decision oversight
Anti-Bot Research & Bypass
- Browser and network-level fingerprinting (JA3, TLS, CDP)
- Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others
DevOps / SRE
- CI/CD setup, Helm charts, scaling configuration
- Monitoring organization (Prometheus, Grafana, Loki) and SLA processes
Requirements
Requirements
- 5+ years of engineering experience in high-load backend/data platforms
- Extensive Scraping experience (mandatory)
- Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
- Experience with async Python and Go (ideally both), Redis, queues, message brokers
- Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
- Experience analyzing and bypassing bot protection systems — strong plus
- Fluent English (all documentation and part of the team are English-speaking)
- Decision-making skills, mentoring abilities, and accountability for results
Benefits
What We Offer
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- Competitive compensation package
- Remote work flexibility
Join us
This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.
Apply now and become the technical leader who shapes our platform's future!
What you need to know about the NYC Tech Scene
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
