Infatica Logo

Infatica

Scraping Tech Lead(Web scraping & Anti-bot)

Reposted 21 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in Nigeria
Senior level
Remote
Hiring Remotely in Nigeria
Senior level
Lead the web scraping development team, design architecture, manage development processes, conduct anti-bot research, and oversee DevOps operations.
The summary above was generated by AI

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure. 

Key Responsibilities

Architecture Design

  • Data-plane: high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
  • Control-plane: API, authorization, billing, quotas, monitoring
  • Infrastructure: microservices, Docker/K8s, CI/CD, observability

Development Leadership

  • Team building: participate in hiring backend, browser, DevOps, and QA engineers
  • Establish development and release processes
  • Code quality control and technical decision oversight

Anti-Bot Research & Bypass

  • Browser and network-level fingerprinting (JA3, TLS, CDP)
  • Protection bypass: Cloudflare, Akamai, Qrator, ServicePipe, Variti, and others

DevOps / SRE

  • CI/CD setup, Helm charts, scaling configuration
  • Monitoring organization (Prometheus, Grafana, Loki) and SLA processes

Requirements

Requirements

  • 5+ years of engineering experience in high-load backend/data platforms
  • Extensive Scraping experience (mandatory)
  • Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
  • Experience with async Python and Go (ideally both), Redis, queues, message brokers
  • Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
  • Experience analyzing and bypassing bot protection systems — strong plus
  • Fluent English (all documentation and part of the team are English-speaking)
  • Decision-making skills, mentoring abilities, and accountability for results

Benefits

What We Offer

  • Participate in developing the company's key product from scratch
  • High autonomy and influence on architecture and team decisions
  • Budget for conferences, courses, and work tools
  • Competitive compensation package
  • Remote work flexibility

Join us 

This is a unique opportunity to build a world-class product from the ground up and establish yourself as a key technical decision-maker in a rapidly growing company.

Apply now and become the technical leader who shapes our platform's future!

Top Skills

Ci/Cd
Docker
Go
Helm
Kubernetes
Prometheus
Python
Redis

Similar Jobs

21 Hours Ago
Remote
6 Locations
Senior level
Senior level
Artificial Intelligence • Healthtech • Software
Seeking a Senior Product UI/UX Designer to enhance a health app. Responsibilities include leading design strategy, refining a Figma design system, ensuring cross-platform UI, and mentoring design teams, with a focus on gamification and user engagement.
Top Skills: FigmaJSON
22 Hours Ago
Remote
Nigeria
Entry level
Entry level
Machine Learning • Natural Language Processing
Join a global network to participate in flexible, remote projects in AI data annotation, evaluation, and prompt creation, working on your terms.
22 Hours Ago
Remote
Nigeria
Entry level
Entry level
Machine Learning • Natural Language Processing
Join Welo Data's talent community to work on flexible, remote projects in AI data annotation, evaluation, and prompt creation.
Top Skills: Digital Tools

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account