Scraping Tech Lead Engineer - Remote

Overview

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.

In Short

• Lead the web scraping development team.
• Drive architectural decisions for the scraping platform.
• Design high-parallel crawlers and session management.
• Oversee API development, authorization, and monitoring.
• Participate in hiring and team building.
• Establish development and release processes.
• Ensure code quality and technical oversight.
• Conduct anti-bot research and bypass strategies.
• Set up CI/CD processes and monitoring.
• Manage scaling configurations and SLA processes.

Requirements

• Experience in web scraping technologies.
• Strong knowledge of anti-bot systems.
• Proficiency in API development.
• Experience with microservices architecture.
• Familiarity with Docker and Kubernetes.
• Skills in CI/CD and observability tools.
• Leadership experience in tech teams.
• Understanding of fingerprinting techniques.
• Knowledge of monitoring tools like Prometheus and Grafana.
• Ability to manage complex infrastructure.

Benefits

• Opportunity to lead a cutting-edge project.
• Work with a talented team of engineers.
• Flexible working conditions.
• Competitive salary and benefits.
• Access to the latest technologies.
• Career growth opportunities.
• Work in an innovative and dynamic environment.
• Contribute to impactful projects.
• Collaborate with international teams.
• Participate in knowledge-sharing sessions.