Remote Tech Lead Engineer (Web Scraping & Anti-Bot)

Overview

Infatica.io is a global provider of proxy and DaaS solutions. We're building our own high-load web scraping platform: an API where you can submit any URL and receive clean HTML or structured JSON output, without worrying about proxies, CAPTCHAs, or anti-bot systems.

The platform will support both cloud deployment and on-premises deployment in client infrastructure (on-prem, Kubernetes).

We are now looking for an experienced Tech Lead for our web scraping development team who will lead the team, become the technical leader of the platform, drive architectural decisions, and shape the future of our cutting-edge scraping infrastructure.

In Short

• Lead the web scraping development team.
• Drive architectural decisions for the scraping platform.
• Manage high-parallel crawlers and session management.
• Oversee API architecture and authorization processes.
• Participate in hiring backend, browser, DevOps, and QA engineers.
• Establish development and release processes.
• Conduct anti-bot research and bypass techniques.
• Set up CI/CD processes and monitoring systems.
• Ensure code quality and technical decision oversight.
• Organize monitoring with tools like Prometheus and Grafana.

Requirements

• Experience in web scraping technologies.
• Strong background in API development.
• Knowledge of microservices architecture.
• Proficiency in Docker and Kubernetes.
• Experience with CI/CD practices.
• Familiarity with anti-bot solutions.
• Leadership skills in team management.
• Ability to conduct research on security bypass techniques.
• Experience in monitoring and observability tools.
• Strong problem-solving skills.

Benefits

• Work remotely from anywhere.
• Competitive salary and benefits.
• Opportunity to lead innovative projects.
• Collaborative and supportive team environment.
• Professional development opportunities.
• Flexible working hours.
• Access to cutting-edge technology.
• Work on impactful projects in the tech industry.
• Health and wellness benefits.
• Company-sponsored events and activities.