Backend Data Developer - Remote

Overview

We are looking for a Backend Data Developer with experience in data ingestion from web portals and converting scrapers from Java to Python. The ideal candidate has skills in data extraction and processing, scraper optimization, and modernizing architectures to improve efficiency.

In Short

• Develop and maintain scrapers to extract data from web portals.
• Experience with Selenium, Puppeteer, or Playwright for dynamic scraping.
• Handle headers, user-agents, proxies, and techniques to avoid blocks and captchas.
• Consume REST and GraphQL APIs for data extraction.
• Experience with Java (Spring Boot, Jsoup, HttpClient) and Python (Scrapy, Selenium, Playwright, FastAPI).
• Refactor and optimize legacy scrapers from Java to Python.
• Implement more efficient architectures to improve performance.
• Experience with pandas and NumPy for data manipulation and cleaning.
• Knowledge of SQL databases (PostgreSQL, MySQL, SQL Server).
• Deployment in AWS or GCP with Docker and Kubernetes.

Requirements

• Backend Developer focused on scraping and data processing.
• Experience in Python and knowledge of Java (ideally for migrations).
• Ability to optimize and modernize scrapers with efficient technologies.
• Skills in data storage and structuring.
• Desirable experience in ETL and data flow automation.

Benefits

• 100% Remote work.
• Contract type: Contractor, initially for 3 months with the possibility of renewal.
• Full-time dedication.
• No English required.
• Competitive salary.