Python Automation Engineer - Remote

Overview

Looking for a skilled and motivated Web Automation Developer. The ideal candidate will be proficient in Python and experienced in developing and maintaining robust web scraping solutions. This role will focus on utilizing a configuration-based approach to extract data from a diverse range of websites. The developed solutions will be hosted on Amazon Web Services (AWS), with data stored in Amazon S3 buckets.

In Short

• Develop, deploy, and maintain scalable Python web scraping scripts using a configuration-driven approach.
• Extract data from diverse websites, handle site structure changes and anti-scraping measures.
• Use AWS services (S3, Lambda, EC2, CloudWatch, IAM) for hosting, storage, monitoring, and security.
• Design data pipelines for reliable data extraction and storage in S3.
• Collaborate with stakeholders to meet data requirements.
• Maintain documentation and ensure compliance with legal/ethical standards.
• Monitor scraping job performance; implement alerts and recovery mechanisms.

Requirements

• Proven Python developer with expertise in web scraping (Beautiful Soup, Scrapy, Selenium, Playwright).
• Strong knowledge of HTML, CSS, JavaScript, DOM, APIs, JSON, XML.
• Experience with AWS services, primarily S3; familiarity with Lambda, EC2, IAM, CloudWatch preferred.
• Skilled in configuration-driven systems, data extraction, parsing, cleaning.
• Proficient with Git and version control.
• Strong problem-solving, communication, and teamwork skills.
• Bachelor’s degree in CS, Engineering, or equivalent experience.

Benefits

• Full remote, no location restrictions.
• 2+ month project with extension possibility.
• Competitive pay aligned with experience.
• Direct involvement in architecture and system-level decisions.
• Fast-paced, engineering-led environment with client collaboration.