Medior Data Sourcing Engineer - Remote

Overview

Dashmote is a start-up focusing on the next generation of data products powered by AI technology, with offices in Amsterdam (HQ) and Shanghai. We connect the offline and online worlds by decoding the digital footprint of locations, allowing our enterprise clients to understand the market and make smarter decisions. Dashmote has ambitious plans in the upcoming years, and therefore, we need to make sure that we have the right people in place to put such plans into practice. Do you want to boost your career by contributing to Dashmote’s core product, used by some of the biggest Fortune 500 companies? Then we're looking for you.

In Short

• Responsible for the operation and maintenance of Scrapy crawling projects and data cleaning and extraction work.
• Perform data crawling tasks on web or app based on task requirements.
• Successfully deliver data while ensuring quality.
• Independently solve problems encountered during development and possess good communication skills.
• Interested in new technologies, responsible, willing to share, and assist team technical growth.

Requirements

• More than 2 years of work experience, Bachelor's degree or above in Computer Science, Engineering, or related disciplines.
• Familiar with Python.
• Understand web scraping principles, HTTP protocol, and common anti-scraping principles.
• Proficient in using requests, Scrapy, BS4, XPath, Regex, and other tools for web requests and data extraction.
• Familiar with data cleaning and able to use Pandas/Spark for data processing.
• Familiar with version control tools (e.g., Git) and database-related technologies.
• Understand JS reverse engineering techniques and common JS anti-scraping methods, familiar with JS debugging, positioning, and injection.
• Understand Android reverse engineering techniques, master concepts such as packet capturing and hooking.
• Experience with overseas food delivery platforms is preferred.
• Proficiency in English is preferred.

Benefits

• Great office location right in the city center of Shanghai.
• Dashmote Flex: a mix of working from home and the office + 20 days of working remotely (anywhere in the world!).
• Market-competitive holiday policy.
• Company Laptop.
• Referral Bonus.
• Annual learning budget.
• Annual health check.
• Working for a company that was awarded the best B2B startup in Europe by Google, McKinsey, and Rocket Internet.
• Working within an international team that truly values your contribution.
• An awesome culture of responsibility and the freedom to turn your ambition into reality, regardless of your role and level.
• Exciting work atmosphere with no shortage of fun team events, gatherings, and snacks both in person and online.