Sayari is seeking a Data Engineer Intern specializing in web crawling to assist in maintaining and improving its web crawling framework, crucial for collecting and analyzing global corporate and trade data.

In Short

Remote paid internship.
Work expectations of 20-30 hours a week.
Focus on web crawling infrastructure maintenance and improvement.
Collaborate with Product and Software Engineering teams.
Investigate and implement web crawlers for new sources.
Improve metrics and reporting for web crawling.
Enhance ETL processes.
Contribute to the development of Sayari’s data product.

Requirements

Experience with Python.
Experience managing web crawling at scale; Scrapy is a plus.
Familiarity with Kubernetes.
Experience with git for collaborative work.
Knowledge of selectors such as XPath, CSS, JMESPath.
Experience with WebDev tools (Chrome/Firefox).

Benefits

Opportunity to work in a supportive and innovative team.
Gain experience in a cutting-edge data engineering environment.
Possibility of future employment opportunities.

Sayari

Sayari is a leading provider of counterparty and supply chain risk intelligence, serving government agencies, multinational corporations, and financial institutions. With its headquarters in Washington, D.C., Sayari offers an intuitive network analysis platform that uncovers hidden risks through integrated data on corporate ownership, supply chains, and trade transactions from over 250 jurisdictions. The company is committed to enhancing visibility into global commercial and financial networks using open data, fostering a culture of collaboration, innovation, and diversity. Sayari's solutions are utilized by thousands of analysts across more than 35 countries, reflecting its global reach and impact.

Share This Job!

Save This Job!

Jobs from Sayari:

Product Marketing Leader

B2B Product Marketing

Go-to-market Strategy

Competitive Analysis

Data Engineering Intern

Python

Scala

Apache Spark

Business Systems Manager