Data Collection & Web Scraping Intern (6 months)

As a Web Scraping & Data Collection Intern, you'll be responsible for feeding and monitoring the data that powers our platform. Concretely, you'll:

Configure and run scrapers on new and existing websites using our in-house scraping framework Investigate target websites to identify undocumented or public APIs, and figure out the most reliable way to collect their data Write Python scripts and notebooks to collect, extract, and structure data from a wide variety of sources Run quality checks on collected data: completeness, consistency, detecting when a source breaks or silently changes Run and monitor existing collection pipelines, and flag or fix issues when a source stops behaving Answer ad hoc questions on our database with SQL queries (volumes, coverage, anomalies) for internal and client-facing needs