Web Scraping Engineer

In this role, you will: Design and build high-scale crawlers, scrapers, and the surrounding infrastructure capable of handling thousands to millions of requests.

Take client requirements and own projects end-to-end, building custom solutions from scratch without waiting for detailed specifications.

Write functional, reusable code in Python or Go, heavily leveraging AI-driven IDEs to maximize output and efficiency.

Work within our data platform to enable the seamless building and delivery of large datasets.

Use internal scraping tools or build new ones as priorities and client routes change.

Justify technical decisions, perform code reviews, and collaborate closely with the team to ensure quality solutions.

Your skills & experiences: Multiple years of backend development experience with Python or Go (or strong web scraping expertise driven by AI tools).

Familiarity with web scraping fundamentals, parsing, headless browsers, and databases like PostgreSQL or BigQuery.

High level of independence—you can align on an approach in a discussion and then fully own the delivery.

A business-first mentality that prioritizes speed and delivery over perfection, with a "thick skin" for direct feedback.

Hands-on experience and a strong comfort level with AI-driven development tools (such as Cursor, Claude Code, or Antigravity).

Nice to have: Experience in data engineering: ETL/ELT pipelines, Spark, Airflow, Dagster, etc.

Tech stack: Python, Go

Databases: PostgreSQL, BigQuery

Hosting: Google Cloud, Hetzner, private cloud

Scraping tools: Playwright, internal APIs, Camoufox, headless browsers

Data Engineering: Airflow

AI tools: Claude Code, Cursor

Salary & Benefits Gross salary: 4400 - 7000 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competencies.

Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing.

Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app.

Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together.

Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need. See the full list of benefits here: https://career.oxylabs.io/blog/our-work-benefits/