Senior Python Data Scraping Engineer

Home > Javascript/Typescript programming jobs

Senior Python Data Scraping Engineer in Remote new

Mindrift
Full time
Email

Remote
10/03/2026
Report

Bahrain

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
Use custom workflows and tools to collect, validate, and process data efficiently.
Extract data from dynamic and interactive websites, including JavaScript-rendered content and changing site structures.
Apply validation, cross-source consistency checks, formatting controls, and systematic verification to maintain data quality.
Scale scraping operations through batching or parallelization, monitor failures, and maintain stability against site changes.

Requirements

At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web scraping experience with tools such as BeautifulSoup and Selenium, including dynamic content, AJAX, infinite scroll, and APIs via proxies.
Ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery in CSV, JSON, or Google Sheets.
Experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain or OpenRouter for automation tasks.
English proficiency at Upper-intermediate (B2) level or above.
A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical field is a plus.
A GitHub link is a plus.

Benefits

Remote, part-time freelance arrangement.
Estimated workload of 10–20 hours per week during active project phases, with no guaranteed workload.
Compensation of up to $37 per hour equivalent, depending on level and pace of contribution.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

DevOps Engineer

Betterme
Full time

Remote
10/03/2026

Worldwide

Senior MTS Software Engineer

Clera
Full time

Others
10/03/2026
Salary: Competitive

Zürich, Switzerland

Staff Software Engineer - Web (React)

Sprout Social
Full time

Remote
10/03/2026
Salary: zł 29.4k-zł 36.8k per month

Poland

Lead ML Engineer

Social Discovery Group
Full time

Remote
10/03/2026

Worldwide

Senior Software Engineer, Global Actions

Roblox
Full time

USA
10/03/2026
Salary: $197k - $243k/yr

San Mateo, CA