Senior Python Data Scraping Engineer

Home > Python programming jobs

Senior Python Data Scraping Engineer in Remote new

Mindrift
Full time
Email

Remote
10/04/2026
Report

Costa Rica

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
Use Python scraping tools and custom workflows to collect, validate, normalize, and process data.
Extract information from JavaScript-rendered and interactive sources, adapting to changing site behavior and dynamic structures.
Handle anti-bot mechanisms and maintain reliable extraction at scale.
Apply validation, formatting, cross-source consistency checks, and systematic verification to ensure data quality.
Scale scraping operations through efficient batching or parallelization, monitor failures, and maintain stability against minor site changes.

Requirements

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong experience with Python web scraping, including BeautifulSoup, Selenium or similar tools, dynamic content, and APIs via proxies.
Experience extracting data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery in structured formats such as CSV, JSON, and Google Sheets.
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain and OpenRouter for automation tasks.
English proficiency at Upper-intermediate (B2) level or above.
A GitHub link is a plus; a relevant bachelor's or master's degree is also a plus.

Benefits

Remote freelance, part-time project opportunity.
Estimated workload of approximately 10–20 hours per week during active project phases, with no guaranteed workload.
Compensation of up to $25 per hour equivalent, depending on level and pace of contribution.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

Junior Software Engineer - Python

Telnyx
Full time

Remote
10/04/2026

Brazil

Senior Software Engineer, Voice AI

Clera
Full time

Others
10/04/2026

Berlin, Germany

DevOps Engineer

Anduril Industries
Full time

USA
10/04/2026
Salary: $111k - $147k/yr

Fort Collins, CO

Senior Software Engineer

Mozilla
Full time

Remote
10/04/2026
Salary: €44k-€59k

Finland

Data Engineer - HR support project

InPost
Full time

Remote
10/04/2026

Poland