Senior Python Data Scraping Engineer

Home > Javascript/Typescript programming jobs

Senior Python Data Scraping Engineer in USA new

Mindrift
Full time
Email

USA
10/04/2026
Report

Remote

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
Use custom workflows and available tools to accelerate data collection, validation, and task execution.
Extract data from dynamic and interactive sources, including JavaScript-rendered content, while adapting to changing site behavior.
Apply validation, cross-source consistency checks, formatting controls, and systematic verification to maintain data quality.
Scale scraping operations through batching or parallelization, monitor failures, and maintain stability against minor site changes.

Requirements

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web-scraping experience with BeautifulSoup, Selenium or similar tools, including dynamic content and APIs via proxies.
Experience extracting data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, validation, and delivery of structured CSV, JSON, or Google Sheets datasets.
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain or OpenRouter for automation tasks.
Upper-intermediate English proficiency at B2 level or above is required.
A bachelor’s or master’s degree in engineering, applied mathematics, computer science, or a related technical field is a plus.
A GitHub link is a plus.

Benefits

Remote freelance engagement.
Part-time project workload estimated at approximately 10–20 hours per week during active phases, with no guaranteed workload.
Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

Staff Software Engineer

G-P
Full time

Remote
10/04/2026
Salary: €85k-€114k

Ireland

Full Stack Software Engineer

Vonage
Full time

Remote
10/04/2026

Poland

Senior Frontend Software Engineer

Megaport
Full time

Canada
10/04/2026

Remote

Senior/Staff Software Development Engineer

Fortinet
Full time

USA
10/04/2026
Salary: $150k - $183k/yr

Sunnyvale, CA

Senior Backend Engineer

Numa
Full time

Remote
10/04/2026
Salary: Competitive

Germany