Senior Python Data Scraping Engineer

Home > Javascript/Typescript programming jobs

Senior Python Data Scraping Engineer in USA new

Mindrift
Full time
Email

USA
09/23/2026
Report

Remote

Responsibilities

Own end-to-end data extraction workflows across complex websites and deliver accurate structured datasets.
Use custom workflows and technical tools to accelerate data collection, validation, and task execution.
Extract data from dynamic and interactive sources, including JavaScript-rendered content, while adapting to changing site behavior.
Apply validation checks, cross-source consistency controls, formatting standards, and systematic verification to ensure data quality.
Scale scraping operations through efficient batching or parallelization, monitor failures, and maintain stability against site structure changes.

Requirements

At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
Strong Python web scraping experience with BeautifulSoup, Selenium or similar tools, including dynamic content and APIs via proxies.
Ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
Experience with data cleaning, normalization, and validation, delivering structured datasets in CSV, JSON, or Google Sheets.
Experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with AWS or equivalent cloud infrastructure and Docker containerization.
Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
Upper-intermediate English proficiency at B2 level or above.
A bachelor's or master's degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
A GitHub link is a plus.

Benefits

Remote freelance work with an estimated 10–20 hours per week during active project phases.
Part-time project engagement with workload dependent on project requirements and active phases.

Mindrift

Mindrift connects specialists with project-based AI opportunities at leading tech companies, enabling them to test, evaluate, and enhance AI systems. With a flexible freelance model, experts can earn competitive rates while contributing to innovative AI development.

Similar positions

Copy of Principal Software Engineer

Canva
Full time

Others
09/23/2026

Beijing, China

Contract Staff Front End Engineer

Mozilla
Contract

Canada
09/23/2026

Remote

Senior Security Engineer, Bug Bounty

Mozilla
Full time

Canada
09/23/2026
Salary: C$95k-C$139k

Remote

Senior Fullstack Software Engineer

Waymo
Full time

USA
09/23/2026
Salary: $170k - $216k/yr

San Francisco, CA

Mobile Software Engineer

Lifted
Full time

Remote
09/23/2026

Mexico