RemoteLeads Logo
Sign Up Sign In

Senior Python Data Scraping Engineer (Freelance)

5 days, 2 hours ago
Germany
Freelance
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 74

Description

  • Own end-to-end data extraction workflows across complex websites.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up data collection, validation, and execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability against minor site structure changes.
  • Collect, structure, and validate data from diverse sources.
  • Troubleshoot scraping and automation issues independently.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with structured outputs in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • English proficiency at Upper-intermediate (B2) or above.
  • Strong attention to detail and ability to work independently.
  • A link to GitHub is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Around 10–20 hours per week during active project phases.
  • Up to $45 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

F

Kotlin Backend Engineer - (Freelance/Service Agreement)

Flix SE 1001-5000 Travel tech

Flix is seeking a Kotlin Backend Engineer to help modernize and run the backend platform for its partner-facing B2B Sales & Distribution ecosystem, including internal tools, partner services, and AI-enabled operations.

Poland Freelance Mid Level Backend Engineer
AWS CI/CD Datadog Kafka Kotlin Kubernetes MySQL PostgreSQL REST API Spring Boot SQL Terraform
1 day, 1 hour ago
F

Kotlin Backend Engineer - (Freelance/Service Agreement)

Flix SE 1001-5000 Travel tech

Flix is seeking a Kotlin Backend Engineer to help modernize and operate the backend platform behind its partner-facing B2B Sales & Distribution ecosystem.

Poland Freelance Senior Backend Engineer
AWS Datadog Kafka Kotlin Kubernetes MySQL PostgreSQL REST API Spring Boot SQL Terraform
1 day, 1 hour ago
Devsu

Semi Senior / Senior Data Engineer (AWS, Python & SQL)

Devsu 51-250 Internet Software & Services

Devsu is hiring a Senior Data Engineer to design and optimize scalable AWS data platforms and pipelines that support analytics, ecommerce, logistics, and marketing initiatives.

Colombia Contract Senior Data Engineer
Apache Airflow Apache Spark AWS Docker Kafka Kubernetes Python R Ruby Snowflake SQL
1 day, 1 hour ago
ProArch

Sr Backend Engineer

ProArch 251-1K Internet Software & Services

This role at the company supports technology decisions to transform software development, improve developer productivity, and accelerate solution delivery for internal and customer-facing systems.

United States Contract Senior Backend Engineer
Agile CRM HIPAA Salesforce Serverless System Design
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers