Python Data Engineer

Що робити

• 1. Scraping
• Add new sites to the scraper. Analyze each target site's structure, write parsers with BeautifulSoup4, and map the extracted data into our database models.
• Maintain existing scrapers. Diagnose and fix breakages caused by layout changes, new anti-bot measures, or changed endpoints.
• Work with our adaptive HTTP client. Our client falls back through curl_cffi → httpx → requests → hrequests. You'll tune it per site, handling headers, cookies, sessions, TLS/browser impersonation, and retries.
• Keep daily runs dependable. Add logging, alerting, and failure reporting to our scheduled jobs so problems surface quickly.