Ref:HR.PROG1225
Python Web Scraping & API Developer
Job Summary
We are seeking a Python Web Scraping & API Developer to join our development team.
The role focuses on building and maintaining reliable data extraction solutions using Python,
including HTML parsing, browser automation, and integrations with external APIs. JavaScript
experience is a plus, particularly for understanding dynamic, client-rendered websites.
Key Responsibilities:
- Develop and maintain web scraping solutions primarily using Python
- Extract, parse, and normalize data from static and dynamic HTML sources
- Integrate and consume data from third-party APIs (REST, GraphQL, JSON, XML)
- Build and maintain data pipelines for processing and storing scraped data
- Handle authentication, pagination, rate limiting, and error recovery
- Monitor scraping jobs and adapt to website structure changes
- Implement performance optimizations and anti-blocking strategies
- Collaborate with backend and data teams to integrate extracted data into production
systems - Write clean, maintainable, and well-documented Python code
Required Skills & Qualifications:
- Strong proficiency in Python
- Hands-on experience with Python-based scraping tools and libraries such as BeautifulSoup, Scrapy, Requests, Playwright, or Selenium
- Solid understanding of HTML, CSS selectors, XPath, and DOM structures
- Experience working with REST APIs and data formats (JSON, XML)
- Good understanding of HTTP concepts (headers, cookies, sessions, status codes)
- Experience with data storage solutions (SQL)
- Strong debugging, problem-solving, and analytical skills
Nice to Have: - Experience with JavaScript for understanding frontend behavior or modifying scraping
logic - Familiarity with JS-rendered sites and tools like Puppeteer or Playwright (JS)
- Experience with proxy management, CAPTCHA handling, or bot-detection mitigation
- Knowledge of cloud platforms, task scheduling, or background workers
- Exposure to data engineering or ETL pipelines
Benefits:
- Opportunities for career growth in a steadily growing company
- A modern and collaborative work environment
- Employee discounts on the company’s products
- Private medical insurance
JOB SUMMARY
Ref:HR.PROG1225
Python Web Scraping & API Developer