Job Title: Senior Python Developer – Web Scraping & Automation
Location: Ahmedabad
Job Type: Full-time
Working Days: 5 Days a Week
Role Overview
We are seeking an experienced Senior Python Developer with proven expertise in
Scrapy (must-have) and strong skills in web scraping and automation. The ideal
candidate will design, develop, and optimize large-scale scraping solutions that power
data-driven decision-making.
Key Responsibilities
- Design, develop, and maintain scalable web scraping frameworks using
Scrapy (mandatory). - Work with additional libraries/tools such as BeautifulSoup, Selenium,
Playwright, Requests, etc. - Implement robust error handling, data parsing, and data storage mechanisms
(JSON, CSV, SQL/NoSQL databases). - Build and optimize asynchronous scraping workflows and handle
multithreading/multiprocessing. - Collaborate with product managers, QA, and DevOps teams to ensure timely
delivery. - Research and adopt new scraping technologies to improve performance,
scalability, and efficiency.
Requirements
- 2+ years of experience in Python development with Scrapy expertise (must-
have). - Proficiency with automation libraries such as Playwright or Selenium.
- Experience with REST APIs, asynchronous programming, and concurrency.
- Familiarity with databases (SQL/NoSQL) and cloud-based data pipelines.
- Strong problem-solving skills and ability to meet deadlines in an Agile
environment.
Preferred Qualifications
- Knowledge of DevOps tools such as Docker, GitHub Actions, or CI/CD pipelines.
Benefits
- Competitive salary.
- 5-day work week (Monday–Friday).
- Flexible and collaborative work environment.
- Ample opportunities for career growth and skill development.