A powerful tool for scraping product images and details from various e-commerce websites. This repository contains scripts designed to extract valuable information, enabling users to gather product data efficiently.
- Image Scraping: Download high-quality images of products.
- Detail Extraction: Gather essential product details such as names, prices, and descriptions.
- Multi-Site Support: Easily extendable to support multiple e-commerce platforms.
- Clone the Repository
git clone https://github.com/Abdelmathin/product-scraper.git
cd product-scraper
- Install Dependencies
Make sure to install the required Python packages:
pip install -r requirements.txt
To run the scraper, execute the desired script. Here’s an example of how to use the main scraping script:
python main.py
The script will automatically scrape product details from the following categories:
- Shoes
- Bags
- Accessories
The main script will use the following code structure to scrape each category:
for product in ['shoes', 'bags', 'acc']:
link = 'http://' + product + '.ygshoes188.com/'
s = Scraper(product, link)
s.run()
This project is licensed under the MIT License - see the LICENSE file for details.
Contributions are welcome! If you have suggestions or find issues, feel free to submit a pull request or open an issue in this repository.
For questions or support, please reach out via GitHub Issues or contact me at [email protected].
Web scraping opens up a world of data collection possibilities, making it easier to analyze market trends and compare products across platforms!