Welcome to the Lienquan Scraper repository! 🦸♂️✨ This project is designed to scrape and store data about heroes and their skins from the popular game Liên Quân Mobile. With this scraper, you can efficiently collect hero data, including images and available skins, and store them in a SQLite database for further analysis or development purposes.
- Hero Data Scraping: Collects names, images, and skins of heroes from the game.
- SQLite Database: Automatically stores scraped data in a structured SQLite database.
To get started with the Lienquan Scraper, follow these steps:
-
Clone the repository:
git clone https://github.com/JuniperNexus/lienquan-scraper.git cd lienquan-scraper
-
Install the required dependencies:
pip install -r requirements.txt
-
Run the scraper:
scrapy crawl heroes
This command will initiate the scraping process, and data will be stored in
heroes.db
.
The database consists of the following tables:
- heroes: Stores unique heroes with their names and image URLs.
- skins: Stores skin details linked to their respective heroes.
CREATE TABLE IF NOT EXISTS heroes (
id INTEGER PRIMARY KEY,
name TEXT UNIQUE,
image_url TEXT
);
CREATE TABLE IF NOT EXISTS skins (
id INTEGER PRIMARY KEY,
hero_id INTEGER,
skin_image_url TEXT,
FOREIGN KEY (hero_id) REFERENCES heroes (id) ON DELETE CASCADE
);
We welcome contributions! If you would like to contribute to this project, please follow these steps:
- Fork the repository.
- Create a new branch (
git checkout -b feature-branch
). - Make your changes and commit them (
git commit -m 'Add new feature'
). - Push to the branch (
git push origin feature-branch
). - Open a pull request.
This project is licensed under the MIT License. See the LICENSE file for more details.
For questions, issues, or suggestions, feel free to open an issue or contact me at [email protected].
Thank you for checking out the Lienquan Scraper! Happy scraping! 🌐