Automates the process of downloading pgn files from the US Chess Federation Chess Life Magazine using selenium and webdriver
- Concurrently scrapes multiple pages to find download links
- Downloads files using Selenium with ChromeDriver
- Configurable download directory and browser options
- Logs errors to file for troubleshooting
- Python 3.x
requests
beautifulsoup4
selenium
- ChromeDriver compatible with your Chrome version
- Install the required Python packages:
pip install requests beautifulsoup4 selenium
-
Download a compatible version of ChromeDriver
-
Update
CHROME_PATH
to your Chrome executable. -
Set
CHROME_DRIVER_PATH
to your ChromeDriver executable. -
Optionaly set
DOWNLOAD_DIR
Run the script from the command line:
python clm.py
- Ensure ChromeDriver is compatible with your installed version of Chrome.
- Check the
selenium.log
file for details on any errors encountered during execution. - Verify that the configured download directory exists and is writable.
- Fix issue with Chrome downloading files in wrong directory