Skip to content

A simple yet powerful solution for harvesting and checking proxy servers from various sources.

License

Notifications You must be signed in to change notification settings

ludndev/python-proxy-harvester-checker

Repository files navigation

Python Proxy Harvester and Checker

Python version License Test & Lint

This Python project provides a simple yet powerful solution for harvesting and checking proxy servers from various sources. It includes functionality to fetch proxies from different online sources, check their validity, and store valid proxies for later use.

Features

  • Proxy Harvester: Fetch proxies from multiple online sources such as ProxyScrape and others.
  • Proxy Checker: Verify the validity of proxies by making test requests to a specified URL.
  • Storage: Store valid proxies in a file for later use in your applications.
  • Flexible Architecture: Easily extendable with new proxy sources by implementing the SourceInterface.
  • CLI Interface: Command-line interface for easy interaction and integration into scripts.

Usage

  1. Clone the repository:

    git clone https://github.com/ludndev/python-proxy-harvester-checker.git
  2. Install dependencies:

    pip install -r requirements.txt
  3. Run the example script to harvest and check proxies:

    python example.py
  4. Integrate the ProxyChecker class into your own projects for proxy management.

Configuration

  • proxy_checker.py: Contains the ProxyChecker class responsible for proxy harvesting, checking, and storing.
  • sources/: Directory containing implementations of proxy sources, each implementing the SourceInterface.
  • data/: Directory where valid proxies are stored. (Note: proxy_list.txt is ignored by default in .gitignore)

Documentations & Examples

DOCS.

Contributing

Contributions to this project are welcome! If you have any ideas for new features, bug fixes, or improvements, please feel free to open an issue or submit a pull request.

License

This project is licensed under the MIT License.

About

A simple yet powerful solution for harvesting and checking proxy servers from various sources.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages