proxy-grabber – PyPI
Project description
Simple proxy grabber and checker
$ pip3 install proxy-grabber
from proxy_grabber import ProxyGrabber
grabber = ProxyGrabber()
# — Grabbing proxies —
# Parse proxy from different sources
# You can call generate_proxy_list() without arguments if you want to grab as more proxies as possible
ab_proxies(proxy_limit=100)
# — Adding proxies —
# Notice: you can add proxies without grabbing
# You can add some proxies from the file
(‘. /data/’)
# Or you can add proxy manually
d_proxies([‘ip:port’, ‘ip:port’,… ])
# — Checking proxies —
# [optional]
# You can specify proxy countries
t_countries([‘US’, ‘RU’, ‘CA’,… ])
eck_proxies()
# — Get results —
t_proxy() # Random checked proxy
t_checked_proxies() # All checked proxies
(‘. /data/’) # Save checked proxies to the file
Download files
Download the file for your platform. If you’re not sure which to choose, learn more about installing packages.
Files for proxy-grabber, version 1. 1. 1
Filename, size
File type
Python version
Upload date
Hashes
(4. 3 kB)
Wheel
py3
Nov 1, 2018
View
(3. 4 kB)
Source
None
View
proxy-grabber – Python Package Health Analysis | Snyk
Total Weekly Downloads (85) Dependents
0
GitHub Stars?
Forks?
Contributors
–
The PyPI package proxy-grabber receives a total of
85 downloads a week. As such, we scored
proxy-grabber popularity level to be Limited.
Based on project statistics from the GitHub repository for the
PyPI package proxy-grabber, we found that it has been
starred? times, and that 0 other projects
in the ecosystem are dependent on it.
The download numbers shown are the average weekly downloads from the
last 6 weeks.
Security and license risk for latest version Release Date Nov 1, 2018 Direct Vulnerabilities 0 C0 H0 M0 L Indirect Vulnerabilities 0 C0 H0 M0 L All security vulnerabilities belong to
production dependencies of direct and indirect
packages. License
MIT
Security Policy
No
We found a way for you to contribute to the project! Looks like
proxy-grabber is missing a security policy.
You can
connect your project’s repository to Snyk
to stay up to date on security alerts and receive automatic fix pull
requests.
Keep your project free of vulnerabilities with Snyk Open Issues?
Open PR?
Last Release
3 years ago
Last Commit
unknown
Further analysis of the maintenance status of proxy-grabber based on
released PyPI versions cadence, the repository activity,
and other data points determined that its maintenance is
Inactive.
An important project maintenance signal to consider for proxy-grabber is
that it
hasn’t seen any new versions released to PyPI in the
past 12 months, and could be considered as a discontinued project, or that which
receives low attention from its maintainers.
In the past month we didn’t find any pull request activity or change in
issues status has been detected for the GitHub repository.
Python Versions Compatibility
==3. 5. *, ==3. 6. *
Age
4 years
Latest Release
Dependencies
2 Direct / 7 Total
Versions
6
Maintainers
1
Wheels
OS Independent
ProxyBroker — ProxyBroker 0.2.0 documentation
[Finder | Checker | Server]
ProxyBroker is an open source tool that asynchronously finds public proxies from multiple sources and concurrently checks them.
Features¶
Finds more than 7000 working proxies from ~50 sources.
Support protocols: HTTP(S), SOCKS4/5. Also CONNECT method to ports 80 and 23 (SMTP).
Proxies may be filtered by type, anonymity level, response time, country and status in DNSBL.
Work as a proxy server that distributes incoming requests to external proxies. With automatic proxy rotation.
All proxies are checked to support Cookies and Referer (and POST requests if required).
Automatically removes duplicate proxies.
Is asynchronous.
Installation¶
To install last stable release from pypi:
$ pip install proxybroker
The latest development version can be installed directly from GitHub:
$ pip install -U git+
Usage¶
CLI Examples¶
Find¶
Find and show 10 HTTP(S) proxies from United States with the high level of anonymity:
$ proxybroker find –types HTTP HTTPS –lvl High –countries US –strict -l 10
Grab¶
Find and save to a file 10 US proxies (without a check):
$ proxybroker grab –countries US –limit 10 –outfile. /
Serve¶
Run a local proxy server that distributes incoming requests to a pool
of found HTTP(S) proxies with the high level of anonymity:
$ proxybroker serve –host 127. 0. 1 –port 8888 –types HTTP HTTPS –lvl High
Note
Run proxybroker –help for more information on the options available.
Run proxybroker
Basic code example¶
Find and show 10 working HTTP(S) proxies:
import asyncio
from proxybroker import Broker
async def show(proxies):
while True:
proxy = await ()
if proxy is None: break
print(‘Found proxy:%s’% proxy)
proxies = ()
broker = Broker(proxies)
tasks = (
(types=[‘HTTP’, ‘HTTPS’], limit=10),
show(proxies))
loop = t_event_loop()
n_until_complete(tasks)
More examples.
TODO¶
Check the ping, response time and speed of data transfer
Check site access (Google, Twitter, etc) and even your own custom URL’s
Information about uptime
Checksum of data returned
Support for proxy authentication
Finding outgoing IP for cascading proxy
The ability to specify the address of the proxy without port (try to connect on defaulted ports)
Contributing¶
Fork it: Create your feature branch: git checkout -b my-new-feature
Commit your changes: git commit -am ‘Add some feature’
Push to the branch: git push origin my-new-feature
Submit a pull request!
License¶
Licensed under the Apache License, Version 2. 0
This product includes GeoLite2 data created by MaxMind, available from Contents:
API Reference
Broker
Proxy
Provider
Examples
Change Log
`0. 2. 1`_ (Unreleased)
0. 0 (2017-09-17)
0. 1. 4 (2016-04-07)
0. 3 (2016-03-26)
0. 2 (2016-02-27)
0. 1 (2016-02-23)
0. 1b4 (2016-01-21)
0. 1b3 (2016-01-16)
0. 1b2 (2016-01-10)
0. 1b1 (2015-12-29)
0. 1a2 (2015-11-24)
0. 1a1 (2015-11-11)
Index
Module Index
Search Page