Python使用代理IP的几种方法

方法一:使用 requests 库

import requests\nproxy = {'http': 'http://123.45.67.89:8080'}\nresp = requests.get('http://httpbin.org/ip', proxies=proxy)\nprint(resp.json())

方法二:使用 urllib

from urllib import request\nproxy_handler = request.ProxyHandler({'http': 'http://123.45.67.89:8080'})\nopener = request.build_opener(proxy_handler)\nresp = opener.open('http://httpbin.org/ip')

方法三:使用 Scrapy

在 Scrapy 的 settings.py 中配置:

DOWNLOADER_MIDDLEWARES = {\n    'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 1,\n}\n# 在 Request 中设置 meta\nrequest = scrapy.Request(url, meta={'proxy': 'http://123.45.67.89:8080'})

方法四:使用 Selenium

from selenium import webdriver\noptions = webdriver.ChromeOptions()\noptions.add_argument('--proxy-server=http://123.45.67.89:8080')\ndriver = webdriver.Chrome(options=options)