在用python 寫爬蟲的時候，經常需要獲取cookies，然后才能開始其他的一起爬取操作。這里整理下，網上一些的資料。在這里我們以豆瓣網 https://accounts.douban.com/passport/login為例。

方法1：python3+requests庫獲取：

import requests from requests.cookies import RequestsCookieJarheaders = {'Host': 'accounts.douban.com','User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36','Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3','Accept-Language': 'zh-CN,zh;q=0.9,en;q=0.8','Accept-Encoding': 'gzip, deflate, br','Connection': 'keep-alive'} request_url = "https://accounts.douban.com/passport/login" res = requests.get(request_url, headers=headers)status_code = res.status_code res_header = res.headers res_cookies = res.cookies cookie1111 = res.cookies.get_dict() # 格式化 字典形式輸出 cookie2222 = requests.utils.dict_from_cookiejar(res_cookies) # 格式化 字典形式輸出 for cookie in res_cookies:print(cookie.name+"\t"+cookie.value)print("響應狀態碼：", status_code) print("響應請求請求頭：", res_header) print("響應cookies：", res_cookies) print("格式化cookie1111 :", cookie1111) print("格式化cookie2222 :", cookie2222)

輸出結果：

響應狀態碼： 200 響應請求請求頭： {'Date': 'Wed, 22 Jul 2020 07:41:04 GMT', 'Content-Type': 'text/html; charset=utf-8', 'Transfer-Encoding': 'chunked', 'Connection': 'keep-alive', 'Keep-Alive': 'timeout=30', 'Vary': 'Accept-Encoding, Accept-Encoding', 'X-Xss-Protection': '1; mode=block', 'X-Douban-Mobileapp': '0', 'Expires': 'Sun, 1 Jan 2006 01:00:00 GMT', 'Pragma': 'no-cache', 'Cache-Control': 'must-revalidate, no-cache, private', 'X-Frame-Options': 'SAMEORIGIN', 'Set-Cookie': 'bid=tGBxkXjx3OI; Expires=Thu, 22-Jul-21 07:41:04 GMT; Domain=.douban.com; Path=/', 'X-DOUBAN-NEWBID': 'tGBxkXjx3OI', 'X-DAE-App': 'accounts', 'X-DAE-Instance': 'default', 'Server': 'dae', 'Strict-Transport-Security': 'max-age=15552000', 'X-Content-Type-Options': 'nosniff', 'Content-Encoding': 'br'} 響應cookies： <RequestsCookieJar[<Cookie bid=tGBxkXjx3OI for .douban.com/>]> 格式化cookie1111 : {'bid': 'tGBxkXjx3OI'} 格式化cookie2222 : {'bid': 'tGBxkXjx3OI'} bid tGBxkXjx3OI

方法2：使用response headers的set_cookie

set_cookie = res.headers['Set-Cookie'] print("set_cookie:", set_cookie)for cookie in res.headers['Set-Cookie'].split(";"):key = cookie.split('=')[0]value = cookie.split('=')[1]print(key, value)

運行結果：

set_cookie: bid=sH5N2LFyPog; Expires=Thu, 22-Jul-21 07:55:11 GMT; Domain=.douban.com; Path=/ bid sH5N2LFyPog Expires Thu, 22-Jul-21 07:55:11 GMT Domain .douban.com Path /

如果要設置cookies，可以這樣做：

import requests from requests.cookies import RequestsCookieJarcookieJar1 = RequestsCookieJar() cookieJar2 = RequestsCookieJar() print(cookieJar1) for cookie in res.cookies:cookieJar1.set(cookie.name, cookie.value) print("cookieJar1:", cookieJar1)# 向請求頭中添加cookie res = requests.get(url, headers, cookies=cookieJar1) # 使用Set-Cookie 獲取的cookies比較完整 for cookie in res.headers['Set-Cookie'].split(";"):key = cookie.split('=')[0]value = cookie.split('=')[1]cookieJar2.set(key, value) print("cookieJar2:", cookieJar2)

運行結果：

<RequestsCookieJar[]> cookieJar1: <RequestsCookieJar[<Cookie bid=sYSpXToGQ1o for />]> cookieJar2: <RequestsCookieJar[<Cookie Domain=.douban.com for />, <Cookie Expires=Thu, 22-Jul-21 08:01:01 GMT for />, <Cookie Path=/ for />, <Cookie bid=sYSpXToGQ1o for />]>

方法3：利用selenium 模擬驅動的方式

from selenium import webdriverdriver=webdriver.PhantomJS() url="https://et.xiamenair.com/xiamenair/book/findFlights.action?lang=zh&tripType=0&queryFlightInfo=XMN,PEK,2018-01-15" driver.get(url) # 獲取cookie列表 cookie_list=driver.get_cookies() # 格式化打印cookie for cookie in cookie_list:cookie_dict[cookie['name']]=cookie['value']

方法4：使用cookielib + http.cookiejar

在python2使用

import cookielib import urllib2 Url = "https://et.xiamenair.com/xiamenair/book/findFlights.action?lang=zh&tripType=0&queryFlightInfo=XMN,PEK,2018-01-15" cj = cookielib.CookieJar() opener = urllib2.build_opener(urllib2.HTTPCookieProcessor(cj)) urllib2.install_opener(opener) resp = urllib2.urlopen(Url) for index, cookie in enumerate(cj):print '[',index, ']',cookie

python3中使用：

from urllib import request from http import cookiejar#跳過SSL驗證證書 import ssl #設置忽略SSL驗證 ssl._create_default_https_context = ssl._create_unverified_contextif __name__ == '__main__':#聲明一個CookieJar對象實例來保存cookiecookie = cookiejar.CookieJar()#利用urllib.request庫的HTTPCookieProcessor對象來創建cookie處理器,也就CookieHandlerhandler=request.HTTPCookieProcessor(cookie)#通過CookieHandler創建openeropener = request.build_opener(handler)#此處的open方法打開網頁response = opener.open('http://www.baidu.com')#打印cookie信息for item in cookie:print('Name = %s' % item.name)print('Value = %s' % item.value)

運行結果：

Name = BAIDUID Value = 94CCDAFB95C81F517566AAE5796693AC:FG=1 Name = BIDUPSID Value = 94CCDAFB95C81F515B73F5C9A79CE9BC Name = H_PS_PSSID Value = Name = PSTM Value = 1595406265 Name = BDSVRTM Value = 0 Name = BD_HOME Value = 1

總結

以上是生活随笔為你收集整理的python获取cookies的全部內容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯，歡迎將生活随笔推薦給好友。