日韩性视频-久久久蜜桃-www中文字幕-在线中文字幕av-亚洲欧美一区二区三区四区-撸久久-香蕉视频一区-久久无码精品丰满人妻-国产高潮av-激情福利社-日韩av网址大全-国产精品久久999-日本五十路在线-性欧美在线-久久99精品波多结衣一区-男女午夜免费视频-黑人极品ⅴideos精品欧美棵-人人妻人人澡人人爽精品欧美一区-日韩一区在线看-欧美a级在线免费观看

歡迎訪問 生活随笔!

生活随笔

當前位置: 首頁 > 编程资源 > 编程问答 >内容正文

编程问答

求助!!css选择器为什么有很多标签查不到

發布時間:2024/10/8 编程问答 28 豆豆
生活随笔 收集整理的這篇文章主要介紹了 求助!!css选择器为什么有很多标签查不到 小編覺得挺不錯的,現在分享給大家,幫大家做個參考.

RT

進行B站北理工的課程,有人說雪球網可以作為百度股票的替代
希望查到的標簽如下:給雪球網跪下了

保存結果如下,可以看出網頁獲取成功,標簽選擇成功,但為什么 上圖中的p標簽和span標簽查不到呢

代碼如下

# -*- coding: utf-8 -*- import scrapy import re class StocksSpider(scrapy.Spider):name = 'stocks'allowed_domains = ['xueqiu.com']start_urls = ['https://quote.eastmoney.com/stock_list.html']def parse(self, response):for href in response.css('a::attr(href)').extract():try:stock=re.findall(r"[s][hz]\d{6}",href)[0]url ='https://xueqiu.com/k?q='+stock#變成生成器#當查找雪球網的時候:比如sh501007#https: // xueqiu.com/k?q = sh501007#點擊進入頁面后#https: // xueqiu.com/S/SH501007#這里大小寫都可以headers = {'cookie': 'miid=1296267545453648768; t=b4d385e2145f596a67961e4dd08e9a8f; cna=pqwcFXxbJjACAXWIA7AFEfA8; thw=cn; tracknick=tb487881011; lgc=tb487881011; _cc_=UIHiLt3xSw%3D%3D; tg=0; enc=%2FTqA3gAexHOKU0cyPYbSWM1pGS8vgnlEK3EMnkYd2T%2BlB%2BJh18hxryREG48c%2BYmdk7yfvbSMCBDQExP23eUm3w%3D%3D; hng=CN%7Czh-CN%7CCNY%7C156; x=e%3D1%26p%3D*%26s%3D0%26c%3D0%26f%3D0%26g%3D0%26t%3D0%26__ll%3D-1%26_ato%3D0; cookie2=19ef67fdfc3f433776e5e9cafaf6a8ea; v=0; _tb_token_=08b7e3e7e183; _m_h5_tk=62383241b06635c64b07942e50e47d9d_1562004576179; _m_h5_tk_enc=0465da475a8335f8fd8d9ef6bb280a71; unb=4235284520; sg=101; _l_g_=Ug%3D%3D; skt=c571ae590b7580cb; cookie1=AnQIvxj44XbyESoVNTVtwfJRB8W%2BbAPV%2BVZMWhAghjk%3D; csg=23f40375; uc3=vt3=F8dBy34cs3fc7ebsEqk%3D&id2=Vy67WD1MZomrsw%3D%3D&nk2=F5RBzeKtOazPVJc%3D&lg2=UtASsssmOIJ0bQ%3D%3D; existShop=MTU2MTk5NTE3MQ%3D%3D; dnk=tb487881011; _nk_=tb487881011; cookie17=Vy67WD1MZomrsw%3D%3D; mt=ci=21_1; uc1=cookie14=UoTaGdT0tHdY5w%3D%3D&lng=zh_CN&cookie16=VT5L2FSpNgq6fDudInPRgavC%2BQ%3D%3D&existShop=false&cookie21=VFC%2FuZ9aj3yE&tag=8&cookie15=UIHiLt3xD8xYTw%3D%3D&pas=0; whl=-1%260%260%261561995222497; isg=BHNzJqpkKgCWtOesccf13ZRUAnddACwkF8iwAyUQzxLJJJPGrXiXutG23hRvn19i; l=bBMxcfBPv539-OTkBOCanurza77OSIRYYuPzaNbMi_5K-6T_2qQOkAuQFF96Vj5Rs4YB4G2npwJ9-etkq','User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36'}yield scrapy.Request(url,callback=self.parse_stock,headers=headers)#callback給出了一個處理函數except:continuedef parse_stock(self,response):#最終要返回信息給item_piplinename =response.css('span::text').extract()name2=response.css('p::text').extract()fname='Xueqiu.txt'with open(fname,'a') as f:f.write(str(response)+'\n')f.write('span'+str(name)+'\n')f.write('p'+str(name2)+'\n')f.close()self.log('Saved file %s.' % str(response))# self.log(str(keyList))

代碼截圖如下

總結

以上是生活随笔為你收集整理的求助!!css选择器为什么有很多标签查不到的全部內容,希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網站內容還不錯,歡迎將生活随笔推薦給好友。