偽裝一下請(qǐng)求頭就可以了

打開網(wǎng)頁，看一下請(qǐng)求頭都是啥玩意兒
然后在你的爬蟲里面配置請(qǐng)求頭一個(gè)樣。

這類網(wǎng)站反爬還算可以的，如果只是想拿到源代碼，偽裝一下頭就好

Accept:text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
Accept-Encoding:gzip, deflate, sdch
Accept-Language:zh-CN,zh;q=0.8
Cache-Control:max-age=0
Connection:keep-alive
Cookie:ASP.NET_SessionId=bqtygl55xovvgp45ajwmuj45
DNT:1
Host:www.gzcc.gov.cn
Upgrade-Insecure-Requests:1
User-Agent:Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.0

當(dāng)然實(shí)際中我們不需要填寫這么多參數(shù)，用requests庫舉個(gè)例子( Pyhthon )

header={'user-agent':'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.36 SE 2.X MetaSr 1.0'}
# 使用json格式的鍵值對(duì)
resp=requests.get(url=url,headers=header)