ljl$ dZddlZddlZddlZddlZddlZddlZejjddZ ddddZ d Z d Z d Z d gZed d e dz z dD]Zej#deddZdZdZd&dZd'dZedk(rdej0vrdZeej0D]Y\ZZedk(s edzeej0ks%ej0edzj=dsGej0edzZner eeyedydej0vrMeedZeeZ e!dee de dd D]Z"e!d e"d!dd"d#e"d$d#e"d%!yedyy)(uK 四川新闻网-资阳频道-原创文艺 https://zq.newssc.org/2017ycxw/ NDB_PATHz/root/search.dbzoMozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/120.0.0.0 Safari/537.36zJtext/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8zzh-CN,zh;q=0.9,en;q=0.8)z User-AgentAcceptzAccept-Languageu资阳原创文艺u资阳z;https://zq.newssc.org/2017ycxw/?spm=zm5056-001.0.0.2.w9S7zKzGhttps://zq.newssc.org/2017ycxw/system/more/0017004000000/0017004000000_z.shtmlc`tj|td}d|_|jS)N)headerstimeoutgb2312)requestsgetHEADERSencodingtext)urlrs !/root/gov_crawler/crawl_zqycxw.py fetch_pagers$ S'26AAJ 66McFg}d}tj||tjD]t}|jdj }|jdj }|jdj }|j |||dv|S)z_Parse list page: