ujo>ddlZ ddlZddlZddlZddlZddlmZmZmZddlZddlZejjdejjejje ddlmZej ej"j$dZdZedZej,ej.edz j1d Zd d iZd Zd ZdZddZedk(rddl Z e jBZ"e"jGdde"jGde$e"jKZ&e&jNxs)e(ejRdkDxrejRddk(Z'ejZ*ee'e&jVyy)N)datetimetimezone timedelta)push_to_searchdbu%信阳市生态环境局-通知公告zhttps://sthjj.xinyang.gov.cnz /xxdt/tzgg/iG)daysz%Y-%m-%dz User-Agentz[Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 Chrome/125.0.0.0 Safari/537.36ctdD]e} tj|tdd}d|_|j j r|j cS tjdgy#YxYw)NF)headerstimeoutverifyzutf-8) rangerequestsgetHEADERSencodingtextstriptimesleep)url_rs '/root/gov_crawler/crawl_xinyang_sthj.pyfetchrsl 1X  S'2eLA AJvv||~vv  1    s A A55A9cpg}tjd|tj}|s|S|jd}tjd|tjD]Q}|j |jdj |jd|jdfS|S)u#提取列表 (title, url, date_str)u;
(.*?)