ij<dZddlZddlZddlZddlZddlZddlmcmZ ddl m Z ddl m Z m Z dZdZdZdZej$d d Zd Zd Zd Zej.Zej2j5dede j6e dz j9dZddddZddZdZ dZ!dZ"d dZ#e$dk(rXdejJvZ&dZ'ejJD].Z(e(jSdse*e(jWddZ'0e#e&e'yy)!u crawl_xiushui_hp.py -- Xiushui county EIA project crawler (TRS) 2026-09-08 修复: 栏目列表已改 JS 渲染, 静态 index.html 无行 → 改从同目录 data_<年份>.xml 拉取(需 x-api-key 头, 见 enc.js/document_year.js)。 N) BeautifulSoup)datetime timedeltac|syt|d}|ddgD]}|j|jdd}tjdd|}|dd S) N html.parserscriptstyle T) separatorstripz\s+i)r decomposeget_textresub) html_textsouptagtexts %/root/gov_crawler/crawl_xiushui_hp.pyextract_plain_textrsf  M 2DXw'(  ==3d= 3D 66&#t $D :zhttps://www.xiushui.gov.cnz$/xxgk/bmxxgk/sthjj/sthj/zdmsxm/xmhp/z********^^^^^^^^ SEARCH_DBz/root/search.dbu修水县-项目环评&z.xml → [{title,url,date}], 失败返回空 listdata_z.xmlz [WARN] data_z.xml fetch failedz^[^<]*<.gJs7 A45M2771::<(..0 Ir IrTITLEPUBURLRELTIMEhttpz./ )titler/date) BASE_URLXML_DIRr4printET fromstringr,rriter startswithlstripappend) yearr/rawrootr>se2recordsr@rFpubrelr?s @rfetch_items_xmlrY7sP JwiuTF$ /C *C  tf$567  }}S!Gii G J' k lC ~~f%W$szz$'77CsCHEF G N+  z315A==#D  N4&(;A3c"F GII   sGC E.DD; D3D.#D3$D;(E.D33D;;Ecnt|}|syt|d}|jdddi}d}|r|jdd}|r|dd nd}|jd d }|s|jd d }|s|jd d }|s|jd d}d}|r t |}||fS)N)rrrmetanamePubDate)attrsrcontentrEdivcB|xrdt|vxr dt|vS)N TRS_UEDITORviewstrcs rzfetch_detail..ds&A4f-3q6:Q4fV\`cde`fVfr)class_c$|xr dt|vS)Nrbrdrfs rrhzfetch_detail..fs8UmsSTv>Urc$|xr dt|vS)Ntrs_editor_viewrdrfs rrhzfetch_detail..hs8Y>OSVWXSY>Yrz article-box)id)r4rr;r)re)r/rr meta_datedate_strraw_date content_div content_htmls r fetch_detailrsXsc I  M 2D &(; BC dfn OF8;7 8 +DK8.$v,4=$u+wA   3  M%,xf jxHY Z[r__main__z--fullz--test==r%)rr)N)FN),__doc__sysrr-osrequestsxml.etree.ElementTreeetree ElementTreerKbs4rrrrrHrI XML_API_KEYgetenvrxr{ TOTAL_PAGES MAX_PAGESSessionr(r#updaterstrftimerr}r4rYrsrr__name__argvrrargrNrsplitrrrs6 ""( ( 0 "))K!2 3 $  (   P  8<<>I5$99CCJO1* B"6("\J z sxx D Fxx, >>) $3*+F, tF# r