Ë j<%ãóÆ—dZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl mZddlm Z dZdZdZd Zd ZdZdZd ZdZd„Zd„Zd„Zd„Zd„Zd„Zedk(re«yy)uí æ–°æ´¥åŒºäººæ°‘æ”¿åºœé—¨æˆ·ç½‘ç«™ - å…¬ç¤ºå…¬å‘Šæ ç›®çˆ¬è™« URL: https://www.xinjin.gov.cn/xjxrmzf/c1256263/zw_list.shtml CMS: ç‘žæ•°WAF(412 JSæŒ‘æˆ˜) + es-search æŽ¥å£åˆ†é¡µ ç ´è§£æ–¹æ¡ˆ: Playwright æ— å¤´æµè§ˆå™¨æ‰§è¡ŒJSæŒ‘æˆ˜, é¡µé¢å†… fetch æŽ¥å£(è‡ªåŠ¨å¸¦ç‘žæ•°cookie) åˆ—è¡¨: GET /es-search/search/6dff54b50943459f96774c6c9d5cadd2?page=N (53é¡µ/1045æ¡/20æ¡é¡µ) è¿”å›ž:

2026-08-07æ ‡é¢˜

z$clean_content_html..3s€ q§v¡vÒ'?°#¸¿¹°-€rÚspanÚfontÚprÚalign)rÚfind_allÚ decomposeÚunwrapÚfindÚlistÚattrsÚstr)Ú html_fragÚsoupÚtagrÚnestedÚattrs rÚclean_content_htmlr,,s€ä˜ MÓ2€Dà}‰}˜h¨Ð0Ó1òˆØ ‰ ðð}‰}Ñ?Ó@òˆØ ‰ ðð}‰}˜f fÐ-Ó.òˆØ ‰ ðð Ø!Ÿ]™]¨3Ó/Ö?˜°1·6±6¸#µ;’!Ð?ˆÐ?ÙØØˆq‰ ×ÑÔð ð]‰]˜3Ó òˆÜ˜Ÿ™“Mò ˆDØw‹Ød‘Gñ ðôˆt‹9Ðùò@sÂDÂ/DcóŽ—|jdtt|«z«}tjd|«}g}|D]…\}}}|sRtj dtj|«zdz|«}|r|jd«j«nd}|j|j«t|«|f«Œ‡|S)u,æŠ“åˆ—è¡¨é¡µ N, è¿”å›ž [(date, title, href)]z”async (u) => { const r = await fetch(u, {headers: {'X-Requested-With': 'XMLHttpRequest'}}); return await r.text(); }zG([^<]+)\s*]*title="([^"]*)"z ]*>([^<]+)ér )ÚevaluateÚAPI_BASEr&rÚfindallÚsearchÚescapeÚgrouprÚappendr) ÚpageÚpage_noÚhtmlÚitemsÚoutÚdÚhrÚms rÚfetch_list_pager>Gsµ€à=‰=ð ô ”3w“<Ñó€Dô J‰JÐaÐcgÓh€EØ €CØò3‰ˆˆ1ˆaÙä— ‘ ˜,¬¯©°1«Ñ5Ð8MÑMÈtÓTˆAÙ&'—‘˜“ × Ñ Ô"¨RˆAØ ‰ A—G‘G“Iœ{¨1›~¨qÐ1Õ2ð3ð€Jrcóp—|jd«r|nt|z}|jd|«}t|d«}d|vr|j dd¬«syd }|j d ddi¬ «}|r|jd«rt |d«}|sA|jr5t |jj«jd«d«}d }|j d ddi¬ «}|rO|jd«r>|dj«}tjd|«}|r|jd«nd }d }|j d ddi¬ «}|r$|jd«r|dj«}|j dd¬«} | syg} | jdd¬«D]z}|d}tjd|tj «sŒ.t#||«} |jd¬«xs| jd«d}| j%|| dœ«| |d<Œ|t't)| ««}||||| |dœS)uIæŠ“è¯¦æƒ…é¡µ, è¿”å›ž dict(title, date, source, content_html, attachments)Úhttpzaasync (u) => { const r = await fetch(u); return await r.text(); }rú_$tsÚdivÚcontent)Úclass_Nr ÚmetarÚArticleTitle)r%ú-rÚPubDatez\d{4}-\d{2}-\d{2}Ú ContentSourceÚaT)ÚhrefrKz2\.(pdf|docx?|xlsx?|zip|rar|wps|jpg|jpeg|png)(\?|$))rú/éÿÿÿÿ©rÚurl)ÚtitleÚdateÚsourceÚcontent_htmlÚattachmentsrO)Ú startswithÚBASEr/rr#ÚgetrrPÚget_textÚsplitrrÚmatchr4r r2ÚIrr5r,r&)r6rKrOr8r(rPr=rQrRÚcontent_divrTrJr<Úabs_urlrrSs rÚfetch_detailr^Zs*€à—/‘/ &Ô)‰$¬t°d©{€CØ=‰=ð ð ó€Dô˜˜}Ó-€DØ ~˜dŸi™i¨°i˜iÔ@Øà€EØ ‰ & ¨Ð 8ˆ Ó9€AÙˆQU‰U9Ô Ü˜A˜i™LÓ)ˆÙT—Z’ZÜ˜DŸJ™J×/Ñ/Ó1×7Ñ7¸Ó<¸QÑ?Ó@ˆà €DØ ‰ & ¨Ð 3ˆ Ó4€AÙˆQU‰U9Ô Ø‰|×!Ñ!Ó#ˆÜx‰xÐ,¨dÓ3ˆÙ $ˆtz‰z˜!Œ}¨"ˆà €FØ ‰ & ¨Ð 9ˆ Ó:€AÙˆQU‰U9Ô Ø9‘×#Ñ#Ó%ˆà—)‘)˜E¨))Ó4€KÙØà€KØ × !Ñ ! #¨DÐ !Ó 1ò ˆØ ˆf‰IˆÜ 9‰9ÐJÈAÌrÏtÉtÕTÜ˜c 1“oˆGØ—:‘: D:Ó)ÒC¨W¯]©]¸3Ó-?ÀÑ-CˆDØ×Ñ¨°WÑ=Ô>ØˆAˆfŠIð ô&¤c¨+Ó&6Ó7€LàØØØ$Ø"Øñ ðrcóˆ—tjtd¬«}|jd«|jd«dx}}|j «}|D]Ÿ}|s|dz }Œtj|dDcgc] }|d|d d œ‘Œc}d¬«} |jd t|d |d |d|d|d|dxsddddd|f «|jdkDr|dz }n|dz }|j«Œ¡|j«||fScc}w#tj$r}td||d «|dz }Yd}~ŒXd}~wwxYw)u;ç›´å†™ search.db (gov_raw è§¦å‘å™¨è‡ªåŠ¨åŒæ¥ gov_search)i")ÚtimeoutzPRAGMA busy_timeout=290000zPRAGMA journal_mode=WALrr.rTrrOrNF)Úensure_asciizÍINSERT OR IGNORE INTO gov_raw (site_name, source_url, page_url, title, publish_date, content, summary, category, script_name, attachments) VALUES (?,?,?,?,?,?,?,?,?,?)rPrQrSr Niôuå…¬ç¤ºå…¬å‘Šzcrawl_xinjin_gsgg.pyz DB err:) Úsqlite3ÚconnectÚDB_PATHÚexecuteÚcursorÚjsonÚdumpsÚ SITE_NAMEÚrowcountÚErrorÚprintÚcommitÚclose) r9ÚconnÚaddedÚskippedÚcurÚitrJÚatt_jsonÚes rÚ push_to_dbrv‘s_€ä?‰?œ7¨CÔ0€DØ‡LLÐ-Ô.Ø‡LLÐ*Ô+ØÐ€EˆGØ +‰+‹-€CØòˆÙØq‰LˆGØä—:‘:ÈRÐP]ÑM^Ö_È¨¨&© ¸!¸E¹(ÓCÒ_ÐnsÔtˆð ØK‰Kð3ô˜B˜u™I r¨%¡y°"°W±+¸rÀ&¹zÈ2ÈnÑK]Ø^Ñ$Ò*¨¨D¨SÐ1°>ÐCYÐ[cðeô ð|‰|˜aÒØ˜‘ ‘à˜1‘ð ‰ ð+ð, ‡JJ„LØ'ˆ>Ðùò%`øô}‰}ò Ü+˜q " U¡)Ô,Øq‰LGûð úsÁ5D ÂADÄEÄ"D<Ä<Ecóº—tj«}|jdtdd¬«|j «}t|jt«}tj«}t«5}|jjdddg¬«}|jtd d dœ¬«}|j«}td «|j!t"dd¬«t%d«D]Y}tj&d«|j)«} d| vsŒ-t+| «dkDsŒÚextendÚ ExceptionÚCUTOFFÚ enumeraterUrVr^r5rv)Úapr|rŒÚt0rÚbrowserÚctxr6Úir8Ú all_itemsÚpnr9ruÚresultsÚn_emptyrQrPrKrOÚdetrprqs rÚmainr§±s€Ü × Ñ Ó "€BØ‡OOI¤C°Ð9`€OÔaØ =‰=‹?€DÜ— ‘ œKÓ(€Eä ‰‹€BÜ Ó ð;˜aØ—*‘*×#Ñ#¨T¸ÐIxÐ8yÐ#ÓzˆØ×!Ñ!¬RÀDÐTWÑ:XÐ!ÓYˆØ|‰|‹~ˆô Ð:Ô<Ø ‰ ”( EÐ6Hˆ ÔIÜr“ò ˆAÜJ‰JqŒMØ—<‘<“>ˆDØ˜TÒ!¤c¨$£i°$Ó&6ÜÐ*¨1¨Q©3¨%¨y¼¸T»¸ÐDÔEÙð ô Ð3Ô4ØM‰MŒOØ÷#;ð;ô( Ð% e W¨CÐ0Ô1Øˆ Ü˜˜5 1™9Ó%ò ˆBð -Ü'¨¨bÓ1Ø× Ñ Ô'Ü˜˜b˜T ¤C¨£J <¨tÐ4Ô5ô J‰JsOð ô œs 9›~Ð.¨m¼F¸8À;ÐOÔPô Ð%Ô'ØˆØˆÜ&/° ¸1Ó&=ò Ñ"ˆAÑ"e˜TØ”fŠ}Ü˜˜a˜S ¤# i£.Ð!1Ð1CÀDÀ6ÈÈ5ÐQTÐRTÈ:È,ÐWÔXØØŸ/™/¨&Ô1‘$´t¸d±{ˆCð Ü" 4¨Ó.ðˆ{Ø˜1‘Ü˜˜a˜S ¤# i£.Ð!1°¸D¸6ÀÀ5ÈÈ"À:À,ÐOÕPä˜˜a˜S ¤# i£.Ð!1°¸°v¸Q¸sÀ7¹|ÈCÈRÐ?PÐ>QÐQXÔY\Ð]`ÐaoÑ]pÓYqÐXrÐr|ô~AðBEðFSñBTó~Uð}VðWôXØN‰N˜3ÔÜJ‰JsOð! ô& Ô!Ü# GÓ,‰ˆˆwÜ Ð% e W¨J°w°i¸}ÈWÈIÐU_Ô`d×`iÑ`iÓ`kÐlnÑ`nÐorÐ_sÐsxÐyÔzØ ‰ Œ÷w;ð;øô6ò -Ü˜˜b˜T ¨ sÐ+×,Ò,ûð -ûô"ò Ü˜˜a˜S ¤# i£.Ð!1°¸q¸cÐBÔCØ–ûð ú÷Y;ð;úsuÁ6B$OÄOÄ*r^rvr§Ú__name__©rrúr²sðñóÛÛ Û ÛÛ ÛÝ åÝ/à$€ Ø"€ØE€ØE€Ø€Ø€ Ø €Ø €Øv€ò òò6ò&5ònò@BðHˆzÒÙ…Fðr