技能 2026-04-24 08:33 UTC
lets-go-rss
由提交人 匿名贡献者 提交,主要更新类型为:新增功能与能力扩展。提交说明:feat: agent-orchestrated --login flow + XHS DOM extraction + stealth。带来了新的能力与可配置项,扩展了使用场景。
Commit提交信息原文
feat: agent-orchestrated --login flow + XHS DOM extraction + stealth
Upgrades the Playwright tier based on what we learned trying to onboard
Twitter/XHS in a real session.
--login is now a complete end-to-end workflow:
1. Opens Chromium (prefers real Google Chrome via channel='chrome',
falls back to bundled Chromium). Stealth-hardened: --enable-automation
stripped, init script patches navigator.webdriver / plugins /
languages / chrome.runtime to defeat basic fingerprint checks.
2. Waits for the user to sign in and close the window.
3. Verifies login by fetching an existing DB subscription of that
platform — real end-to-end test, not just "did cookies land".
4. Idempotently writes RSS_PLAYWRIGHT_PLATFORMS=<...> into .env
(seeds with cron default `bilibili` so we don't silently demote
the zero-login Bilibili tier).
XHS fetcher rewritten for 2025 DOM
Playwright+login found that xiaohongshu no longer serves the old
user_posted XHR — notes are SSR-inlined into the profile page as
`section.note-item` cards. fetch_xhs_user now extracts note_id and
title from DOM via page.evaluate, which is faster AND robust to
future XHR churn. Verified end-to-end: 20 items fetched per user.
Bilibili fetcher: switched to page.expect_response for reliable XHR
capture (was polling with 8s deadline, first cold load timed out);
retry once on HTTP 412 (Bilibili's occasional throttle).
Docs: SKILL.md documents the agent-orchestrated pattern so future
sessions know to proactively offer --login when health check shows
auth-kind failures.
Twitter/X remains unsolved. X.com has extremely aggressive anti-bot:
even real Chrome via channel='chrome' with webdriver masking gets the
login form reset on input. Options explored that did NOT work:
- bundled Chromium + stealth init script (detected)
- real Google Chrome via channel='chrome' + stealth (still detected)
- browser_cookie3 import from user's main Chrome (user not logged
in there; even if they were, macOS Keychain permission flow blocks
unattended read)
Accepting Twitter as platform-level unsolvable; the existing
syndication + RSSHub fallback remains in place.
Verified via smoke run:
Before this tier: 5 OK / 9 FAIL
With Bilibili auto: 8 OK / 6 FAIL (+60 new items)
With XHS login: 11 OK / 3 FAIL (+27 additional new items)
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>