SkillPedia Skills Encyclopedia
中文 EN

技能 2026-04-24 08:33 UTC

lets-go-rss

由提交人 匿名贡献者 提交,主要更新类型为:新增功能与能力扩展。提交说明:feat: agent-orchestrated --login flow + XHS DOM extraction + stealth。带来了新的能力与可配置项,扩展了使用场景。

08be290 ALBEDO-TABAI/lets-go-rss

Commit提交信息原文

feat: agent-orchestrated --login flow + XHS DOM extraction + stealth

Upgrades the Playwright tier based on what we learned trying to onboard
Twitter/XHS in a real session.

--login is now a complete end-to-end workflow:
  1. Opens Chromium (prefers real Google Chrome via channel='chrome',
     falls back to bundled Chromium). Stealth-hardened: --enable-automation
     stripped, init script patches navigator.webdriver / plugins /
     languages / chrome.runtime to defeat basic fingerprint checks.
  2. Waits for the user to sign in and close the window.
  3. Verifies login by fetching an existing DB subscription of that
     platform — real end-to-end test, not just "did cookies land".
  4. Idempotently writes RSS_PLAYWRIGHT_PLATFORMS=<...> into .env
     (seeds with cron default `bilibili` so we don't silently demote
     the zero-login Bilibili tier).

XHS fetcher rewritten for 2025 DOM
  Playwright+login found that xiaohongshu no longer serves the old
  user_posted XHR — notes are SSR-inlined into the profile page as
  `section.note-item` cards. fetch_xhs_user now extracts note_id and
  title from DOM via page.evaluate, which is faster AND robust to
  future XHR churn. Verified end-to-end: 20 items fetched per user.

Bilibili fetcher: switched to page.expect_response for reliable XHR
capture (was polling with 8s deadline, first cold load timed out);
retry once on HTTP 412 (Bilibili's occasional throttle).

Docs: SKILL.md documents the agent-orchestrated pattern so future
sessions know to proactively offer --login when health check shows
auth-kind failures.

Twitter/X remains unsolved. X.com has extremely aggressive anti-bot:
even real Chrome via channel='chrome' with webdriver masking gets the
login form reset on input. Options explored that did NOT work:
  - bundled Chromium + stealth init script (detected)
  - real Google Chrome via channel='chrome' + stealth (still detected)
  - browser_cookie3 import from user's main Chrome (user not logged
    in there; even if they were, macOS Keychain permission flow blocks
    unattended read)
Accepting Twitter as platform-level unsolvable; the existing
syndication + RSSHub fallback remains in place.

Verified via smoke run:
  Before this tier: 5 OK / 9 FAIL
  With Bilibili auto: 8 OK / 6 FAIL (+60 new items)
  With XHS login:    11 OK / 3 FAIL (+27 additional new items)

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>