authenticated-web-extraction
Extract data from sites that require login (LinkedIn, GitHub, Sessionize, Microsoft 365, X, Meetup) using a persistent Playwright + Microsoft Edge profile. Covers profile setup, interactive sign-in capture, session-cookie re-injection (Chromium drops session-only auth cookies on shutdown), cookie-based auth detection, OAuth callback flags, and a task harness pattern. USE FOR: scrape LinkedIn, scrape GitHub, scrape Sessionize, authenticated scraping, persistent browser profile, Playwright Edge profile, msedge channel, headless authenticated extraction, session cookie persistence, OAuth callback cookie, ASP.NET ApplicationCookie, li_at, user_session, Sessionize cookie, login status check, launchPersistentContext, Edge tracking prevention, FedCm SSO, profile lock orphan msedge, CV resume data extraction from web. DO NOT USE FOR: posting or mutating user accounts, CAPTCHA-heavy targets, scraping at scale (no rate limiting), Microsoft Graph API access (use microsoft-todo-tasks), Outlook COM (use outlook-* skills).
- Compatibility
- Requires Node.js with Playwright, an installed Microsoft Edge channel, and a writable persistent browser profile directory.
Pinned to revision 7a186c5dfcf8, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/authenticated-web-extraction/SKILL.md
- skills/authenticated-web-extraction/bootstrap/package.json
- skills/authenticated-web-extraction/bootstrap/scripts/extract.mjs
- skills/authenticated-web-extraction/bootstrap/scripts/open.mjs
- skills/authenticated-web-extraction/bootstrap/tasks/check-logins.mjs
- skills/authenticated-web-extraction/bootstrap/tasks/dump-cookies.mjs
Every link opens the file at its source, pinned to the revision this page describes.