What's New

Product updates, new features, and improvements to Scrappy.gg.

v1.10.0

MajorAugust 26, 2026
  • FeatureRead a page the way a screen reader does — roles, names, and state — then click or type against a ref instead of guessing a CSS selector that breaks on the next re-render
  • FeatureRun up to 25 browser actions in one call, search a page for a control by describing it, and fill an entire form in a single request
  • FeatureRecord a browser session to video — an MP4 of everything the session did, downloadable while the session is still alive
  • FeatureNavigation can wait for the page's own scripts to finish running, and a new wait-for-function blocks until any condition you name comes true
  • FeatureCoordinate and path drags, wheel scrolling into nested panes, modifier clicks, and paste — including pasting an image into an editor that has no upload button
  • FeatureA browser session carrying a login can hold a static exit IP, and a dead one is detected and cleared automatically
  • ImprovementThe live viewer captures at Retina density and streams binary frames, so the remote page looks sharp and responds faster
  • ImprovementThe AI chat agent's browser tools now match the API's, including press-and-hold for human-verification widgets
  • FixClosed the last cases where one browser session could see another's tabs, pages, or cookies
  • FixA credit purchase shows up immediately instead of waiting out a cache, and file uploads no longer report success for a file the page never received

v1.9.0

NewAugust 22, 2026
  • FeatureUpload a file from your own machine into a live browser session — the remote file dialog is replaced with your browser's own picker
  • FeatureEmbedded integrations can scope every call to one of their own end users, so one customer can never reach another's session
  • ImprovementA browser session now survives its underlying machine being replaced, rebuilding itself with the same cookies, tabs, and exit IP
  • ImprovementCredit balances load faster — the balance read no longer sits in front of every deduction
  • FixClicks in the live viewer land where you aimed instead of roughly 9% too low, and the page is no longer squeezed into 800x600
  • FixYou are charged only for browser time we can prove was live, and waived charges leave a visible trace
  • FixCredit purchase webhooks reach Scrappy again — deliveries had been landing on a path that did not exist
  • FixLive progress streams reconnect after a laptop sleeps instead of quietly giving up

v1.8.0

NewAugust 15, 2026
  • FeatureCloud browser sessions can detect a CAPTCHA and, with a solver key configured, clear it
  • FeatureWeb search is now its own API and MCP tool — structured results billed in credits, with no search provider key of your own
  • FeatureAn API key can be bound to a single project, and the binding is visible, enforced, and editable
  • ImprovementThe project ID is now visible and copyable where you need it for API calls
  • FixEach browser session's timezone is derived from its own proxy exit IP, so it no longer contradicts where the traffic appears to come from
  • FixRepaired 60+ MCP tool parameters that were silently dropped before reaching the API
  • FixOutreach no longer reports success for mail that was never sent

v1.7.0

MajorJuly 24, 2026
  • FeatureCloud browser sessions are metered per minute, capped by per-key quotas, and embeddable on your own domain with short-lived viewer tokens
  • FeatureBrowser profiles — sign in once and every future session starts already authenticated, cookies and local storage intact
  • FeatureThe browser API reached parity with the in-app agent: drag and drop, wait for the network to settle, block requests by type or URL, and pierce shadow DOM
  • FeatureChoose how a page is reduced before extraction — full, simplified, or text-only — so an AI reads structure instead of markup
  • FeatureBrowser sessions are scoped to the active project, and the session panel shows the proxy and live egress IP
  • ImprovementA browser session's lifetime is based on idle time with a keepalive, replacing the hard age cap that killed sessions mid-use
  • ImprovementCloud browser sessions present a coherent fingerprint — real Chrome, matching platform and version, no spoofed WebGL
  • ImprovementThe interactive viewer is responsive, and copy/paste works inside it
  • FixClosed AI billing gaps, including unbounded free-tier chat usage

v1.6.0

NewJuly 20, 2026
  • FeatureHosted MCP endpoint at /api/mcp — external AI agents authenticate with a Scrappy API key, drive the cloud browser, and can converse with the Scrappy agent itself
  • FeatureThe AI assistant can now search and read Scrappy's own documentation when answering you
  • FixLong chat sessions no longer overflow the model's context limit
  • FixThe cloud browser wakes reliably from suspend and reports an outage as an outage instead of a generic error

v1.5.0

NewJune 29, 2026
  • ImprovementSecurity hardening across access control, SSRF, prompt injection, and encryption — every finding from a deep audit closed
  • ImprovementMoved to self-hosted Redis and browser machines that suspend when idle, cutting running costs without changing behavior
  • ImprovementA consistent visual pass across the dashboard — shared loading, alert, and status components, and colors that work in both light and dark mode

v1.4.0

NewMay 28, 2026
  • FeaturePut a browser session to sleep and wake it later with its tabs and cookies intact, instead of losing it
  • ImprovementBrowser screenshots render as images in chat instead of raw data, and oversized tool results are trimmed
  • FixZombie, stale, and orphaned browser sessions are detected and recovered rather than lingering

v1.3.0

MajorApril 11, 2026
  • FeatureCloud browser — run several isolated browser sessions at once and watch or drive any of them live from the dashboard
  • FeatureConsole, network, and DOM panels for a live browser session, streamed from the browser itself
  • FeatureCloud browser SDK — drive a Scrappy browser from your own code with an API key, including an embeddable live-view React component
  • FeatureAutonomous pipeline — set a lead target and Scrappy discovers sources, scrapes, enriches, and validates until it hits the number
  • FeatureImport leads and datasets straight from Airtable, Google Sheets, and folk.app with smart column mapping
  • FeatureEmail finder — find a person's email from a name and company, verified before it is returned
  • FeatureGenerate and download real spreadsheets from your data, with formula-injection protection
  • ImprovementLinkedIn enrichment runs through the anti-detection browser with full session cookies, and can force a re-enrich
  • ImprovementEmail validation adds NeverBounce as a default tier, per-lead SMTP control, and SOCKS5 proxy support

v1.2.0

MajorMarch 31, 2026
  • FeatureMCP server — drive Scrappy from Claude Code and any MCP client, with the full toolset exposed over stdio
  • FeatureThe AI chat agent can now reach every part of Scrappy — 73 new tools across chat, projects, outreach, LinkedIn, GDPR, enterprise, and admin
  • FeatureDatasets — collect any structured data from the web with AI extraction, then export as JSONL or a HuggingFace dataset
  • FeatureContact form outreach — Scrappy detects a contact form on a lead's site, fills it, submits, and tracks the result
  • FeatureWorkflow automation, team collaboration, and advanced analytics — triggers, schedules, approvals, mentions, delegation, and funnel/cohort/forecast reporting
  • FeaturePause and resume a running scraping job, and retry a stuck one without paying for it twice
  • FeatureMove or copy leads between projects, and transfer or duplicate leads and sources between users
  • FeatureBuild a campaign from a brief — upload a deck, add instructions, and keep your progress if you close the tab
  • FeatureLink a GitHub account to an existing password login and sign in either way
  • ImprovementPer-site stealth scraping with proxy selection, fingerprint evasion, and WAF bypass tuned per source
  • ImprovementScraping survives a flaky browser — circuit breaker, per-URL retry, health checks, and automatic restart
  • ImprovementFewer junk leads — role-address detection, a minimum quality threshold, and an AI cleanup pass you can run in bulk
  • ImprovementShift-click to select a range of leads, and your page, sort, and column preferences survive a reload

v1.1.0

NewMarch 24, 2026
  • FeatureAPI key authentication on all endpoints — use Bearer tokens for programmatic access
  • ImprovementRefactored large service files into focused single-responsibility modules for better maintainability
  • FixPersist Playwright browsers in Docker volume to avoid redownloading on container restart
  • FixResolved GitHub OAuth sign-in issues caused by missing User table columns
  • FixFixed DB migration drift, middleware rename, and worker rebuild performance

v1.0.0

MajorMarch 4, 2026
  • FeatureEnterprise features — organizations with SSO/SCIM, API key management, source templates marketplace
  • FeatureProxy profiles — residential and datacenter proxy configuration for scraping
  • FeatureEmail suppression lists — compliance-focused suppression management
  • FeatureData destinations — sync leads to external systems via webhooks, databases, and CRMs
  • FeatureSLA monitoring — configurable uptime and data freshness SLAs per source
  • FeatureSelector healing — auto-repair broken CSS selectors when page structure changes
  • FeatureAI chat agent — Claude-powered assistant for managing leads, sources, and jobs via natural language
  • FeatureSource health analytics dashboard with alert escalation rules
  • FeaturePipeline analytics and admin metrics with LTV tracking
  • Improvement270+ API endpoints with comprehensive documentation
  • ImprovementConcurrency and correctness audit — rate limiter hardening, pagination overflow protection, timing-safe comparisons

v0.9.0

NewFebruary 26, 2026
  • FeatureDeal campaign builder — discover sources, rank accounts, and find profile commonalities using AI
  • FeatureAccounts dashboard — aggregated view of companies scraped across all leads
  • FeatureLinkedIn commonalities analyzer — surface shared traits across profiles using Perplexity AI
  • FeatureCommercial construction lender profile type template
  • ImprovementCampaign wizard with guided deal parameter configuration

v0.8.0

NewFebruary 17, 2026
  • FeatureCredits system with balance tracking and checkout via cred.diy
  • FeatureWebhooks with HMAC signing, delivery history, and one-click retry
  • FeatureAngelSend integration — export leads, send bulk emails, and generate AI-powered sequences
  • FeatureEmail warmup domains — 5-week progressive ramp with DNS tracking and auto-pause on failures
  • ImprovementPer-user AngelSend API keys with fallback to global environment variable

v0.7.0

NewFebruary 17, 2026
  • FeatureGDPR compliance suite — consent management, data export (SAR), and right to erasure
  • FeatureLinkedIn credential manager with health tracking, rate-limit detection, and soft-ban detection
  • FeatureAccount lockout after failed login attempts with lockout status endpoint
  • FeatureData retention worker — daily cleanup of expired leads, exports, and audit logs
  • ImprovementSOC2 audit logging with 2-year retention and sensitive field sanitization
  • ImprovementSession max-age reduced to 1 day for improved security

v0.6.0

NewFebruary 17, 2026
  • FeatureProfile Types system — define custom entity schemas with JSON Schema field definitions
  • FeatureMatching Engine — filter and score profiles with FILTER, SCORED, and AI rule types
  • FeatureAI matching powered by Perplexity sonar-pro with customizable prompt templates
  • FeatureProfile export with optional rule-based filtering, match scores, and AI reasoning columns
  • ImprovementMulti-tier email validation (DNS, MX, SMTP) with batch processing

v0.5.0

NewFebruary 17, 2026
  • FeatureLead CSV import with column mapping UI and duplicate detection
  • FeatureBulk lead actions — delete, tag, and export in CSV or JSON
  • FeatureManual lead creation via Add Lead dialog
  • FeatureScraping job detail view with per-URL progress, retry count, and cancellation
  • ImprovementAutomatic lead deduplication using canonical SHA-256 hashing
  • FixSoft-delete for leads — deleted leads are hidden but recoverable

v0.4.0

NewFebruary 17, 2026
  • FeatureProjects — organize sources and leads into separate workspaces
  • FeatureSource health monitoring — HEALTHY / WARNING / CRITICAL badges with dismissable alerts
  • FeatureSelector validator — test CSS selectors against live pages before activating a source
  • FeatureAlternative source suggestions for CRITICAL sources
  • ImprovementSources now start as DRAFT; explicit activation required

v0.3.0

NewFebruary 1, 2026
  • FeatureAI-powered source discovery using Perplexity sonar-pro
  • FeatureDeep crawl engine with configurable URL frontier and pagination detection
  • FeatureSitemap discovery and URL pattern matching
  • ImprovementRedis-backed rate limiting with sliding window per endpoint
  • ImprovementStandardized API error handling and route middleware

v0.2.0

NewJanuary 15, 2026
  • FeatureBackground worker with BullMQ for scraping, email validation, and retention jobs
  • FeatureCredential manager for storing login credentials used during scraping
  • FeatureProxy rotation support via Webshare API
  • ImprovementSteel Browser integration for reliable, bot-resistant scraping

v0.1.0

LaunchJanuary 1, 2026
  • FeatureInitial launch — web scraping sources, lead management, and email validation
  • FeatureNextAuth authentication with project-scoped access
  • FeaturePostgreSQL + Prisma ORM with Redis queue
  • FeatureDashboard with lead list, source management, and job monitoring