All pull requests

Pull requests

• fix(api): record robots.txt denials on crawls so the status warning and robotsBlocked work

  #4900·claude[bot] opened Oct 1, 2026Bot·

  ·

• fix(api): report crawl completedAt correctly when no page succeeds

  #4899·claude[bot] opened Oct 1, 2026Bot·

  ·
  1

• feat(js-sdk): abortable crawl() that cancels its job; cancelCrawl returns false on 409

  #4898·claude[bot] opened Oct 1, 2026Bot·

  ·

• fix(python-sdk): cancel the crawl when async crawl() is cancelled; cancel_crawl returns False on 409

  #4897·claude[bot] opened Oct 1, 2026Bot·

  ·

• fix(test-site): upgrade devalue to >=5.9.3 (6 GHSA advisories)

  #4896·claude[bot] opened Oct 1, 2026Bot·

  ·

• docs(release): draft v2.12.0 release notes and changelog post

  #4890·cursor[bot] opened Oct 1, 2026Bot·

  ·
  1

• fix(api): negotiate OpenAI-compatible endpoints and structured output

  #4888·B-A-M-N opened Oct 1, 2026·

  ·
  48

• fix(js-sdk): ignore self-contradictory empty completed catchup frames

  #4887·aniketkrs opened Oct 1, 2026·

  ·
  1

  6

• Accept Vercel Marketplace OIDC resource tokens (Phase 1, dual auth)

  #4874·erikengervall opened Sep 30, 2026Contributor·2 of 3 tasks·

  ·

• fix(python-sdk): stop monitor pagination on repeated cursors

  #4871·davidscottpope-gif opened Sep 30, 2026·

  ·
  3

• fix: interact() preserves scrape's location and proxy settings

  #4858·genius-0963 opened Sep 30, 2026·

  ·
  1

  5

• fix(json): fit extraction content to self-hosted models' context window

  #4857·Anjali-Kedia opened Sep 30, 2026·

  ·
  1

  14

• Give agent hints stable ids and record each emission

  #4854·rakshith48 opened Sep 30, 2026Collaborator·

  ·

• fix(dotnet-sdk): avoid replaying ambiguous write failures

  #4850·rudycelekli opened Sep 29, 2026·

  ·
  9

• fix(dotnet-sdk): stop pagination on repeated next URLs

  #4849·rudycelekli opened Sep 29, 2026·

  ·
  3

• fix(python-sdk): accept ignore_query_parameters and location in async map

  #4844·RaphaelFakhri opened Sep 29, 2026·

  ·

• fix(js-sdk): send the request when maxRetries is 0

  #4843·RaphaelFakhri opened Sep 29, 2026·

  ·
  2

• fix(python-sdk): match sync extract in the async client

  #4842·RaphaelFakhri opened Sep 29, 2026·

  ·
  2

• fix(js-sdk): keep polling crawl and batch jobs after a 408 or 429 status response

  #4840·RaphaelFakhri opened Sep 29, 2026·

  ·
  8

• fix(python-sdk): forward robots_user_agent from crawl and start_crawl

  #4839·RaphaelFakhri opened Sep 29, 2026·

  ·

• fix(python-sdk): stop the sync watcher when its timeout elapses

  #4838·RaphaelFakhri opened Sep 29, 2026·

  ·

• fix(crawler): check includePaths on a crawled page's redirect target

  #4833·breken-ai opened Sep 29, 2026·

  ·

• fix(api): skip invalid batch scrape URLs by default, as documented

  #4831·breken-ai opened Sep 29, 2026·

  ·
  3

• fix(crawler): follow external links one hop, not into the external site

  #4830·breken-ai opened Sep 29, 2026·

  ·
  9

• fix(api): prevent duplicate browsers on concurrent scrape interactions

  #4829·rudycelekli opened Sep 28, 2026·

  ·
  13