Skip to content

feat(sdk): add MIME and PDF processor options - #101

Merged
VinciGit00 merged 5 commits into
mainfrom
marcovinciguerra/feat/search-content-types
Jul 30, 2026
Merged

feat(sdk): add MIME and PDF processor options#101
VinciGit00 merged 5 commits into
mainfrom
marcovinciguerra/feat/search-content-types

Conversation

@VinciGit00

@VinciGit00 VinciGit00 commented Jul 29, 2026

Copy link
Copy Markdown
Member

Aligns the Python SDK with the current API and playground contract across Scrape, Extract, Search, and Crawl.

Changes

  • add allowed_types and processors to all four endpoint methods and request models
  • add PdfProcessor(max_pages=...)
  • replace the obsolete Crawl content_types field
  • document all supported types by default and the independent PDF page cap

Verification

  • Ruff checks passed
  • pytest: 30 passed, 1 skipped
  • live local calls through the Python SDK: Scrape, Extract, Search, and Crawl all returned status: success
  • PDF Search with max_pages=1 returned OCR metadata with exactly one processed page

Counterparts: ScrapeGraphAI/scrapegraph-js#21, ScrapeGraphAI/docs-mintlify#93, ScrapeGraphAI/sgai-stack#963.

Search now accepts contentTypes so callers can pick which content types get
fetched. Adds application/json and text/markdown to FetchContentType to match
the API enum.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@VinciGit00
VinciGit00 force-pushed the marcovinciguerra/feat/search-content-types branch from fbafa92 to a23f016 Compare July 29, 2026 13:06
@github-actions

Copy link
Copy Markdown

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@VinciGit00 VinciGit00 changed the title feat(search): add contentTypes filter feat(search): add MIME and PDF processor options Jul 30, 2026
@VinciGit00 VinciGit00 changed the title feat(search): add MIME and PDF processor options feat(sdk): add MIME and PDF processor options Jul 30, 2026
@VinciGit00
VinciGit00 merged commit 69de22f into main Jul 30, 2026
6 checks passed
@VinciGit00
VinciGit00 deleted the marcovinciguerra/feat/search-content-types branch July 30, 2026 14:54
github-actions Bot pushed a commit that referenced this pull request Jul 30, 2026
# [2.3.0](v2.2.0...v2.3.0) (2026-07-30)

### Features

* **sdk:** add MIME and PDF processor options ([#101](#101)) ([69de22f](69de22f))
@github-actions

Copy link
Copy Markdown

🎉 This PR is included in version 2.3.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant