Skip to content

Document scrape freshness and cache metadata#156

Open
hmishra2250 wants to merge 2 commits into
mainfrom
agent/cache-provenance-phase1-20260714
Open

Document scrape freshness and cache metadata#156
hmishra2250 wants to merge 2 commits into
mainfrom
agent/cache-provenance-phase1-20260714

Conversation

@hmishra2250

@hmishra2250 hmishra2250 commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

Summary

  • document existing firecrawl scrape --max-age and --json in the scrape skill
  • add fresh-retrieval/cache provenance guidance for final verification scrapes
  • add job/ATS liveness guidance for agent workflows

Root cause / behavior change

CLI agents could already pass --max-age, but the skill did not teach when to request a fresh retrieval path or how to inspect cache provenance. The scrape skill now makes the final-verification pattern explicit without treating retrieval freshness as source-object liveness.

Validation

  • scoped grep for --max-age, --json, metadata.cache, ATS/liveness guidance ✅
  • git diff --check
  • GitHub Actions ✅: tests, macOS/Linux/Windows binary tests, and macOS/Linux/Windows npm package smoke tests

@hmishra2250
hmishra2250 marked this pull request as ready for review July 18, 2026 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant