45a4db2225
Follow-up to the cherry-picked "cache extracts by returned URL": Keenable and Firecrawl report the post-redirect address in `url` and the REQUESTED URL in `metadata.sourceURL`, so matching on `url` alone left every redirected page uncached. Accept either field, as long as it names a URL from this batch; anything else is served but never cached (a miss re-fetches, a mis-key poisons the cache for the whole TTL). Docs: say the cache key is the requested URL the provider reports, not the batch position. Co-authored-by: nemofq <5635994+nemofq@users.noreply.github.com> Co-authored-by: wooyongbin3-cpu <256294002+wooyongbin3-cpu@users.noreply.github.com>
Website
This website is built using Docusaurus, a modern static website generator.
Installation
yarn
Local Development
yarn start
This command starts a local development server and opens up a browser window. Most changes are reflected live without having to restart the server.
Build
yarn build
This command generates static content into the build directory and can be served using any static contents hosting service.
Deployment
Using SSH:
USE_SSH=true yarn deploy
Not using SSH:
GIT_USER=<Your GitHub username> yarn deploy
If you are using GitHub pages for hosting, this command is a convenient way to build the website and push to the gh-pages branch.
Diagram Linting
CI runs ascii-guard to lint docs for ASCII box diagrams. Use Mermaid (````mermaid`) or plain lists/tables instead of ASCII boxes to avoid CI failures.