Teknium
8adef09be8
Review fixes for #94618 (all three blockers reproduced by the reviewer through the real web_extract_tool): 1. Cache lookup moved AFTER provider resolution and strict-selection validation, and gated per-URL on the website blocklist policy — a blocklist-blocked or misconfigured-backend call now behaves exactly as it would without a cache instead of serving cached content. 2. Rescue-served extract batches are never cached (mirrors the search memo's exclusion), keeping one-shot rescue one-shot. 3. Cache entries now get dedicated per-(url, format, provider) files instead of sharing the URL-keyed truncate-store file — html and markdown (or two backends') copies of one URL no longer overwrite each other, and switching extract backends within the TTL never serves the old backend's rendering. Also from review: per-process index tmp filename (cross-process writers can no longer truncate each other mid-write) and held flight locks are never evicted from the bounded lock table (eviction could have allowed a duplicate paid request). New regression tests for formats/provider keying; E2E harness extended with policy-block, strict-selection, rescue-two-call, and dual-format scenarios — 6/6 pass; original 13/13 still pass.
Website
This website is built using Docusaurus, a modern static website generator.
Installation
yarn
Local Development
yarn start
This command starts a local development server and opens up a browser window. Most changes are reflected live without having to restart the server.
Build
yarn build
This command generates static content into the build directory and can be served using any static contents hosting service.
Deployment
Using SSH:
USE_SSH=true yarn deploy
Not using SSH:
GIT_USER=<Your GitHub username> yarn deploy
If you are using GitHub pages for hosting, this command is a convenient way to build the website and push to the gh-pages branch.
Diagram Linting
CI runs ascii-guard to lint docs for ASCII box diagrams. Use Mermaid (````mermaid`) or plain lists/tables instead of ASCII boxes to avoid CI failures.