Teknium ea0fd393db perf(compression): gate CJK-aware token estimation behind an ASCII fast path ...

The salvaged estimator ran a per-character Python loop on every
estimate_tokens_rough() call — a ~28,000,000x slowdown vs (len+3)//4 on a
1MB ASCII tool output (measured ~3.0s per call). Gate it:

- str.isascii() O(1) fast path keeps pure-ASCII text bit-identical to the
  classic (len+3)//4 rule at ~1.3x baseline cost (0.23us vs 0.17us per
  1MB call).
- Non-ASCII text counts dense CJK chars via a compiled character-class
  regex in C (len(text) - len(re.sub(''))): ~352ms/1MB hangul vs ~2.1s
  for the per-char loop.
- Non-ASCII-but-non-CJK text (accents, Cyrillic, emoji) keeps the classic
  rule.

Also: parity tests against the per-char reference implementation, and
updated two stale expectations that encoded the old behavior (CJK now
counted ~1 token/char; short string content now ceil-divided instead of
floored to 0). The continuity test now detects merged-into-tail summaries
via _is_context_summary_content.

2026-07-22 06:57:22 -07:00

..

lsp

refactor(lsp): version-tagged _DocState replaces timestamp freshness tracking

2026-07-20 13:43:36 -04:00

pet

fix: remove dead f-string prefixes via ruff F541 (216 sites) (#52336)

2026-07-05 13:42:46 -07:00

secret_sources

fix(secrets): harden encrypted Bitwarden cache

2026-07-22 04:40:07 -07:00

transports

feat(cache): persist the exact bytes sent to the API in an api_content sidecar

2026-07-19 08:25:35 +05:30

__init__.py

fix(agent): preload jiter native parser

2026-05-28 00:20:11 -07:00

account_usage.py

feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)

2026-07-18 14:30:24 +05:30

agent_init.py

fix(compression): unify the attempt cap across every compression site

2026-07-22 06:56:42 -07:00

agent_runtime_helpers.py

fix(desktop, ink): don't wipe messages before final message (#65919)

2026-07-20 11:42:29 -04:00

anthropic_adapter.py

fix(models): complete kimi-k3 rollout across Kimi-direct catalog surfaces

2026-07-20 08:47:55 -07:00

async_utils.py

refactor(gateway): dedupe detached-task consumer + reconnect backoff policy

2026-07-18 20:01:55 +05:30

aux_accounting.py

feat(analytics): record auxiliary model usage per task in session accounting (#65537)

2026-07-16 04:23:12 -07:00

auxiliary_client.py

fix(auxiliary): resolve key_env in _resolve_task_provider_model (#66641)

2026-07-18 19:03:51 -04:00

azure_identity_adapter.py

feat(azure-foundry): add Microsoft Entra ID auth

2026-05-18 10:14:38 -07:00

background_review.py

fix(background_review): gate reasoning_config inheritance on not-routed + dedupe recorder stubs

2026-07-14 17:19:46 +05:30

battery.py

feat(status-bar): add /battery toggle for a color-coded battery read-out

2026-07-21 13:54:11 -05:00

bedrock_adapter.py

fix(bedrock): probe real context window instead of stale static table

2026-07-20 05:49:44 -07:00

billing_usage.py

feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)

2026-07-18 14:30:24 +05:30

billing_view.py

fix(billing): rename user-facing "terminal billing" copy to Remote Spending (#68355)

2026-07-21 12:20:25 +05:30

bounded_response.py

fix(agents): bound streaming error-response body reads

2026-07-05 14:00:20 -07:00

browser_provider.py

fix(browser): self-review pass — dead-import, log levels, future-proofing

2026-05-17 04:04:15 -07:00

browser_registry.py

style: restore PEP8 blank-line separation after dead-code removal

2026-05-29 04:22:27 -07:00

chat_completion_helpers.py

fix: widen geo-prefix parity to all Bedrock ID normalization sites

2026-07-20 05:38:45 -07:00

codex_responses_adapter.py

fix(agent): treat Codex incomplete content filter as refusal

2026-07-15 09:47:37 -07:00

codex_runtime.py

feat(codex): stream live app-server events to TUI/desktop tool cards

2026-07-17 13:44:12 -07:00

coding_context.py

fix(windows): share one bounded, tree-killing git probe across both call sites (#68997)

2026-07-21 20:18:43 -05:00

context_breakdown.py

feat(desktop): add context usage breakdown popover

2026-06-29 09:18:10 -04:00

context_compressor.py

fix(compression): handle CJK token budgeting

2026-07-22 06:57:22 -07:00

context_engine.py

fix(compression): harden provider context handoff

2026-07-20 02:25:57 -07:00

context_references.py

fix(security): anchor @file context refs to canonical read deny-list

2026-07-01 02:43:49 -07:00

conversation_compression.py

fix(compression): preserve synthetic user provenance

2026-07-22 06:56:53 -07:00

conversation_loop.py

fix(compression): unify the attempt cap across every compression site

2026-07-22 06:56:42 -07:00

copilot_acp_client.py

fix(file-safety): distinguish safe-root write denial from credential blocks

2026-07-14 17:09:40 +05:30

credential_persistence.py

feat(auth): make xAI Grok OAuth device-code-only, drop loopback login

2026-07-02 13:17:41 -07:00

credential_pool.py

fix(secrets): scope BWS-injected provider keys

2026-07-22 04:39:17 -07:00

credential_sources.py

feat(auth): make xAI Grok OAuth device-code-only, drop loopback login

2026-07-02 13:17:41 -07:00

credits_tracker.py

feat(tui+cli): change your Nous plan from the terminal (/subscription, /topup, terminal-billing UX) (#51639)

2026-07-18 14:30:24 +05:30

curator_backup.py

fix(cron): widen UTF-8 BOM tolerance to backup/curator jobs.json readers

2026-07-18 02:31:20 -07:00

curator.py

fix(runtime): preserve resolved fork metadata

2026-07-10 18:32:32 +05:30

display.py

feat(gateway): live per-tool status line on Slack

2026-07-18 12:28:59 -07:00

error_classifier.py

fix(error_classifier): stop empty-response advisories from triggering compression

2026-07-18 12:54:58 -07:00

errors.py

fix(moa): surface stale presets without retries

2026-07-17 13:49:12 -07:00

file_safety.py

fix(secrets): harden encrypted Bitwarden cache

2026-07-22 04:40:07 -07:00

gemini_native_adapter.py

feat(gemini): improve request context for support and compatibility

2026-07-13 22:26:19 -07:00

gemini_schema.py

fix(gemini): prune required entries missing from properties in tool schemas

2026-07-17 04:54:06 -07:00

i18n.py

fix(packaging): ship locales/ i18n catalogs in wheel, sdist, and Nix (#38383)

2026-06-03 12:00:27 -07:00

image_gen_provider.py

feat(image-gen): add image-to-image / editing to image_generate (#48705)

2026-06-18 22:13:07 -07:00

image_gen_registry.py

fix(plugins): filter resolution by is_available() in web + image_gen registries

2026-05-13 22:31:28 -07:00

image_routing.py

fix(auxiliary): scope runtime state to each turn

2026-07-17 09:08:30 -07:00

insights.py

fix(insights): include auxiliary usage in overview token totals (#65603)

2026-07-16 05:39:33 -07:00

iteration_budget.py

refactor(run_agent): extract OpenAI proxy, safe stdio, IterationBudget

2026-05-16 17:59:32 -07:00

jiter_preload.py

fix(agent): preload jiter native parser

2026-05-28 00:20:11 -07:00

kanban_stop.py

follow-up: integrate agent nudge + dispatcher retry docs and tests

2026-07-14 16:47:33 +05:30

learn_prompt.py

fix(learn): honor requirements mixed with sources in /learn requests (#55956)

2026-06-30 16:56:01 -07:00

learning_graph_render.py

fix: cover remaining GNU-only %-d strftime site in learning graph render

2026-07-05 00:59:35 -07:00

learning_graph.py

fix(learning_graph): guard non-dict metadata so /journey can't crash

2026-07-01 16:25:48 -05:00

learning_mutations.py

refactor(journey): route memory mutations through MemoryStore atomic I/O

2026-06-30 15:16:21 -05:00

lmstudio_reasoning.py

fix(lmstudio): clamp max/ultra reasoning effort to LM Studio's ceiling

2026-07-16 07:57:51 -07:00

manual_compression_feedback.py

fix(context): harden compression failure feedback

2026-07-16 14:34:03 +05:30

markdown_tables.py

fix(cli): vertical fallback for markdown tables wider than terminal (#23948)

2026-05-11 16:49:13 -07:00

memory_manager.py

fix(memory): drain queued writes on shutdown

2026-07-17 04:55:58 -07:00

memory_provider.py

fix(backup): capture memory-provider state stored outside HERMES_HOME (#50325)

2026-06-21 12:03:46 -07:00

message_content.py

fix(openviking): preserve structured sync attribution

2026-06-19 15:23:41 +08:00

message_sanitization.py

fix(agent): close tool-call sequence on all interrupt aborts, not just finalize_turn

2026-06-25 12:24:34 -05:00

moa_loop.py

feat(portal): ambient conversation context entangles aux/MoA/delegate calls

2026-07-16 01:13:43 -07:00

moa_trace.py

fix(moa): capture streamed aggregator output into full-turn traces (#56312)

2026-07-01 04:07:46 -07:00

model_metadata.py

perf(compression): gate CJK-aware token estimation behind an ASCII fast path

2026-07-22 06:57:22 -07:00

models_dev.py

remove Vercel AI Gateway and Vercel Sandbox (#33067)

2026-05-27 00:43:32 -07:00

moonshot_schema.py

fix(agent): inject empty required array on Moonshot object schemas

2026-07-20 11:05:52 -07:00

nous_rate_guard.py

codebase: add encoding='utf-8' to all bare open() calls (PLW1514)

2026-05-08 14:27:40 -07:00

onboarding.py

fix(config): close unreadable-overwrite bug class at a single chokepoint

2026-07-05 23:00:34 +05:30

oneshot.py

feat(agent): one-shot LLM helper + llm.oneshot gateway RPC (#51261)

2026-06-23 08:01:50 +00:00

plugin_llm.py

feat(plugins): run any LLM call from inside a plugin via ctx.llm (#23194)

2026-05-10 07:09:28 -07:00

portal_tags.py

feat(portal): ambient conversation context entangles aux/MoA/delegate calls

2026-07-16 01:13:43 -07:00

process_bootstrap.py

fix(agent): apply pool-level keepalive to the process_bootstrap sibling builder

2026-07-05 03:14:55 -07:00

prompt_builder.py

fix(matrix): correct platform hint over-claims, add regression tests + docs

2026-07-20 11:10:49 -07:00

prompt_caching.py

refactor(salvage): scope #40632 to the two live copy-on-write sites

2026-07-09 14:35:14 +05:30

rate_limit_tracker.py

refactor: remove dead code — 1,784 lines across 77 files (#9180)

2026-04-13 16:32:04 -07:00

reactions.py

feat(agent): core affection reaction detector + reaction_callback

2026-07-10 05:41:59 -05:00

reasoning_timeouts.py

feat(models): add Claude Sonnet 5 support

2026-07-20 02:25:44 -07:00

redact.py

fix(redaction): normalize URL credential key aliases

2026-07-20 02:25:57 -07:00

replay_cleanup.py

refactor: shared helpers for api_content sidecar pop/drop/extract

2026-07-19 08:25:35 +05:30

retry_utils.py

refactor(retry): single-source Z.AI overload short-attempts + drop change-detector assert

2026-07-07 11:57:01 +05:30

runtime_cwd.py

fix(agent): scope install-tree guard to fallback-picked cwds, allow cli/tui in-tree dev

2026-07-16 04:32:23 -07:00

secret_scope.py

fix(secrets): scope BWS-injected provider keys

2026-07-22 04:39:17 -07:00

shell_hooks.py

fix(cli): safe mode also skips shell-hook registration

2026-07-07 02:32:32 -07:00

skill_bundles.py

fix(gateway): apply platform-disabled skill gate to bundle invocations (#59156)

2026-07-05 14:48:11 -07:00

skill_commands.py

fix(skills): guard skill slash commands against core-command and slug collisions

2026-07-14 16:41:21 +05:30

skill_preprocessing.py

fix(windows): hide console-window flash on backend git/gh/wmic/bash subprocess spawns

2026-06-28 05:28:45 -07:00

skill_utils.py

fix(skills): strip UTF-8 BOM before parsing SKILL.md frontmatter

2026-07-17 04:52:02 -07:00

ssl_guard.py

fix(ssl): align guard docs and escape hatch

2026-06-13 21:14:32 -07:00

ssl_verify.py

fix(agent): honor custom CA certs on aux client + harden TLS resolution

2026-07-02 04:51:56 +05:30

stream_diag.py

feat(agent): buffer retry/fallback status, surface only on terminal failure (#33816)

2026-05-28 04:53:27 -07:00

stream_single_writer.py

fix(streaming): make the single-writer fence best-effort so a missing guard can't crash a turn (#66448)

2026-07-17 18:31:09 +00:00

subdirectory_hints.py

fix(subdirectory_hints): catch RuntimeError from Path.expanduser()

2026-07-01 04:55:15 -07:00

subscription_view.py

feat(cli): plan catalog on Free + plan= deep link + top-up/auto-refill copy split (#68689)

2026-07-22 08:11:09 +05:30

system_prompt.py

fix: replace hardcoded ~/.hermes with get_hermes_home() in system prompt (#66450)

2026-07-18 19:03:51 -04:00

think_scrubber.py

fix(agent): re-arm think scrubber boundary after stream flush

2026-07-16 01:07:29 +05:30

thinking_timeout_guidance.py

fix(agent): detect thinking-timeout for reasoning models and surface actionable guidance instead of misleading file-write advice

2026-06-25 19:00:48 -07:00

thread_scoped_output.py

fix(bg-review): scope stdout/stderr silencing to the worker thread (#55966)

2026-06-30 17:28:33 -07:00

title_generator.py

fix(title): prevent stale background title generation from reloading unloaded Ollama models

2026-07-16 23:07:13 -07:00

tool_dispatch_helpers.py

fix(agent): canonicalise paths in parallel-batch planner to prevent same-file concurrent mutation

2026-07-16 04:26:32 -07:00

tool_executor.py

fix(checkpoints): honor gateway config and task cwd (#68195)

2026-07-20 13:04:12 -07:00

tool_guardrails.py

fix(agent): tolerate lone UTF-16 surrogates in tool-guardrail hashing

2026-07-18 02:08:39 -07:00

tool_result_classification.py

fix(agent): preserve none vs unknown tool effects (#61783)

2026-07-11 05:41:58 -07:00

trace_upload.py

feat(sessions): trace export + HF upload via 'sessions export --format trace' (#60507)

2026-07-07 15:12:49 -07:00

trajectory.py

…

transcription_provider.py

feat(stt): add register_transcription_provider() plugin hook

2026-05-25 01:41:19 -07:00

transcription_registry.py

fix(deepinfra): harden multimodal provider routing

2026-07-14 02:59:39 +05:30

tts_provider.py

feat(tts): add register_tts_provider() plugin hook (closes #30398)

2026-05-24 18:04:54 -07:00

tts_registry.py

feat(providers): Support DeepInfra as an LLM provider

2026-07-14 02:59:39 +05:30

turn_context.py

fix(compression): unify the attempt cap across every compression site

2026-07-22 06:56:42 -07:00

turn_finalizer.py

fix(desktop, ink): don't wipe messages before final message (#65919)

2026-07-20 11:42:29 -04:00

turn_retry_state.py

feat(vertex): add Google Vertex AI provider for Gemini (OAuth2)

2026-07-01 05:25:33 -07:00

usage_pricing.py

fix(pricing): strip apac./au. Bedrock region prefixes so cost isn't unknown

2026-07-20 05:38:45 -07:00

verification_evidence.py

fix(desktop, ink): don't wipe messages before final message (#65919)

2026-07-20 11:42:29 -04:00

verification_stop.py

fix(approval): allow verifier temp cleanup

2026-07-12 04:32:52 -07:00

verify_hooks.py

feat(agent): add pre_verify hook and verify-on-stop coding guidance

2026-06-30 00:59:29 -05:00

vertex_adapter.py

security(vertex): route credential/project/region resolution through the profile secret scope

2026-07-02 06:07:56 +05:30

video_gen_provider.py

feat(providers): Support DeepInfra as an LLM provider

2026-07-14 02:59:39 +05:30

video_gen_registry.py

fix(deepinfra): harden multimodal provider routing

2026-07-14 02:59:39 +05:30

web_search_provider.py

fix(web): widen config-aware env resolution to exa/parallel/tavily/brave-free providers

2026-07-06 02:42:24 -07:00

web_search_registry.py

fix(web): correct 'disabled plugin' diagnosis for web backends (#59573)

2026-07-06 04:38:17 -07:00