Teknium
55f9e472a0
Cold CLI time-to-banner was ~1.8s (hermes) / ~2.8s (hermes -w). The banner path was paying for work the session doesn't need before first input: - aux availability probes built REAL OpenAI/httpx clients (openai import ~0.3s + SSL context) just to answer check_fns. New aux_probe_mode() returns a cache-excluded stub; resolution policy unchanged. - tools/mcp_tool imported the mcp SDK (~260ms, mcp.types pydantic model construction) at module import even with zero MCP servers configured. SDK import is now lazy behind _ensure_mcp_sdk(); _MCP_AVAILABLE is a find_spec probe so every existing gate/test keeps its semantics. - banner blocked 500ms on the update-check prefetch; now waits 50ms and defers the warning line to a daemon thread (prints above the prompt). - banner recomputed get_tool_definitions + skills scan + git state every launch; now snapshotted to ~/.hermes/cache/banner_snapshot.json keyed on (config.yaml, .env, checkout rev, toolsets) and replayed on warm launches with a background refresh. Agent tool list is still computed fresh. - _resolve_active_context_length probed the Nous portal /models (~200ms network) per launch; the tool-search gate now prefers the on-disk context cache when present. - schema reconciliation re-executed SCHEMA_SQL in a scratch SQLite DB (~85ms) per SessionDB(); the reference parse is now disk-memoized by DDL hash (live-DB diffing still runs every startup). - bundled-skills sync (~120-170ms rglob/hash) moved off the startup path to a daemon thread; plugin discovery starts in the background and every synchronous consumer joins via discover_plugins(). - hermes_cli.auth imported httpx eagerly (~30ms); now a lazy proxy that test monkeypatching still reaches (setattr forwards to the real module). - fast chat launch: unambiguous 'hermes'/'hermes chat' invocations skip building all ~40 subcommand parsers (bails to full dispatch on anything else, incl. container mode). - -w path: git worktree add runs with checkout.workers=8 (0.6s→0.2s) and overlaps HermesCLI construction; --skills preload runs in the background and is folded in at agent init (finalize_preloaded_skills, same fail-loud contract for fully-unknown skill lists); stale-worktree prune moved off the banner path. Warm results (PTY time-to-banner, 5-run): hermes 1.80s → 0.38-0.40s; hermes -w -s hermes-agent-dev --yolo 2.82s → 0.57-0.69s.
90 lines
3.4 KiB
Python
90 lines
3.4 KiB
Python
"""Shared fixtures for tests/tools/ web-provider tests.
|
|
|
|
Per-file subprocess isolation means each test file gets a fresh interpreter,
|
|
so module-level state (like the web-search-provider registry) is empty when
|
|
a file starts. The ``web_registry_populated`` fixture registers all bundled
|
|
providers before each test and resets the registry afterwards — tests that
|
|
depend on the registry being populated should use it explicitly or via
|
|
``@pytest.mark.usefixtures("web_registry_populated")``.
|
|
"""
|
|
|
|
from unittest.mock import patch
|
|
|
|
import pytest
|
|
|
|
|
|
@pytest.fixture(autouse=True)
|
|
def _materialize_mcp_sdk_symbols():
|
|
"""Materialize the lazily-imported MCP SDK before each tools test.
|
|
|
|
``tools/mcp_tool.py`` defers the ~260ms ``mcp`` SDK import until first
|
|
real use (CLI startup perf). Tests in this directory patch SDK symbols
|
|
(``ClientSession``, ``stdio_client``, ``_MCP_HTTP_AVAILABLE``, ...) on
|
|
the module and expect the pre-lazy eager-import world: symbols bound,
|
|
availability flags reflecting the installed SDK. Ensure that state up
|
|
front so ``mock.patch`` sees real originals and ``_ensure_mcp_sdk()``
|
|
can never clobber a patched flag mid-test (it no-ops once attempted).
|
|
"""
|
|
try:
|
|
from tools import mcp_tool
|
|
mcp_tool._ensure_mcp_sdk()
|
|
except Exception:
|
|
pass
|
|
yield
|
|
|
|
|
|
def register_all_web_providers():
|
|
"""Register all bundled web-search providers into the global registry.
|
|
|
|
This is the single source of truth for the provider list used by
|
|
test classes that need the registry populated for dispatch checks.
|
|
"""
|
|
from agent.web_search_registry import register_provider, _reset_for_tests
|
|
from plugins.web.brave_free.provider import BraveFreeWebSearchProvider
|
|
from plugins.web.ddgs.provider import DDGSWebSearchProvider
|
|
from plugins.web.exa.provider import ExaWebSearchProvider
|
|
from plugins.web.firecrawl.provider import FirecrawlWebSearchProvider
|
|
from plugins.web.parallel.provider import ParallelWebSearchProvider
|
|
from plugins.web.searxng.provider import SearXNGWebSearchProvider
|
|
from plugins.web.tavily.provider import TavilyWebSearchProvider
|
|
from plugins.web.xai.provider import XAIWebSearchProvider
|
|
|
|
_reset_for_tests()
|
|
for cls in (
|
|
BraveFreeWebSearchProvider,
|
|
DDGSWebSearchProvider,
|
|
ExaWebSearchProvider,
|
|
FirecrawlWebSearchProvider,
|
|
ParallelWebSearchProvider,
|
|
SearXNGWebSearchProvider,
|
|
TavilyWebSearchProvider,
|
|
XAIWebSearchProvider,
|
|
):
|
|
register_provider(cls())
|
|
|
|
|
|
@pytest.fixture
|
|
def web_registry_populated():
|
|
"""Populate the web-search-provider registry for one test, then reset."""
|
|
register_all_web_providers()
|
|
yield
|
|
from agent.web_search_registry import _reset_for_tests
|
|
_reset_for_tests()
|
|
|
|
|
|
@pytest.fixture
|
|
def disable_lazy_stt_install():
|
|
"""Disarm the runtime lazy-install probe so static ``_HAS_FASTER_WHISPER``
|
|
patches accurately simulate 'faster-whisper not installed'.
|
|
|
|
Without this, ``_try_lazy_install_stt()`` calls
|
|
``importlib.util.find_spec("faster_whisper")``, which returns truthy
|
|
whenever the package is installed in the dev / CI environment —
|
|
defeating the test's ``_HAS_FASTER_WHISPER=False`` patch.
|
|
|
|
Opt in at module scope with
|
|
``pytestmark = pytest.mark.usefixtures("disable_lazy_stt_install")``.
|
|
"""
|
|
with patch("tools.transcription_tools._try_lazy_install_stt", return_value=False):
|
|
yield
|