Files
EvoScientist-Multi/EvoScientist/deploy/server.py
T
Xiaohui Yan 3c5cc831c0 Feat/configurable bind host (#402)
* feat: configurable bind host for WebUI and langgraph dev (refs #400)

WebUI mode was only reachable from the machine running it: the front-end
got no bind interface, and `start_langgraph_dev(...)` was called without a
host, so both servers stayed on loopback with no way to widen them.

Adds two config fields with deliberately different defaults:

  webui_host        = 0.0.0.0    front-end serves the app shell, no secrets
  langgraph_dev_host = 127.0.0.1  unauthenticated API, agent can run shell

The design hinges on separating bind address from client address. Only
bind() uses the configured interface; every consumer that *connects*
(health probes, occupancy checks, async sub-agent self-dispatch) goes
through the new `_probe_host`, which maps a wildcard bind back to
loopback and honors a pinned interface verbatim. `_can_bind_port` is the
one exception and binds the literal host, since it must replicate the
bind the server itself will attempt.

  - manager.py: `_probe_host`, `_is_loopback_host`, `_format_hostport`;
    host kwarg threaded through the probes and `start_langgraph_dev`,
    which now emits `--host` and propagates
    EVOSCIENTIST_LANGGRAPH_DEV_HOST to the subprocess
  - sdk.py: `langgraph_dev_url` tracks host as well as port;
    EvoScientist.py reuses it instead of an inline f-string
  - server.py: `--host` flag mirroring `--port`, plus a red PUBLIC BIND
    banner whenever the bind is not provably loopback
  - webui.py: forwards both hosts; the front-end is widened via HOSTNAME
    because @evoscientist/webui ships no --host flag — its bin launcher
    does `HOSTNAME: process.env.HOSTNAME || "127.0.0.1"`. The warning is
    gated on the backend host only, so the shipped front-end default
    doesn't print a banner on every launch

Verified end to end against a live server: requesting 0.0.0.0 yields a
socket listening on 0.0.0.0 with the health probe correctly resolved to
127.0.0.1, while the default still binds 127.0.0.1 only.

Note: webui_host defaulting to 0.0.0.0 is a behavior change — upgrading
users will find the front-end reachable from the LAN.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* feat: default both bind hosts to 0.0.0.0, add --host and wizard host rendering (closes #400)

Completes the remaining items from #400.

  - `langgraph_dev_host` now defaults to 0.0.0.0, matching `webui_host`.
    Remote WebUI use needs both anyway (the UI reaches the backend from the
    browser, not server-side), so a loopback backend default just meant every
    remote user hit a silently failing UI. `_DEFAULT_HOST` and sdk's
    `DEFAULT_LANGGRAPH_DEV_HOST` follow, so there is one story about where
    these servers listen.

    SECURITY: this exposes an unauthenticated API whose agent can run shell
    commands. The red PUBLIC BIND banner consequently fires on every launch
    while exposed — kept deliberately, since the exposure is real and the
    escape hatch (`--host 127.0.0.1` / `config set langgraph_dev_host`) is
    only discoverable if we say so. READMEs now lead with the warning and
    document the SSH-tunnel alternative.

  - `EvoSci --host <ip>` on the WebUI launch path, driving both servers. In
    WebUI mode they are two halves of one surface; moving only one leaves the
    UI loading but unable to reach the agent. Blank values are dropped rather
    than written as an empty override that would beat the config file.

  - Onboarding wizard no longer prints hard-coded `http://127.0.0.1:{port}` /
    `http://localhost:{port}` (steps.py:160, :223) — both render the
    configured bind through `_base_url` / `_format_hostport`, so a pinned
    interface is reported honestly and a wildcard still shows loopback.

Verified against a live server: with no host argument at all, resolution
through EvoScientistConfig yields a socket listening on 0.0.0.0, a client URL
of http://127.0.0.1, and the warning gate returning True.

Still open and tracked separately: the front-end takes its backend URL from
browser input: `@evoscientist/webui` reads only HOSTNAME, PORT and
EVOSCIENTIST_LANGGRAPH_DEV_PORT, so advertising a backend URL needs a change
in that repo.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* ci: bump setup-uv v6 -> v9.0.0 to drop the deprecated node20 runtime

GitHub now warns that setup-uv@v6 targets Node.js 20 and is being forced
onto Node.js 24. v7.0.0 is the release that made that switch, so anything
>= v7 clears the warning; v9.0.0 is current.

Pinned to the full tag deliberately: setup-uv stopped publishing major and
minor tags in v8.0.0 as supply-chain hardening, so `@v9` and `@v8` return
404 and would fail the job outright. Releases are immutable from v8 on, so
the full tag is as tamper-proof as a SHA. Comment left in lint.yml because
"simplifying" this back to `@v9` is an easy and CI-breaking mistake.

actions/checkout@v5 is already node24 and needs no change.

Note: v9.0.0 flips the `prune-cache` default to false (upstream did this to
ease load on PyPI infrastructure). None of these workflows set it, so they
follow the new default and Actions cache usage may grow.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* fix(cli): correct --host help text and warn on public bind in non-WebUI modes

The --host help claimed "WebUI mode only", which is wrong in a way that
matters for security. `--host` writes `langgraph_dev_host` unconditionally,
and `_ensure_async_subagent_server` auto-starts that backend for tui / cli /
serve as well — the langgraph dev server is shared across UI modes. So the
flag narrows or widens the agent API in every mode, and only `webui_host` is
actually WebUI-specific. Reported against cli/commands.py.

The documentation error hid a real gap: the PUBLIC BIND banner lived only in
deploy/server.py and deploy/webui.py, so a plain `EvoSci` session bound
0.0.0.0 with no runtime signal whatsoever — and `--help` is opt-in, so
fixing the text alone would not surface it. Added the same banner to the
shared CLI path, gated on `is_async_subagents_available()`: ensure_langgraph_dev
fails soft (async degrades to in-process delegation), and warning about a
bind that never happened would be worse than staying quiet.

READMEs (EN + zh-CN) get the same correction — the warning block sat inside
the Desktop WebUI section and read as WebUI-scoped.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* fix(deploy): strip the config-derived bind host, not just the CLI one

`deploy()` only stripped the `--host` branch. When the flag was omitted,
`getattr(config, "langgraph_dev_host", ...)` flowed unstripped into
`_is_port_occupied`, `is_langgraph_dev_running`, `start_langgraph_dev` and
the banner. `run_webui` already strips unconditionally; this aligns the two.

Reachable because `deploy()` reads through `getattr` and is routinely handed
duck-typed config objects (tests, embedders) that never run
`EvoScientistConfig.__post_init__`, which is what normally normalizes these
fields.

Worst case was not just a bad bind: `_is_loopback_host(" 127.0.0.1 ")` is
False, so a padded loopback value would print a false PUBLIC BIND warning
while binding a string socket.bind() rejects outright — a security banner
saying the opposite of the truth.

Three regression tests added, each verified to fail against the old code.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* style: apply ruff format to the bind-host changes

The Lint workflow runs both `ruff check` and `ruff format --check`; I had
only been running the former locally, so five files landed unformatted and
failed CI. Whitespace and line-wrapping only — no semantic change.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

* fix(security): keep the langgraph dev backend on loopback by default

The backend is an unauthenticated API whose agent can run shell commands,
and it is auto-started in every UI mode (tui/cli/webui/serve/deploy) — so a
0.0.0.0 default put it on the network for users who never asked. Restore
127.0.0.1 as the default and make 0.0.0.0 an explicit opt-in.

webui_host keeps its 0.0.0.0 default: the front-end serves the app shell
only and holds no credentials. run_webui already prints a remote-backend
hint when the front-end is exposed and the backend is not.

Help text and both READMEs are reframed around widening rather than
narrowing; the escape-hatch tests are inverted to assert the public-bind
opt-in survives into argv.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-06 16:15:49 +08:00

334 lines
13 KiB
Python

"""``EvoSci deploy`` — start a standalone langgraph dev server.
Hosts the fully-equipped EvoScientist main agent (MCP + async sub-agents)
for consumption by external LangChain-compatible UIs (deep-agents-ui,
agent-chat-ui, LangSmith Studio) and SDK clients.
Differs from ``EvoSci`` / ``EvoSci serve``: no in-process CLI agent,
no session DB, no channel runtime, no TUI. The terminal only shows
startup progress, the Ready banner, and then blocks until Ctrl+C.
Mode dispatch happens via the ``EVOSCIENTIST_DEPLOY_MODE`` env var
injected by ``start_langgraph_dev``: ``full`` for the deploy subprocess
(this command), ``stripped`` for CLI/serve subprocesses, unset for the
parent process. The subprocess reads this at module-load time
(``langgraph_dev/manager.py``) to flip ``_ASYNC_SUBAGENTS_AVAILABLE``,
and the agent build code (``EvoScientist.py:_get_default_agent``)
loads or skips MCP based on the value.
"""
from __future__ import annotations
import atexit
import os
import signal
import threading
from pathlib import Path
from typing import Any
import typer # type: ignore[import-untyped]
from rich.panel import Panel
from rich.text import Text
from ..cli._app import app
from ..stream.console import console
@app.command()
def deploy(
workdir: str | None = typer.Option(
None,
"--workdir",
help="Workspace directory (default: config.default_workdir or cwd)",
),
port: int | None = typer.Option(
None,
"--port",
help="Port for langgraph dev (default: config.langgraph_dev_port = 6174)",
),
host: str | None = typer.Option(
None,
"--host",
help="Interface to bind (default: config.langgraph_dev_host = "
"127.0.0.1, i.e. this machine only — pass 0.0.0.0 to reach it from "
"other machines, but note the server has no auth)",
),
tunnel: bool = typer.Option(
False,
"--tunnel",
help="Expose the server over a public Cloudflare tunnel (no auth — "
"anyone with the URL can drive the agent; trusted use only)",
),
debug: bool = typer.Option(
False,
"--debug",
help="Enable debug logging",
),
):
"""Deploy EvoScientist main agent as a standalone LangGraph dev server.
Starts ``langgraph dev`` in deploy mode (full MCP + async sub-agents).
Connect any LangChain-compatible UI or SDK client to the printed
endpoint. Press Ctrl+C to stop.
"""
from ..config import apply_config_to_env, get_effective_config
from ..langgraph_dev.manager import (
_DEFAULT_HOST,
_DEFAULT_PORT,
RUNTIME,
_base_url,
_is_loopback_host,
_is_port_occupied,
is_langgraph_dev_running,
read_tunnel_url,
start_langgraph_dev,
stop_langgraph_dev,
)
# 1. Load config (no CLI overrides here — deploy is opinionated about
# full MCP + async; user-facing flags are workspace/port/debug only).
cli_overrides: dict[str, Any] = {}
if debug:
cli_overrides["log_level"] = "DEBUG"
config = get_effective_config(cli_overrides)
if debug:
os.environ["EVOSCIENTIST_LOG_LEVEL"] = "DEBUG"
from ..cli.commands import _configure_logging
_configure_logging()
apply_config_to_env(config)
# 2. Resolve workspace (CLI > config.default_workdir > cwd)
if workdir:
ws = os.path.abspath(os.path.expanduser(workdir))
elif config.default_workdir:
ws = os.path.abspath(os.path.expanduser(config.default_workdir))
else:
ws = os.getcwd()
# Subprocess inherits this path via EVOSCIENTIST_WORKSPACE_DIR (set inside
# start_langgraph_dev). Ensure the dir exists; do NOT mutate the parent
# process's paths module state — the deploy parent has no in-process agent.
os.makedirs(ws, exist_ok=True)
# 3. Resolve port (explicit None check — don't treat --port 0 as "unset"),
# then validate range so misconfigurations fail fast with a clear message
# instead of an opaque socket error from langgraph dev later.
effective_port = (
int(getattr(config, "langgraph_dev_port", _DEFAULT_PORT))
if port is None
else port
)
if not (1 <= effective_port <= 65535):
console.print(
f"[red]Invalid port {effective_port}. Use an integer in [1, 65535].[/red]"
)
raise typer.Exit(1)
# Same explicit-None resolution for the bind interface. Both branches strip
# (matching run_webui): whitespace reaching socket.bind() surfaces as an
# opaque gaierror, and an all-whitespace value collapses to the default
# rather than erroring. The config branch needs it too even though
# ``EvoScientistConfig.__post_init__`` normalizes these fields — this
# function reads via ``getattr`` and is routinely handed duck-typed config
# objects, which never run that normalization.
effective_host = (
str(
getattr(config, "langgraph_dev_host", _DEFAULT_HOST) or _DEFAULT_HOST
).strip()
if host is None
else host.strip()
) or _DEFAULT_HOST
# 4. Pre-flight port check — refuse to start if a non-EvoSci process is
# holding the port. If an existing EvoSci langgraph dev is already up,
# also refuse (deploy is the "primary server" — running multiple on the
# same port is a configuration error).
if _is_port_occupied(effective_port, effective_host):
if is_langgraph_dev_running(port=effective_port, host=effective_host):
console.print(
f"[red]Port {effective_port} is already serving a langgraph dev "
f"instance.[/red]"
)
console.print(
"[dim]Stop the existing EvoSci/serve session first, or use "
"[bold]--port[/bold] to deploy on a different port.[/dim]"
)
else:
console.print(
f"[red]Port {effective_port} is occupied by another process.[/red]"
)
console.print(
f"[dim]Run [bold]lsof -i :{effective_port}[/bold] to inspect, "
f"or use [bold]--port[/bold] to pick a different port.[/dim]"
)
raise typer.Exit(1)
# 5. Startup banner
_auth_label = _describe_auth(config)
console.print(
Panel(
Text.from_markup(
f"[bold]Workspace:[/bold] {_shorten(ws)}\n"
f"[bold]Host:[/bold] {effective_host}\n"
f"[bold]Port:[/bold] {effective_port}\n"
f"[bold]Auth:[/bold] {_auth_label}"
),
title="[bold cyan]EvoScientist Deploy[/bold cyan]",
border_style="cyan",
)
)
if config.dangerous_mode:
from ..cli._constants import (
DANGEROUS_BANNER_LABEL,
DANGEROUS_BANNER_MESSAGE,
)
console.print(
f"[bold white on red] ⚠ {DANGEROUS_BANNER_LABEL} [/bold white on red] "
f"[bold red]{DANGEROUS_BANNER_MESSAGE}[/bold red]"
)
if not _is_loopback_host(effective_host):
console.print(
"[bold white on red] ⚠ PUBLIC BIND [/bold white on red] "
f"[bold red]Listening on {effective_host} — no auth, and the agent "
f"can run shell. Trusted networks only.[/bold red]"
)
if tunnel:
console.print(
"[bold white on red] ⚠ PUBLIC TUNNEL [/bold white on red] "
"[bold red]Public URL, no auth — share only with people you "
"trust.[/bold red]"
)
# 6. ccproxy lifecycle (only if any provider uses OAuth)
_ccproxy_proc = None
if config.anthropic_auth_mode == "oauth" or config.openai_auth_mode == "oauth":
try:
from ..ccproxy_manager import maybe_start_ccproxy, stop_ccproxy
with console.status(
"[dim]Starting ccproxy (OAuth proxy)...[/dim]", spinner="dots"
):
_ccproxy_proc = maybe_start_ccproxy(config)
if _ccproxy_proc:
atexit.register(stop_ccproxy, _ccproxy_proc)
console.print("[green]✓[/green] ccproxy started")
except RuntimeError as exc:
console.print(f"[red]ccproxy startup failed:[/red] {exc}")
raise typer.Exit(1) from exc
# 7. Start langgraph dev (deploy mode → full MCP + async)
jobs_per_worker = int(getattr(config, "langgraph_dev_jobs_per_worker", 10))
file_persistence = bool(getattr(config, "langgraph_dev_file_persistence", True))
try:
with console.status(
"[dim]Starting langgraph dev (deploy mode: MCP + async)...[/dim]",
spinner="dots",
):
proc = start_langgraph_dev(
workspace_dir=Path(ws),
port=effective_port,
host=effective_host,
file_persistence=file_persistence,
jobs_per_worker=jobs_per_worker,
deploy_mode=True,
tunnel=tunnel,
)
atexit.register(stop_langgraph_dev, proc)
except Exception as exc:
console.print(f"[red]langgraph dev startup failed:[/red] {exc}")
raise typer.Exit(1) from exc
# start_langgraph_dev already health-polled before returning; if we got
# here, the subprocess is up.
console.print("[green]✓[/green] langgraph dev ready")
# 8b. Cloudflare tunnel URL — the local server is healthy, but cloudflared
# establishes the public tunnel a few seconds later and prints the random
# URL into the log. Poll for it so we can surface it in the ready banner.
public_url: str | None = None
if tunnel:
with console.status(
"[dim]Waiting for Cloudflare tunnel URL...[/dim]", spinner="dots"
):
public_url = read_tunnel_url()
if public_url:
console.print("[green]✓[/green] tunnel up")
else:
console.print(
"[yellow]⚠ Tunnel URL not detected within the wait window. "
f"Check the log ({_shorten(str(RUNTIME.log_file))}) for a "
"trycloudflare.com URL.[/yellow]"
)
# 9. Ready banner
log_hint = _shorten(str(RUNTIME.log_file))
public_line = f"[bold]Public URL:[/bold] {public_url}\n" if public_url else ""
console.print(
Panel(
Text.from_markup(
f"[bold]Endpoint:[/bold] "
f"{_base_url(effective_port, effective_host)}\n"
f"{public_line}"
f"[bold]Assistant ID:[/bold] EvoScientist\n"
f"[bold]Connect via:[/bold] any LangChain SDK / "
f"LangGraph-compatible UI\n"
f"[bold]Logs:[/bold] {log_hint}\n\n"
f"[dim]Press Ctrl+C to stop.[/dim]"
),
title="[bold green]✓ Ready[/bold green]",
border_style="green",
)
)
# 10. Block on signal — mirror serve's dual-gate (threading.Event +
# explicit SIGINT/SIGTERM handlers) so SIGTERM (no default raise) also
# triggers clean shutdown.
shutdown_event = threading.Event()
def _handle_shutdown(signum: int, _frame: Any) -> None:
shutdown_event.set()
if signum == signal.SIGINT:
signal.default_int_handler(signum, _frame)
_orig_sigint = signal.signal(signal.SIGINT, _handle_shutdown)
_orig_sigterm = signal.signal(signal.SIGTERM, _handle_shutdown)
try:
while not shutdown_event.is_set():
shutdown_event.wait(timeout=0.5)
except KeyboardInterrupt:
shutdown_event.set()
finally:
signal.signal(signal.SIGINT, _orig_sigint)
signal.signal(signal.SIGTERM, _orig_sigterm)
# stop_langgraph_dev + stop_ccproxy run via atexit during interpreter
# shutdown, so subprocess teardown happens AFTER this print returns.
# Don't claim "Stopped." here — that would be a lie until atexit fires.
console.print(
"\n[dim]Shutting down (background cleanup may take a few seconds)...[/dim]"
)
def _describe_auth(config: Any) -> str:
"""Render a one-line auth summary for the startup banner."""
anth = getattr(config, "anthropic_auth_mode", "api_key")
oai = getattr(config, "openai_auth_mode", "api_key")
if anth == "oauth" and oai == "oauth":
return "OAuth (Anthropic + OpenAI via ccproxy)"
if anth == "oauth":
return "OAuth (Anthropic via ccproxy) + API key (OpenAI)"
if oai == "oauth":
return "API key (Anthropic) + OAuth (OpenAI via ccproxy)"
return "API key"
def _shorten(path: str) -> str:
"""Replace ``$HOME`` prefix with ``~`` for compact display."""
home = os.path.expanduser("~")
if path.startswith(home):
return "~" + path[len(home) :]
return path