emozilla
43e67d872f
feat: local models — managed llama.cpp runtime with one-click desktop setup
...
Run models locally as a first-class provider. The CLI grows a managed
llama.cpp runtime (engine install, model download, server supervision);
the desktop app grows the full setup and management story on top of it.
GUI surfaces ship behind the desktop --local launch flag (hermes desktop
--local, or the flag on the packaged app); backend routes and the CLI
are always live.
Runtime (hermes_cli/local_runtime/):
- curated GGUF catalog with per-machine variant selection: hardware
probe (VRAM/RAM/UMA), fit planning with spill accounting, quant choice
by context window
- derived recommendation: quality-ranked picks gated by a predicted
decode-speed floor, bandwidth-aware on unified memory; the decision
table is pinned as a test (pick AND reason per memory class), and the
Recommended badge explains its pick in a tooltip fed by the resolver's
actual branch
- engine install + model download with resumable split parts, cumulative
plan-level progress, and staged-model integrity (a split GGUF counts
only when every part is present)
- server supervision: spawn/adopt/stop, router mode with per-model load
progress relayed over SSE, abandoned-request cleanup
Desktop:
- Settings -> Providers -> Local models: one-click quickstart (install
engine, download the recommended model, boot) plus per-model download/
activate/eject, fit-ranked catalog with context pills
- model pickers (composer dropdown + Cmd+K) show staged local models,
in-flight downloads as live progress rows, and load-into-memory bars
- local-setup campaign tip for eligible hardware; System resources
statusbar widget (GPU/VRAM/RAM); in-chat load progress during sends
- friendly dead-server errors, and failed agent builds retry on the next
send instead of wedging the session
Co-developed with NVIDIA field feedback on RTX 5090 and DGX Spark.
2026-09-01 16:01:53 -04:00
..
2026-08-31 19:36:03 -05:00
2026-08-31 19:20:32 -05:00
2026-08-20 13:13:15 +00:00
2026-09-01 00:30:56 -07:00
2026-09-01 16:01:53 -04:00
2026-08-27 21:50:18 -05:00
2026-07-26 19:29:25 -07:00
2026-07-26 19:29:25 -07:00
2026-08-19 10:50:52 -05:00
2026-07-27 21:23:46 -05:00
2026-07-28 03:43:07 +00:00
2026-08-19 10:51:12 -05:00
2026-08-17 12:12:24 -07:00
2026-08-27 23:23:47 -05:00
2026-08-29 11:33:05 +05:30
2026-08-22 17:34:58 +00:00
2026-08-22 10:30:31 -07:00
2026-08-31 20:43:36 -05:00
2026-08-31 20:43:36 -05:00
2026-08-19 10:50:52 -05:00
2026-07-15 07:39:42 -07:00
2026-07-16 01:42:02 +05:30
2026-08-19 05:11:57 +00:00
2026-08-18 22:03:25 -07:00
2026-08-26 00:22:27 -07:00
2026-08-26 07:45:59 +00:00
2026-08-18 14:45:23 -07:00
2026-08-18 14:45:23 -07:00
2026-08-24 03:19:47 -07:00
2026-08-24 03:19:47 -07:00
2026-08-23 23:33:06 -07:00
2026-08-23 23:33:06 -07:00
2026-07-24 18:14:17 +00:00
2026-07-24 12:55:06 -05:00
2026-08-31 20:50:10 -05:00
2026-08-31 20:50:10 -05:00
2026-08-01 02:32:28 -05:00
2026-08-01 02:32:28 -05:00
2026-07-26 19:29:25 -07:00
2026-08-09 09:51:41 +00:00
2026-07-15 03:13:33 -04:00
2026-08-03 18:37:31 +05:30
2026-08-03 18:37:31 +05:30
2026-08-21 15:24:03 -07:00
2026-08-21 15:24:03 -07:00
2026-08-29 00:51:43 -05:00
2026-08-29 05:56:24 +00:00
2026-08-18 20:40:02 +00:00
2026-08-15 09:33:47 +00:00
2026-08-15 09:33:47 +00:00
2026-07-26 17:48:05 -07:00
2026-08-14 20:40:24 -07:00
2026-08-14 20:40:24 -07:00
2026-08-26 21:38:00 -07:00
2026-08-26 21:38:00 -07:00
2026-08-19 10:50:52 -05:00
2026-07-20 20:54:36 -04:00
2026-08-26 21:38:41 -07:00
2026-08-10 04:52:19 -05:00
2026-08-18 14:26:28 -07:00
2026-08-18 21:38:17 +00:00
2026-09-01 16:01:53 -04:00
2026-08-15 01:03:57 -07:00
2026-08-15 01:03:57 -07:00
2026-07-26 02:56:08 -05:00
2026-08-24 00:04:10 +05:30
2026-08-24 00:07:19 +05:30
2026-08-14 21:10:13 -07:00
2026-08-14 21:10:13 -07:00
2026-07-28 02:27:11 -05:00
2026-07-28 02:27:11 -05:00
2026-08-24 04:01:53 -07:00
2026-08-25 22:51:31 -07:00
2026-08-16 09:32:26 +00:00
2026-08-27 21:46:40 -05:00
2026-08-19 10:50:52 -05:00
2026-08-27 02:17:56 -07:00
2026-08-27 02:17:56 -07:00
2026-08-05 10:26:48 -06:00
2026-08-05 10:26:48 -06:00
2026-08-27 21:46:40 -05:00
2026-08-27 21:46:40 -05:00
2026-07-18 18:53:41 -04:00
2026-07-26 17:02:59 -05:00
2026-08-13 03:33:45 +00:00
2026-08-12 11:08:55 -07:00
2026-08-13 13:36:54 -05:00
2026-08-13 13:36:54 -05:00
2026-08-18 20:40:02 +00:00
2026-08-18 14:19:39 -07:00
2026-08-19 23:10:25 -05:00
2026-08-20 14:07:53 -05:00
2026-08-16 02:24:32 -07:00
2026-08-16 02:24:32 -07:00
2026-07-17 14:30:29 +00:00
2026-08-13 01:06:51 -05:00
2026-08-16 02:25:14 -07:00
2026-08-16 09:32:26 +00:00
2026-08-15 02:03:24 -07:00
2026-08-16 17:16:57 +00:00
2026-08-19 10:50:52 -05:00
2026-08-16 02:36:54 -07:00
2026-08-16 02:36:54 -07:00
2026-08-28 06:33:40 -07:00
2026-08-28 06:33:40 -07:00
2026-08-23 21:59:22 -07:00
2026-08-23 21:59:22 -07:00
2026-07-30 21:43:14 -05:00
2026-08-01 02:15:02 -05:00
2026-09-01 02:09:50 +00:00
2026-08-31 20:40:09 -05:00
2026-09-01 02:09:50 +00:00
2026-09-01 02:09:50 +00:00
2026-08-21 14:38:19 -07:00
2026-09-01 16:01:53 -04:00
2026-09-01 16:01:53 -04:00
2026-08-08 14:50:43 -05:00
2026-08-08 14:50:43 -05:00
2026-08-15 01:21:40 -07:00
2026-08-15 01:21:40 -07:00
2026-08-09 10:33:58 -07:00
2026-08-24 06:48:10 -05:00
2026-08-18 14:45:23 -07:00
2026-08-18 14:45:23 -07:00
2026-08-19 10:50:52 -05:00
2026-08-18 08:52:36 -05:00
2026-08-18 08:52:36 -05:00
2026-07-23 00:18:21 -05:00
2026-07-23 00:18:21 -05:00
2026-07-18 19:15:57 -04:00
2026-07-18 19:15:57 -04:00
2026-07-19 22:38:57 -05:00
2026-08-06 22:02:46 -05:00
2026-08-06 22:02:46 -05:00
2026-07-25 20:51:18 -05:00
2026-07-25 20:51:18 -05:00
2026-08-03 18:10:30 +05:30
2026-08-03 18:10:30 +05:30
2026-07-31 22:28:43 -07:00
2026-07-31 22:28:43 -07:00
2026-08-07 02:42:42 +00:00
2026-08-06 21:20:41 -05:00
2026-08-15 03:31:07 +00:00
2026-08-14 20:23:07 -07:00
2026-08-23 18:43:12 -07:00
2026-08-23 18:43:12 -07:00
2026-08-22 03:38:21 +00:00
2026-08-22 03:38:21 +00:00
2026-08-19 10:51:12 -05:00
2026-07-27 07:00:22 +00:00
2026-09-01 02:09:50 +00:00
2026-09-01 02:09:50 +00:00
2026-08-08 13:36:08 +05:30
2026-08-19 08:01:29 -04:00
2026-07-24 22:52:45 -05:00
2026-08-27 02:17:56 -07:00
2026-08-12 22:24:37 -05:00
2026-07-24 23:30:25 -05:00
2026-07-24 23:30:25 -05:00
2026-07-15 15:37:12 -04:00
2026-07-15 15:37:12 -04:00
2026-08-14 20:24:51 -07:00
2026-08-14 20:24:51 -07:00
2026-07-29 01:49:23 +00:00
2026-07-31 13:53:04 -05:00
2026-07-30 04:52:06 -05:00
2026-07-28 21:55:38 +00:00
2026-07-28 11:58:03 -07:00
2026-08-19 02:56:55 -05:00
2026-08-19 02:56:55 -05:00
2026-08-08 16:26:48 -05:00
2026-08-15 00:32:53 -07:00
2026-08-16 23:43:53 +00:00
2026-08-20 05:49:39 +00:00
2026-08-20 00:31:43 -05:00
2026-08-19 10:50:52 -05:00
2026-07-29 08:24:00 -07:00
2026-08-19 10:50:52 -05:00
2026-08-08 20:29:52 +00:00
2026-07-24 16:36:59 +00:00
2026-08-30 01:45:35 +00:00
2026-08-30 01:45:35 +00:00
2026-08-13 01:06:51 -05:00
2026-08-15 01:04:19 -07:00
2026-08-17 15:12:53 -05:00
2026-08-17 15:12:53 -05:00
2026-07-27 19:54:47 -05:00
2026-07-27 19:54:47 -05:00
2026-08-27 23:23:43 -05:00
2026-08-27 23:23:43 -05:00
2026-08-14 13:09:44 -07:00
2026-08-14 13:09:44 -07:00
2026-07-29 12:52:42 -07:00
2026-08-27 16:29:27 +00:00
2026-08-27 11:23:40 -05:00
2026-08-26 21:38:00 -07:00
2026-08-27 04:43:58 +00:00
2026-07-29 00:01:06 -07:00
2026-07-29 00:01:06 -07:00
2026-08-05 16:51:56 +00:00
2026-08-01 14:30:11 -07:00
2026-08-01 14:30:11 -07:00
2026-07-29 01:49:23 +00:00
2026-08-19 10:50:52 -05:00
2026-08-25 22:51:31 -07:00
2026-08-26 21:38:00 -07:00
2026-07-30 02:41:34 -05:00