lepetitprince716-prog
7e439dbb1b
perf: parallelize provider model-list fetches in model picker
...
When the 1h provider_models_cache.json TTL lapses, the model picker
serially fetches /v1/models for each authenticated provider. With 10+
providers this stacks to 15-30s of blocking before the picker renders.
Add a parallel prefetch step before the serial picker build loops:
- _collect_authed_provider_slugs(): lightweight credential pre-scan
that mirrors sections 1/2/2b without fetching model lists
- _prefetch_provider_models_parallel(): ThreadPoolExecutor-based
concurrent fetch of stale/missing cache entries (max 8 workers)
- update_provider_cache_entry(): thread-safe single-entry cache writer
with threading.Lock to prevent concurrent write races
Guardrails:
- Skipped when <=3 authed providers (overhead not worth it)
- Skipped when refresh=True (serial path force-refreshes)
- Exception-isolated (falls back to serial path on any failure)
- No behavioral change (same model lists, same picker output)
Closes #80413
(cherry picked from commit 89dddd6cb5d53d73278e0518c375fb5b878e5c6b)
2026-08-15 00:34:29 -07:00
..
2026-08-12 16:25:29 -07:00
2026-08-14 01:31:21 -07:00
2026-08-15 00:33:01 -07:00
2026-08-14 16:43:37 -07:00
2026-08-10 11:07:22 -07:00
2026-08-08 23:56:46 -07:00
2026-08-14 16:36:39 -07:00
2026-08-12 16:26:55 -07:00
2026-08-07 08:57:39 -07:00
2026-08-12 23:47:38 -07:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-08 12:32:23 -07:00
2026-08-11 23:36:47 -05:00
2026-08-14 21:47:23 -07:00
2026-08-14 13:46:33 -07:00
2026-08-10 10:40:19 -07:00
2026-08-14 22:04:16 -07:00
2026-08-08 16:07:03 -04:00
2026-08-09 22:09:49 -04:00
2026-08-14 01:31:21 -07:00
2026-08-14 01:31:31 -07:00
2026-08-09 22:09:49 -04:00
2026-08-14 22:27:37 -07:00
2026-08-12 16:42:07 -07:00
2026-08-14 00:26:11 -07:00
2026-08-15 00:33:32 -07:00
2026-08-07 17:45:06 +05:30
2026-08-14 20:46:50 -07:00
2026-08-12 23:47:22 -07:00
2026-08-15 00:32:53 -07:00
2026-08-14 21:55:14 -07:00
2026-08-14 00:59:38 +05:30
2026-08-10 18:04:59 -07:00
2026-08-14 21:39:01 +00:00
2026-08-14 21:56:33 -07:00
2026-08-13 02:38:28 -07:00
2026-08-09 22:09:49 -04:00
2026-08-08 14:56:38 +05:30
2026-08-13 02:38:28 -07:00
2026-08-13 02:38:28 -07:00
2026-08-14 22:03:56 -07:00
2026-08-12 16:59:37 -07:00
2026-08-09 22:09:49 -04:00
2026-08-08 12:32:23 -07:00
2026-08-07 20:56:29 +00:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-09 21:40:23 +05:30
2026-08-10 17:02:56 -07:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-15 12:04:29 +05:30
2026-08-08 12:34:46 -07:00
2026-08-09 22:09:49 -04:00
2026-08-12 17:19:12 -07:00
2026-08-05 11:47:05 -04:00
2026-08-05 22:32:55 -07:00
2026-08-13 23:41:49 -07:00
2026-08-09 22:09:49 -04:00
2026-08-12 13:20:38 +05:30
2026-08-14 22:25:23 -07:00
2026-08-12 19:43:22 -07:00
2026-08-09 22:09:49 -04:00
2026-08-13 09:35:52 -07:00
2026-08-13 12:21:04 -07:00
2026-08-10 12:43:46 -07:00
2026-08-10 12:43:46 -07:00
2026-08-10 12:43:46 -07:00
2026-08-10 12:43:46 -07:00
2026-08-10 12:43:46 -07:00
2026-08-13 09:35:52 -07:00
2026-08-13 09:35:52 -07:00
2026-08-14 22:33:44 -07:00
2026-08-09 22:09:49 -04:00
2026-08-14 13:40:19 -07:00
2026-08-15 10:29:05 +05:30
2026-08-14 22:37:46 -07:00
2026-08-08 03:57:00 -07:00
2026-08-07 09:44:21 -07:00
2026-08-09 22:09:49 -04:00
2026-08-13 23:15:25 +05:30
2026-08-06 05:00:17 +05:30
2026-08-15 00:34:29 -07:00
2026-08-07 23:00:28 +05:30
2026-08-14 02:03:38 -07:00
2026-08-14 01:06:13 -07:00
2026-08-08 19:17:05 -07:00
2026-08-14 01:31:26 -07:00
2026-08-14 01:31:21 -07:00
2026-08-08 16:07:03 -04:00
2026-08-08 14:47:11 +05:30
2026-08-07 19:47:40 +05:30
2026-08-13 02:38:28 -07:00
2026-08-14 21:35:30 -07:00
2026-08-08 18:35:31 -07:00
2026-08-08 12:31:19 -07:00
2026-08-12 19:44:32 -07:00
2026-08-10 17:02:56 -07:00
2026-08-09 10:33:58 -07:00
2026-08-15 00:32:44 -07:00
2026-08-07 21:02:40 +05:30
2026-08-12 20:10:51 -07:00
2026-08-12 16:25:29 -07:00
2026-08-12 19:16:59 -07:00
2026-08-13 13:38:58 -07:00
2026-08-13 11:49:14 -07:00
2026-08-12 16:26:43 -07:00
2026-08-12 16:27:07 -07:00
2026-08-12 18:57:51 -07:00
2026-08-12 18:52:08 -07:00
2026-08-12 16:27:30 -07:00
2026-08-12 18:39:22 -07:00
2026-08-12 18:25:33 -07:00
2026-08-12 19:13:32 -07:00
2026-08-12 19:56:44 -07:00
2026-08-12 16:34:58 -07:00
2026-08-13 13:38:58 -07:00
2026-08-12 19:44:50 -07:00
2026-08-13 11:49:14 -07:00
2026-08-12 19:16:59 -07:00
2026-08-06 05:00:17 +05:30
2026-08-10 16:21:17 -05:00
2026-08-15 00:32:53 -07:00
2026-08-10 03:13:08 -05:00
2026-08-10 22:48:24 -07:00
2026-08-15 00:33:11 -07:00
2026-08-09 22:09:49 -04:00
2026-08-14 22:11:30 -07:00
2026-08-08 14:01:57 -05:00
2026-08-08 04:03:41 -07:00
2026-08-09 04:33:58 -05:00
2026-08-14 21:58:09 -07:00
2026-08-12 16:25:10 -07:00
2026-08-08 12:32:23 -07:00
2026-08-10 19:16:59 -07:00
2026-08-14 21:07:21 -07:00
2026-08-15 00:33:11 -07:00
2026-08-13 11:49:24 -07:00
2026-08-08 15:10:35 +05:30
2026-08-10 18:04:59 -07:00
2026-08-14 22:11:30 -07:00
2026-08-14 21:56:33 -07:00
2026-08-14 21:56:33 -07:00
2026-08-06 05:00:17 +05:30
2026-08-14 13:36:42 -07:00
2026-08-14 13:09:44 -07:00
2026-08-08 21:18:09 -07:00
2026-08-14 22:03:56 -07:00
2026-08-13 18:42:42 +00:00
2026-08-09 22:09:49 -04:00
2026-08-14 22:03:56 -07:00
2026-08-05 10:34:18 -06:00
2026-08-14 22:03:56 -07:00
2026-08-14 22:03:56 -07:00
2026-08-08 20:01:03 -07:00
2026-08-14 22:03:56 -07:00
2026-08-14 21:46:32 -07:00
2026-08-08 19:46:35 -07:00
2026-08-09 23:19:39 -07:00
2026-08-14 16:43:37 -07:00
2026-08-07 21:02:40 +05:30
2026-08-09 22:09:49 -04:00
2026-08-08 22:54:20 +05:30
2026-08-06 05:00:17 +05:30
2026-08-13 02:44:48 -07:00
2026-08-08 13:28:28 +05:30
2026-08-14 20:46:50 -07:00
2026-08-12 23:47:22 -07:00
2026-08-15 00:32:53 -07:00
2026-08-14 21:36:29 -07:00
2026-08-13 02:38:28 -07:00
2026-08-09 22:09:49 -04:00
2026-08-12 02:56:33 -07:00
2026-08-13 22:09:50 -07:00