Skip to content

Function: listServingEndpoints()

listServingEndpoints(client, host, options?): Promise<object[]>

List Model Serving endpoints for the workspace owning client, routed through AppKit’s CacheManager. The manager gives us everything cachetools.TTLCache provides plus what cachetools-async adds on top: per-entry TTL, in-flight request coalescing (concurrent callers share one fetch via the manager’s internal inFlightRequests map), bounded size, telemetry spans (cache.getOrExecute), and optional Lakebase persistence so the catalogue survives restarts when the lakebase plugin is wired up.

Returns plain ServingEndpointSummary objects (a stable subset of the SDK type) so cache hits never expose stale SDK internals. Errors from CacheManager or the SDK fetch propagate to the caller - we don’t swallow them so users see the real auth / network issue.

WorkspaceClientLike

string

Workspace host used as the cache key. Pass the value resolved from client.config.getHost() so multi-host apps share one entry per workspace.

ListServingEndpointsOptions = {}

Promise<object[]>