zed/crates/language_model
Max Brunsfeld 8e9c2b1125
Introduce a separate backend service for LLM calls (#15831)
This PR introduces a separate backend service for making LLM calls.

It exposes an HTTP interface that can be called by Zed clients. To call
these endpoints, the client must provide a `Bearer` token. These tokens
are issued/refreshed by the collab service over RPC.

We're adding this in a backwards-compatible way. Right now the access
tokens can only be minted for Zed staff, and calling this separate LLM
service is behind the `llm-service` feature flag (which is not
automatically enabled for Zed staff).

Release Notes:

- N/A

---------

Co-authored-by: Marshall <marshall@zed.dev>
Co-authored-by: Marshall Bowers <elliott.codes@gmail.com>
2024-08-05 20:26:21 -04:00
..
src Introduce a separate backend service for LLM calls (#15831) 2024-08-05 20:26:21 -04:00
Cargo.toml Restructure workflow step resolution and fix inserting newlines (#15720) 2024-08-05 09:18:06 +02:00
LICENSE-GPL Extract completion provider crate (#14823) 2024-07-19 13:35:34 -04:00