Use a language model
Put a language model behind a route with the model's key on the gateway, a token budget, a prompt guard and a cache. Each guide does one job, in the order the console does it, and ends with a request you send and the answer to expect.
Read in this order
- Put a language model behind the gateway. Send your apps' chat requests to one language model through a route, with the model's key on the gateway, a token budget, a prompt guard and a cache.
G8 dev