Skip to main content

Use a language model

Put a language model behind a route with the model's key on the gateway, a token budget, a prompt guard and a cache. Each guide does one job, in the order the console does it, and ends with a request you send and the answer to expect.

Read in this order​

  1. Put a language model behind the gateway. Send your apps' chat requests to one language model through a route, with the model's key on the gateway, a token budget, a prompt guard and a cache.
G8 dev