Connecting to Other Models

Connect to other models where you have accounts

You need to have your own paid account with the LLM service/model provider.

To access the Models page, click on the Models link in the left navigation of the Extension Settings. Or click here.

The model is the LLM service that Steve uses to help you accomplish all your tasks. By default Ask Steve uses Google's Gemini 1.5 Flash model.
All models have different characteristics and are better or worse at various tasks.
Generally the better the model, the slower it and more expensive it is.
When you use the free Gemini 1.5 Flash model, Google reserves the right to use your data for training purposes and to make their products better. If your data is sensitive or you are concerned about privacy, you should create a paid account at a provider that doesn't use your data and connect to it.
Switching out Steve's model is like switching out his brain.

The QuickStart plan uses Google's Gemini 1.5 Flash model.
When you are on the QuickStart plan, your requests are sent to the Ask Steve server, which sends them along to Google, and then sends the results back. Your requests go through our server, but we never save anything.

To add a new model, press the ADD NEW MODEL button. A dialog will open with a number of model templates that you can select from, and a place for you to enter your API Key for that model if you have it already. Press OK and the interface will be filled in with the template details.
Edit any of the details that you need to
To test the model, scroll down to the Test Your Connection area and press the TEST button. A sample query will be sent and the response shown below.
Once you are satisfied that everything is working correctly, press the SAVE NEW MODEL button. Steve will switch to using this new model, as indicated in the dropdown list at the top of the page.

All requests are made via POST. The data fields for a model are as follows:

Name: So that you know what model this is. This is shown to users in error messages.
URL: The URL endpoint for this model
Context Window: The size of the context window for this model.
Header: The JSON header that is sent in the POST request. This should be formatted according to the service provider's documentation. This typically includes the API Key or other authentication for the service.
Body: The JSON body that is sent with the POST request. This should be formatted according to the service provider's documentation.
Response Path: In bracket notation, the path to the field in the response object that contains the actual response. This will be in the service provider's documentation. Note that one-shot responses and streaming responses usually have different paths, even from the same service provider.
Error Path: In bracket notation, the path to the field in the response object that contains any error messages. This will be in the service provider's documentation.
This is a Streaming API: If you are calling a streaming API, this needs to be checked, as streaming responses are parsed differently than non-streaming responses.

Select the model that you want to edit from the Steve is using: dropdown.
Make your edits
Press the UPDATE button

NOTE: This also changes the current model. Change it back when you're done editing via the Steve is using: dropdown.

Select the model that you want to change to from the Steve is using: dropdown.
This is automatically saved, so now Steve will use this model.

The temperature setting of a model usually ranges from 0.0 to 1.0 or 2.0, where 0 tells the model to provide more factual answers, and the upper limit tells the model to provide more creative responses. The value can be set to a value somewhere in that range (e.g. 0.3)
The default model and all our templates use a temperature of 0, as most use cases will benefit from more factual responses.
When adding a new model, you can set its temperature to something else, depending on how you're going to use it.
You can even add the same model multiple times, each with a different temperature, and then assign Skills that need more creativity to higher temperature models.