Anthropic / Chat

A maximum number of tokens to generate before stopping.

string

Select the model to use for your query. Defaults to the `claude-3-opus-20240229` model, which Anthropic describes as the "Most powerful model for highly complex tasks".

string

The user messages provide instructions to the assistant

string

All relevant information must be supplied via the conversation. You can provide an array of messages from prior conversations here always beginning with the human message.

string | undefined

**Optional**. Amount of randomness injected into the response. Ranges from 0 to 1. Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks.

string | undefined

Only sample from the top K options for each subsequent token. Used to remove `long tail` low probability responses.

string | undefined

Does nucleus sampling, in which we compute the cumulative distribution over all the options for each subsequent token in decreasing probability order and cut it off once it reaches a particular probability specified.

string | undefined