Overridable Anthropic ClientOptions
Model name to use
Optional anthropicAnthropic API key
Optional anthropicAnthropic API URL
Optional invocationHolds any additional parameters that are valid to pass to anthropic.complete that are not explicitly specified on this class.
Optional maxA maximum number of tokens to generate before stopping.
Optional maxA maximum number of tokens to generate before stopping.
Use "maxTokens" instead.
Optional stopA list of strings upon which to stop generating.
You probably want ["\n\nHuman:"], as that's the cue for
the next turn in the dialog agent.
Optional streamingWhether to stream the results or not
Optional temperatureAmount of randomness injected into the response. Ranges from 0 to 1. Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks.
Optional topKOnly sample from the top K options for each subsequent token. Used to remove "long tail" low probability responses. Defaults to -1, which disables it.
Optional topPDoes nucleus sampling, in which we compute the cumulative distribution over all the options for each subsequent token in decreasing probability order and cut it off once it reaches a particular probability specified by top_p. Defaults to -1, which disables it. Note that you should either alter temperature or top_p, but not both.
Generated using TypeDoc
Input to AnthropicChat class.