Skip to main content

opendevin.llm.llm

LLM Objects​

class LLM()

The LLM class represents a Language Model instance.

__init__​

def __init__(model=DEFAULT_MODEL_NAME,
             api_key=DEFAULT_API_KEY,
             base_url=DEFAULT_BASE_URL,
             api_version=DEFAULT_API_VERSION,
             num_retries=LLM_NUM_RETRIES,
             retry_min_wait=LLM_RETRY_MIN_WAIT,
             retry_max_wait=LLM_RETRY_MAX_WAIT,
             llm_timeout=LLM_TIMEOUT,
             llm_max_return_tokens=LLM_MAX_RETURN_TOKENS)

Arguments:

  • model str, optional - The name of the language model. Defaults to LLM_MODEL.
  • api_key str, optional - The API key for accessing the language model. Defaults to LLM_API_KEY.
  • base_url str, optional - The base URL for the language model API. Defaults to LLM_BASE_URL. Not necessary for OpenAI.
  • api_version str, optional - The version of the API to use. Defaults to LLM_API_VERSION. Not necessary for OpenAI.
  • num_retries int, optional - The number of retries for API calls. Defaults to LLM_NUM_RETRIES.
  • retry_min_wait int, optional - The minimum time to wait between retries in seconds. Defaults to LLM_RETRY_MIN_TIME.
  • retry_max_wait int, optional - The maximum time to wait between retries in seconds. Defaults to LLM_RETRY_MAX_TIME.
  • llm_timeout int, optional - The maximum time to wait for a response in seconds. Defaults to LLM_TIMEOUT.
  • llm_max_return_tokens int, optional - The maximum number of tokens to return. Defaults to LLM_MAX_RETURN_TOKENS.

Attributes:

  • model_name str - The name of the language model.
  • api_key str - The API key for accessing the language model.
  • base_url str - The base URL for the language model API.
  • api_version str - The version of the API to use.

completion​

@property
def completion()

Decorator for the litellm completion function.