Local LLM

Following configurations are required to interact with a Local LLM:

  • local.llm.temperature.default=2.0 : Temperature for the model
  • local.llm.frequency_penalty.default=2.0 : Frequency Penalty for the model
  • local.llm.presence_penalty.default=2.0 : Presence Penalty for the model
  • local.llm.max_tokens.default=256 : Max Tokens for the model
  • local.llm.top_p.default=2.0 : Top P for the model