Ask a question to get started
Enter to send•Shift+Enter new line
LlamaEdgeChatService()
BaseChatModel
request timeout for chat http requests
URL of WasmChat service
model name, default is NA.
NA
Whether to stream the results or not.
Build extra kwargs from additional params that were passed in.
Chat with LLMs via llama-api-server
llama-api-server
For the information about llama-api-server, visit https://github.com/second-state/LlamaEdge
