module LLM::Adapter

Overview

A normalized adapter interface for LLM clients.

Implementations should return a String response (JSON text after any provider-specific cleanup).

Direct including types

• LLM::GeneralAdapter
• LLM::OllamaAdapter

Defined in:

llm/adapter.cr

Instance Method Summary

• #request(prompt : String, format : String = "json") : String

  Send a single prompt and get a response as a String.

• #request_messages(messages : Messages, format : String = "json") : String

  Send chat-style messages (system/user) and get a response as a String.

• #request_with_context(system : String | Nil, user : String, format : String = "json", cache_key : String | Nil = nil) : String

  Context-aware request.

• #supports_context? : Bool

  Whether this adapter supports server-side KV context reuse across calls.

Instance Method Detail