module LLM::Cache

Defined in:

llm/cache.cr

Constant Summary

CACHE_FILE_SUFFIX = ".json"

All cache entries are stored as <sha256>.json flat in .cache_dir. The bulk operations below (.clear, .purge_older_than, .stats) filter on this suffix so a stray .lock or user-dropped file in the directory is left alone.

CACHE_TMP_MARKER = ".tmp-"

Infix .store stamps onto its in-flight temp file (see .store). Kept as a constant so the writer and the sweepers below can't drift apart: a stranded temp file whose name the sweepers don't recognize is a file nothing can ever delete.

Class Method Summary

• .cache_dir : String
• .clear : DeleteOutcome
• .delete(key : String) : Bool
• .disable : Nil
• .disabled_by_env? : Bool
• .enable : Nil
• .enabled? : Bool
• .ensure_dir : Nil
• .fetch(key : String) : String | Nil
• .key(provider : String, model : String, kind : String, format : String, payload : String) : String

  Build a deterministic cache key from inputs

• .path_for(key : String) : String
• .purge_older_than(days : Int32) : DeleteOutcome
• .stats : Stats
• .store(key : String, content : String) : Bool

  Write atomically: a partially-written file from a crash mid-write would parse as broken JSON on the next .fetch, forcing a spurious fresh API call.

• .tmp_entry?(name : String) : Bool

  True for a temp file stranded by a crash between File.write and File.rename.

Class Method Detail