class Llama::ContextOptions

• Llama::ContextOptions
• Reference
• Object

Defined in:

Constructors

• .new(context_size : UInt32 = 0_u32, batch_size : UInt32 = 512_u32, micro_batch_size : UInt32 = 512_u32, threads : Int32 | Nil = nil, batch_threads : Int32 | Nil = nil, embeddings : Bool = false, offload_kqv : Bool = false, op_offload : Bool = false)

Instance Method Summary

• #batch_size : UInt32
• #batch_threads : Int32 | Nil
• #context_size : UInt32
• #embeddings : Bool
• #micro_batch_size : UInt32
• #offload_kqv : Bool
• #op_offload : Bool
• #threads : Int32 | Nil

Constructor Detail

Instance Method Detail