struct Llama::Generation

Overview

Immutable summary of one generation operation.

Defined in:

llama/result.cr

Constructors

Instance Method Summary

Constructor Detail

def self.new(text : String, sampled_tokens : Array(Token), finish_reason : FinishReason, stop_sequence : String | Nil, usage : Usage) #

[View source]

Instance Method Detail

def finish_reason : FinishReason #

[View source]
def sampled_tokens : Array(Token) #

Returns a defensive copy so result values cannot expose internal ledgers.


[View source]
def stop_sequence : String | Nil #

[View source]
def text : String #

[View source]
def usage : Usage #

[View source]