class Llamero::MetaData::MetaDataReader

• Llamero::MetaData::MetaDataReader
• Reference
• Object

Overview

This class reads the meta data from a gguf model file according to the GGUF/GGML Original File Spec

Defined in:

models/meta_data/meta_data_reader.cr

Constant Summary

GGUF_METADATA_VALUE_TYPE_ARRAY = 9

Arrays can be nested, and the length of the array is the number of elements in the array, not the number of bytes.

GGUF_METADATA_VALUE_TYPE_BOOL = 7

GGUF_METADATA_VALUE_TYPE_FLOAT32 = 6

GGUF_METADATA_VALUE_TYPE_FLOAT64 = 12

GGUF_METADATA_VALUE_TYPE_INT16 = 3

GGUF_METADATA_VALUE_TYPE_INT32 = 5

GGUF_METADATA_VALUE_TYPE_INT64 = 11

GGUF_METADATA_VALUE_TYPE_INT8 = 1

GGUF_METADATA_VALUE_TYPE_STRING = 8

GGUF_METADATA_VALUE_TYPE_UINT16 = 2

GGUF_METADATA_VALUE_TYPE_UINT32 = 4

GGUF_METADATA_VALUE_TYPE_UINT64 = 10

GGUF_METADATA_VALUE_TYPE_UINT8 = 0

Constructors

• .new(model_file_path : Path)

Instance Method Summary

• #bos_token : String
• #bos_token=(bos_token : String)
• #chat_template : String
• #chat_template=(chat_template : String)
• #eos_token : String
• #eos_token=(eos_token : String)
• #file_header : NamedTuple(magic: UInt32, version: UInt32, tensor_count: UInt64, metadata_kv_count: UInt64)
• #file_header=(file_header : NamedTuple(magic: UInt32, version: UInt32, tensor_count: UInt64, metadata_kv_count: UInt64))
• #model_file_path : Path
• #model_file_path=(model_file_path : Path)
• #padding_token : String
• #padding_token=(padding_token : String)
• #read_meta_data
• #separator_token : String
• #separator_token=(separator_token : String)
• #tokens_array : Array(JSON::Any)
• #tokens_array=(tokens_array : Array(JSON::Any))
• #unknown_token : String
• #unknown_token=(unknown_token : String)

Constructor Detail

Instance Method Detail