Platforms to show: All Mac Windows Linux Cross-Platform

Back to LlamaModelMBS class.

LlamaModelMBS.ClassifierOutputs as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the number of classifier outputs (only valid for classifier models)

Undefined behavior for non-classifier models
(Read only property)

LlamaModelMBS.ctx_train as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the context length (i.e., the maximum number of tokens) the model was trained with.

This may differ from the context size used during inference, especially if the model is fine-tuned or configured with a different context window.
(Read only property)

LlamaModelMBS.Description as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Get a string describing the model type.

(Read only property)

LlamaModelMBS.embd as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the size of the embedding vector for each token (also known as the hidden size or dimensionality of the model).

For LLaMA-7B, this is typically 4096.
(Read only property)

LlamaModelMBS.Handle as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
The internal object reference.

(Read only property)

LlamaModelMBS.HasDecoder as Boolean

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns true if the model contains a decoder that requires Decode call.

(Read only property)

LlamaModelMBS.HasEncoder as Boolean

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns true if the model contains an encoder that requires Encode call.

(Read only property)

LlamaModelMBS.head as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the number of attention heads used in each transformer layer.

LLaMA-7B typically uses 32 attention heads.
(Read only property)

LlamaModelMBS.head_kv as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the number of key-value (KV) attention heads.

In models with multi-query attention (e.g., grouped-query attention), this may be less than the total number of attention heads. In standard attention, this equals head function.
(Read only property)

LlamaModelMBS.IsDiffusion as Boolean

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns true if the model is diffusion-based (like LLaDA, Dream, etc.)

(Read only property)

LlamaModelMBS.IsHybrid as Boolean

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns true if the model is hybrid (like Jamba, Granite, etc.)

(Read only property)

LlamaModelMBS.IsRecurrent as Boolean

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns true if the model is recurrent (like Mamba, RWKV, etc.)

(Read only property)

LlamaModelMBS.layer as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the number of transformer layers (also known as "blocks") in the model.

LLaMA-7B has 32 layers.
(Read only property)

LlamaModelMBS.Meta as Dictionary

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries the metadata for the model.

This provides all keys and values in the metadata at once.
(Read only property)

LlamaModelMBS.MetaCount as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries meta data count.

(Read only property)

LlamaModelMBS.ParameterCount as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the total number of parameters in the model.

(Read only property)

LlamaModelMBS.RopeType as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Retrieves the Rotary Positional Embedding (RoPE) type used by the given llama model.

See RopeType* constants.
(Read only property)

LlamaModelMBS.Size as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the total size of all the tensors in the model in bytes

(Read only property)

LlamaModelMBS.swa as Integer

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns the number of sliding window attention (SWA) blocks, if used.

This field may be 0 if the model does not use sliding window attention. This is a feature used in some efficient transformer variants.
(Read only property)

LlamaModelMBS.Vocab as LlamaVocabMBS

Type Topic Plugin Version macOS Windows Linux iOS Targets
property Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries the vocabulary.

(Read only property)

The items on this page are in the following plugins: MBS Tools Plugin.


The biggest plugin in space...