Platforms to show: All Mac Windows Linux Cross-Platform
Back to LlamaModelMBS class.
LlamaModelMBS.ClassifierOutputs as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
Undefined behavior for non-classifier models
(Read only property)
LlamaModelMBS.ctx_train as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
This may differ from the context size used during inference, especially if the model is fine-tuned or configured with a different context window.
(Read only property)
LlamaModelMBS.Description as String
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
For LLaMA-7B, this is typically 4096.
(Read only property)
LlamaModelMBS.Handle as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.HasDecoder as Boolean
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.HasEncoder as Boolean
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
LLaMA-7B typically uses 32 attention heads.
(Read only property)
LlamaModelMBS.head_kv as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
In models with multi-query attention (e.g., grouped-query attention), this may be less than the total number of attention heads. In standard attention, this equals head function.
(Read only property)
LlamaModelMBS.IsDiffusion as Boolean
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.IsHybrid as Boolean
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.IsRecurrent as Boolean
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.layer as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
LLaMA-7B has 32 layers.
(Read only property)
LlamaModelMBS.Meta as Dictionary
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
This provides all keys and values in the metadata at once.
(Read only property)
LlamaModelMBS.MetaCount as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.ParameterCount as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
LlamaModelMBS.RopeType as Integer
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
See RopeType* constants.
(Read only property)
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
This field may be 0 if the model does not use sliding window attention. This is a feature used in some efficient transformer variants.
(Read only property)
LlamaModelMBS.Vocab as LlamaVocabMBS
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| property | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
(Read only property)
The items on this page are in the following plugins: MBS Tools Plugin.