Platforms to show: All Mac Windows Linux Cross-Platform
LlamaModelParametersMBS class
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| class | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
- event Progress(progress as Single) as Boolean
- 9 properties
- property check_tensors as Boolean
- property main_gpu as Int32
- property no_alloc as Boolean
- property no_host as Boolean
- property n_gpu_layers as Int32
- property split_mode as Integer
- property use_extra_bufts as Boolean
- property vocab_only as Boolean
- property Yield as Boolean
- 2 methods
- method Constructor
- method Destructor
- 4 constants
Split Modes
| Constant | Value | Description |
|---|---|---|
| SplitModeLayer | 1 |
split layers and KV across GPUs |
| SplitModeNone | 0 |
single GPU |
| SplitModeRow | 2 |
split layers and KV across GPUs, use tensor parallelism if supported |
| SplitModeTensor | 3 |
Tensor |
This class has no sub classes.
Blog Entries
- MBS Xojo Plugins, version 26.4pr5
- Use Llama.cpp in Xojo
- MBS Xojo Plugins, version 26.1pr3
- Using llama.cpp in Xojo
Release notes
- Version 26.4
- Removed use_direct_io, use_mmap and use_mlock for LlamaModelParametersMBS class.
- Version 26.1
- Added no_alloc and use_direct_io properties to LlamaModelParametersMBS class.
Some methods using this class:
- LlamaModelMBS.Constructor(File as FolderItem, Parameters as LlamaModelParametersMBS = nil)
- LlamaModelMBS.Constructor(Path as String, Parameters as LlamaModelParametersMBS = nil)
Some examples using this class:
- /Tools/Llama/LLama Simple
- /Tools/Llama/LLama Simple Chat
- /Tools/Llama/LLama Simple Chat Gemma 4
- /Tools/Llama/LLama Simple console
Some related classes:
The items on this page are in the following plugins: MBS Tools Plugin.
LlamaModelMBS - LlamaModelQuantizeParametersMBS
