Platforms to show: All Mac Windows Linux Cross-Platform
LlamaModelParametersMBS class
| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| class | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
- event Progress(progress as Single) as Boolean
- 12 properties
- property check_tensors as Boolean
- property main_gpu as Int32
- property no_alloc as Boolean New in 26.1
- property no_host as Boolean
- property n_gpu_layers as Int32
- property split_mode as Integer
- property use_direct_io as Boolean New in 26.1
- property use_extra_bufts as Boolean
- property use_mlock as Boolean
- property use_mmap as Boolean
- property vocab_only as Boolean
- property Yield as Boolean
- 2 methods
- method Constructor
- method Destructor
- 3 constants
Split Modes
| Constant | Value | Description |
|---|---|---|
| SplitModeLayer | 1 |
split layers and KV across GPUs |
| SplitModeNone | 0 |
single GPU |
| SplitModeRow | 2 |
split layers and KV across GPUs, use tensor parallelism if supported |
This class has no sub classes.
Blog Entries
Release notes
- Version 26.1
- Added no_alloc and use_direct_io properties to LlamaModelParametersMBS class.
Some methods using this class:
- LlamaModelMBS.Constructor(File as FolderItem, Parameters as LlamaModelParametersMBS = nil)
- LlamaModelMBS.Constructor(Path as String, Parameters as LlamaModelParametersMBS = nil)
Some related classes:
The items on this page are in the following plugins: MBS Tools Plugin.
LlamaModelMBS - LlamaModelQuantizeParametersMBS
