Platforms to show: All Mac Windows Linux Cross-Platform
The module LlamaMBS
module LlamaMBS| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| module | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
This is a thin layer around llama.cpp package.
We load the llama library (and ggml library) and call the functions.
- 8 properties
- property MaxDevices as UInt64
- property MaxParallelSequences as UInt64
- property MaxTensorBufTOverrides as UInt64 New in 26.1
- property SupportsGPUOffload as Boolean
- property SupportsMLock as Boolean
- property SupportsMMap as Boolean
- property SupportsRPC as Boolean
- property TimeUS as Int64
- 13 methods
- method ApplyChatTemplate(Template as String, ChatMessages() as LlamaChatMessageMBS, AddAssistentTokens as boolean) as String New in 26.1
- method BackendInit
- method BackendLoad(Path as String) as Boolean New in 26.1
- method BackendLoadAll
- method Backends as LlamaBackendMBS() New in 26.1
- method ChatBuiltInTemplates as String()
- method Loaded as Boolean
- method LoadErrorMessage as String
- method LoadLibrary(File as FolderItem) as boolean
- method LoadLibrary(Path as String) as boolean
- method PrintSystemInfo
- method SetDebugLogger New in 26.1
- method SetLogger(Logger as LlamaLogMBS)
- delegate LlamaLogMBS(Level as Integer, Message as String)
- 6 constants
Log Levels
| Constant | Value | Description |
|---|---|---|
| LogLevelCont | 5 |
Continue previous log |
| LogLevelDebug | 1 |
Debug Message |
| LogLevelError | 4 |
Error |
| LogLevelInfo | 2 |
Information |
| LogLevelNone | 0 |
No level set. |
| LogLevelWarn | 3 |
Warning |
Blog Entries
Release notes
- Version 26.1
- Updated LlamaMBS module to use newer headers.
- Added MaxTensorBufTOverrides property to LlamaMBS module.
- Added SetDebugLogger method to LlamaMBS module.
- Added Backends method to LlamaMBS module.
- Version 25.5
- Added LlamaMBS module for using Llama.cpp in Xojo.
The items on this page are in the following plugins: MBS Tools Plugin.
