Platforms to show: All Mac Windows Linux Cross-Platform
The module LlamaMBS New in 25.5
module LlamaMBS| Type | Topic | Plugin | Version | macOS | Windows | Linux | iOS | Targets |
| module | Llama | MBS Tools Plugin | 25.5 | ✅ Yes | ✅ Yes | ✅ Yes | ✅ Yes | All |
This is a thin layer around llama.cpp package.
We load the llama library (and ggml library) and call the functions.
- 7 properties
- property MaxDevices as UInt64
- property MaxParallelSequences as UInt64
- property SupportsGPUOffload as Boolean
- property SupportsMLock as Boolean
- property SupportsMMap as Boolean
- property SupportsRPC as Boolean
- property TimeUS as Int64
- 9 methods
- method BackendInit
- method BackendLoadAll
- method ChatBuiltInTemplates as String()
- method Loaded as Boolean
- method LoadErrorMessage as String
- method LoadLibrary(File as FolderItem) as boolean
- method LoadLibrary(Path as String) as boolean
- method PrintSystemInfo
- method SetLogger(Logger as LlamaLogMBS)
- delegate LlamaLogMBS(Level as Integer, Message as String)
- 6 constants
Log Levels
| Constant | Value | Description |
|---|---|---|
| LogLevelCont | 5 |
Continue previous log |
| LogLevelDebug | 1 |
Debug Message |
| LogLevelError | 4 |
Error |
| LogLevelInfo | 2 |
Information |
| LogLevelNone | 0 |
No level set. |
| LogLevelWarn | 3 |
Warning |
Blog Entries
Release notes
- Version 25.5
- Added LlamaMBS module for using Llama.cpp in Xojo.
The items on this page are in the following plugins: MBS Tools Plugin.
