Platforms to show: All Mac Windows Linux Cross-Platform

LlamaDeviceMBS class   New in 26.1

Type Topic Plugin Version macOS Windows Linux iOS Targets
class Llama MBS Tools Plugin 26.1 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
The class for a backend device.

This is an abstract class. You can't create an instance, but you can get one from various plugin functions.

Types

Constant Value Description
TypeACCEL 3 Accelerator devices intended to be used together with the CPU backend (e.g. BLAS or AMX).
TypeCPU 0 CPU device using system memory
TypeGPU 1 GPU device using dedicated memory
TypeIGPU 2 Integrated GPU device using host memory

This class has no sub classes.

Blog Entries

Release notes

  • Version 26.1
    • Added LlamaDeviceMBS and LlamaBackendMBS classes.

Some methods using this class:

Some related classes:


The items on this page are in the following plugins: MBS Tools Plugin.


LlamaContextParametersMBS   -   LlamaExceptionMBS


The biggest plugin in space...