Platforms to show: All Mac Windows Linux Cross-Platform

Back to LlamaModelMBS class.

LlamaModelMBS.ChatTemplate(Name as String) as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Get the default chat template. Returns nullptr if not available.

If name is "", returns the default chat template.

LlamaModelMBS.ClassifierOutputLabel(index as integer) as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Returns label of classifier output by index (<n_cls_out).

Returns "" if no label provided.

LlamaModelMBS.Constructor   Private

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
The private constructor.

See also:

LlamaModelMBS.Constructor(File as FolderItem, Parameters as LlamaModelParametersMBS = nil)

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Loads a model.

Raises UnsupportedOperationException if the model can't be loaded.

See also:

LlamaModelMBS.Constructor(Path as String, Parameters as LlamaModelParametersMBS = nil)

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Loads a model.

Raises UnsupportedOperationException if the model can't be loaded.

See also:

LlamaModelMBS.DecoderStartToken as Int32

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
For encoder-decoder models, this function returns id of the token that must be provided to the decoder to start generating output sequence. For other models, it returns -1.

LlamaModelMBS.Destructor

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
The destructor.

LlamaModelMBS.MetaKey(Index as Integer) as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries the metadata key with the given index.
Example
var model as LlamaModelMBS // your model
Var firstKey As String = model.MetaKey(0)
Var firstValue As String = model.MetaValue(0)

Index is zero based.

LlamaModelMBS.MetaValue(Index as Integer) as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries the metadata value with the given index.
Example
var model as LlamaModelMBS // your model
Var firstKey As String = model.MetaKey(0)
Var firstValue As String = model.MetaValue(0)

Index is zero based.

See also:

LlamaModelMBS.MetaValue(Key as String) as String

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Queries the metadata value with the given key.

See also:

LlamaModelMBS.SaveToFile(File as FolderItem)

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Saves the model to a new file.

See also:

LlamaModelMBS.SaveToFile(Path as String)

Type Topic Plugin Version macOS Windows Linux iOS Targets
method Llama MBS Tools Plugin 25.5 ✅ Yes ✅ Yes ✅ Yes ✅ Yes All
Saves the model to a new file.

See also:

The items on this page are in the following plugins: MBS Tools Plugin.


The biggest plugin in space...