Platforms to show: All Mac Windows Linux Cross-Platform

LlamaContextMBS class

• 11 properties
  • property Handle as Integer
  • property Model as LlamaModelMBS
  • property n_batch as UInt32
  • property n_ctx as UInt32
  • property n_ctx_seq as UInt32   New in 26.1
  • property n_ctx_used as UInt32   New in 26.1
  • property n_seq_max as UInt32
  • property n_threads as Integer
  • property n_threads_batch as Integer
  • property n_ubatch as UInt32
  • property pooling_type as Integer
• 21 methods
  • method Ask(Sampler as LlamaSamplerMBS, prompt as String, MaxTokens as Integer = 100) as String
  • method ClearMemory   New in 26.1
  • method Constructor   Private
  • method Constructor(Model as LlamaModelMBS, Parameters as LlamaContextParametersMBS = nil)
  • method Decode(batch as LlamaBatchMBS) as Integer
  • method Destructor
  • method Embeddings as Ptr
  • method Embeddings(index as Integer) as Ptr
  • method EmbeddingsSeq(index as Integer) as Ptr
  • method Encode(batch as LlamaBatchMBS) as Integer
  • method Logits as Ptr
  • method Logits(index as Integer) as Ptr
  • method MemoryBreakdownPrint
  • method Performance as LlamaPerformanceContextDataMBS
  • method PerformancePrint
  • method PerformanceReset
  • method SetCausalAttention(causalAttn as boolean)
  • method SetEmbeddings(embeddings as Boolean)
  • method SetThreads(Threads as Integer, ThreadsBatch as Integer)
  • method SetWarmup(warmup as boolean)
  • method Synchronize

This class has no sub classes.

Blog Entries

• Use Llama.cpp in Xojo
• MBS Xojo Plugins, version 26.1pr3
• Using llama.cpp in Xojo
• MonkeyBread Software Releases the MBS Xojo Plugins in version 25.5
• MBS Xojo Plugins, version 25.5pr4

Xojo Developer Magazine

• 24.1, page 9: News

Release notes

• Version 26.1
  • Added n_ctx_seq property to LlamaContextMBS class.

Some methods using this class:

• LlamaSamplerMBS.Sample(context as LlamaContextMBS, Index as Integer) as Int32

Some related classes:

• class LlamaBatchMBS
• class LlamaContextParametersMBS
• class LlamaModelMBS
• class LlamaPerformanceContextDataMBS
• class LlamaSamplerMBS

The items on this page are in the following plugins: MBS Tools Plugin.

LlamaChatMessageMBS   -   LlamaContextParametersMBS