Platforms to show: All Mac Windows Linux Cross-Platform

LlamaContextMBS class   New in 25.5

• 9 properties
  • property Handle as Integer
  • property Model as LlamaModelMBS
  • property n_batch as UInt32
  • property n_ctx as UInt32
  • property n_seq_max as UInt32
  • property n_threads as Integer
  • property n_threads_batch as Integer
  • property n_ubatch as UInt32
  • property pooling_type as Integer
• 20 methods
  • method Ask(Sampler as LlamaSamplerMBS, prompt as String, MaxTokens as Integer = 100) as String
  • method Constructor   Private
  • method Constructor(Model as LlamaModelMBS, Parameters as LlamaContextParametersMBS = nil)
  • method Decode(batch as LlamaBatchMBS) as Integer
  • method Destructor
  • method Embeddings as Ptr
  • method Embeddings(index as Integer) as Ptr
  • method EmbeddingsSeq(index as Integer) as Ptr
  • method Encode(batch as LlamaBatchMBS) as Integer
  • method Logits as Ptr
  • method Logits(index as Integer) as Ptr
  • method MemoryBreakdownPrint
  • method Performance as LlamaPerformanceContextDataMBS
  • method PerformancePrint
  • method PerformanceReset
  • method SetCausalAttention(causalAttn as boolean)
  • method SetEmbeddings(embeddings as Boolean)
  • method SetThreads(Threads as Integer, ThreadsBatch as Integer)
  • method SetWarmup(warmup as boolean)
  • method Synchronize

This class has no sub classes.

Blog Entries

• MBS Xojo Plugins, version 25.5pr4

Some methods using this class:

• LlamaSamplerMBS.Sample(context as LlamaContextMBS, Index as Integer) as Int32

Some related classes:

• class LlamaBatchMBS
• class LlamaContextParametersMBS
• class LlamaModelMBS
• class LlamaPerformanceContextDataMBS
• class LlamaSamplerMBS

The items on this page are in the following plugins: MBS Tools Plugin.

LlamaChatMessageMBS   -   LlamaContextParametersMBS