S&Box LLM Proof of Concept
Released
Proof of concept for running a real LLM entirely inside s&box using a custom C# GPT-Neo inference engine. No APIS, fully local
Llm/LlmFoundationState.cs
Static state holder for the LLM foundation components. Stores status, error, runtime flags, timing and references to the model and tokenizer for use elsewhere in the LlmPoc.Llm code.
namespace LlmPoc.Llm;
public static class LlmFoundationState
{
public static string Status { get; internal set; } = "NOT IMPLEMENTED: validation has not run";
public static string Error { get; internal set; } = "";
public static bool IsRunning { get; internal set; }
public static bool IsReady { get; internal set; }
public static double LastValidationMilliseconds { get; internal set; }
public static SboxLlmModel Model { get; internal set; }
public static Gpt2ByteBpeTokenizer Tokenizer { get; internal set; }
}