S&Box LLM Proof of Concept

Game

Proof of concept for running a real LLM entirely inside s&box using a custom C# GPT-Neo inference engine. No APIS, fully local

jeffskitchen updated 1mo ago 32 MB engine 28
S&Box LLM Proof of Concept
 
 !!!!NOTE!!!!!!:
This is not meant to be even a tiny bit close to an actual useable ChatGPT or Claude clone, the model (TinyStories-Instruct-1M) is quite literally 1/2000 the size of any flagship model. The findings in this project can be used to build larger language model projects.

S&Box LLM POC
is a proof of concept demonstrating that a transformer language model can run entirely inside the s&box game runtime without external AI software, servers, APIs, Python, Ollama, or separate executables.

The project includes a custom C# inference engine capable of loading packaged model weights, GPT-2 tokenization, GPT-Neo transformer inference, global and local attention, and autoregressive text generation directly within s&box.

The current implementation runs TinyStories-Instruct-1M locally on the CPU and has been numerically validated against the original PyTorch/Hugging Face model. Generated token sequences match the reference implementation while inference runs on an s&box worker thread to keep the game responsive.


The end goal of the POC is a simple in-game chat interface powered entirely by an LLM running inside s&box itself.

From this, I hope other developers can see what is possible and potentially use small LLM to power NPCs, game functions or even whole games.



show_chart Player History
Loading history...
No history data available yet
23
Total Users
27
Total Sessions
1.7 hours
Total Playtime
0 recorded entries
Rank Player Score Recorded
refresh
Discovering package leaderboards...
Package ID: jeffskitchen.llm_poc
Created: 2026-08-17 05:09 UTC
Updated: 2026-08-17 04:58 UTC
Type: game
Public: Yes
Version: 342521
files: 41
Size: 32.1 MB
Engine Version: 28
Asset Version ID: 342521
Version Created: 2026-08-17 04:58 UTC
Hash: 1788116883
Manifest: Open manifest
Multiplayer: Unknown
Versus: Unknown
Co-op: Unknown

settings Engine & Multiplayer Configuration

Player Count: 1 - 64 Players
Tick Rate: 50 Hz
Network Type: Multiplayer
Startup Scene: scenes/minimal.scene
Map Select: Unrestricted
new_releases Latest Update Aug 17, 2026
Updated model to publish correctly
342521 Aug 17, 2026
Updated model to publish correctly
342519 Aug 17, 2026
Changes on 2026-08-17
info Live API Passthrough & Removal Notice

This file manifest and asset metadata are retrieved live directly from the official Facepunch s&box public API. s&box Explorer does not host, store, or redistribute any package files. All download links route directly to Facepunch CDN servers.