AI generated
Genesis — /Grounded-Entropy/project-genesis (100% local and free for personal/research use) 1. What it does & why you should care Project Genesis is a ~0.51 MB cache-resident C++/CUDA co-processor (libgenesis_core.so) that hooks inline into existing local causal LLMs during inference. Euclidean manifolds require the use of layer norms and softmax with boundless hidden states, which often leads to noisy logits, repetitive loops, or wasted reasoning tokens—particularly on smaller or quantized checkpoints. Project Genesis conditions trajectories in native IEEE-754 double precision (FP64) on norm-preserving manifolds prior to token resolution, without touching or retraining your model's weights and with O(1) memory overhead. 2. Why use it vs. running no co-processor Without a co-processor, your only options for stabilizing a smaller local model are scaling up in parameter count, running quantization, or using VRAM on a second draft model for speculative decoding. Project Genesis leaves your existing checkpoint completely intact, adds zero sequence-length memory scaling, and keeps its entire working set (~4.5 MB at d_model=4096) resident inside physical L2 cache rather than round-tripping to your GPU's VRAM. The fused CUDA kernel runs asynchronously with a lock-free GPU ring buffer for telemetry. 3. How it's been tested and validated The binary has been verified end-to-end on a local 16 GB RTX 5080 (WSL2 Ubuntu 22.04) across five distinct model lineages (Qwen2.5-0.5B/1.5B, Qwen3-8B, Gemma-4-E4B-it, Llama-3.2-3B-Instruct, Nemotron-Mini-4B-Instruct, and Mistral-7B-Instruct-v0.3), maintaining finite logits and bit-level FP64 parity (1.78e-14 max deviation against the reference math) across heterogeneous attention and normalization setups. Rather than giving my benchmarks here, the compiled bundle is up for anyone on 64-bit Linux or WSL2 with an NVIDIA GPU (Compute Capability 8.0+, supporting 20 d_model sizes from 576 to 8192) to pull, run with enable_telemetry=True, and report back with your own latency, throughput, and output behavior. https://zenodo.org/records/24234017