Your proprietary work product is your proprietary intelligence.
Website · Claude workflows · Local models · PLI Labs · Research · Hugging Face · Contact
In the press: Tom's Hardware, November 9, 2026, by Shane Downing, on the eight-V100 build: Lawyer builds private AI server with eight used Nvidia V100 GPUs — up to 215 tokens per second to keep legal files offline, costing about $2,400 per four-GPU board. The article reports the builder's own measurements. The same measurements, with the method, are in the Volta sPLIt repository.
Featured: Volta sPLIt: ~200 tok/s on code, ~110 on legal text, on eight 2018 V100s
DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2-32GB, MEASURED 2026-11-05 on our checkpoint build. The whole 249 GB model, every expert, resident in the HBM2 of eight sm_70 cards from 2018, split pipeline-parallel 2 x tensor-parallel 4 across two NVLink boards. Decode depends on what the model writes: about 200 tok/s for code and JSON, 105-118 for legal text, 85-110 for prose and chat, from a 1K prompt to 128K, a little slower at 256K. Prompt reading reaches 2,200 tok/s from 128K up (first token 59 s at 128K). Our port of 1Cat-vLLM #1277, one A/B-tested switch at a time, with exact outputs. Quality, thinking off: LegalBench 0.716 balanced accuracy over 22 tasks; MMLU-Pro 79.9 % (700-item subset); HumanEval+ 89.6 % pass@1; it picks the original model's top next token 89.0 % of the time (92.5 % on legal text). Every patch, measurement and losing idea is published.
| Prompt | First token | Code | Structured (JSON) | Legal | Prose | Chat |
|---|---|---|---|---|---|---|
| 1K | 1.2 s | 215 tok/s | 203 tok/s | 118 tok/s | 89 tok/s | 95 tok/s |
| 32K | 17 s | 200 | 207 | 117 | 90 | 107 |
| 128K | 59 s | 183 | 197 | 111 | 91 | 96 |
| 256K | 119 s | 160 | 180 | 103 | 84 | 81 |
One request at a time, 150 W per card, DSpark 5 drafts per round, thinking off, greedy, 1,024 tokens out; each prompt a real document of its kind; mean of 2 runs, greedy outputs byte-identical across runs. Thinking-on rows, every length from 1K to 256K, method and the test queue are in the repository.
Repository · Measurements · Every lever, won and lost · Test queue · Hugging Face card
Also featured: Volta Max uPLIft: as much of the routed work at NVFP4 precision as fits, every expert on the cards
DeepSeek-V4.1-Flash-1017 on the same 8x V100-SXM2-32GB, MEASURED 2026-11-10 at a 1,425 MHz clock ceiling. Volta Max uPLIft puts as much of the routed work at NVIDIA's NVFP4 precision as fits on the eight cards, with all routed experts on the cards (VRAM) in decode. Experts are promoted to exactly NVFP4 precision in order of use per byte until the next does not fit, and the rest run from compressed IQ2-class records. This maximizes use (the mixed tally's routed counts, in-sample), not the number of NVFP4 experts. 6,087 of the 15,360 routed experts are at NVFP4, and they carried 79 to 85 % of decode routes in the measured sets (in-sample). Decode runs at 104 to 127 tok/s on code and 62 to 72 on legal text from 1K to 256K prompts, slower than Volta sPLIt.
2026-11-11: a larger NVFP4 tier map and a faster dispatch kernel for Volta Max uPLIft were measured on the eight cards on 2026-11-11. They ship in its next update. The figures here are those of the current release.
How close to NVIDIA's NVFP4 pack, MEASURED 2026-11-11 at a 1,475 MHz ceiling (320 contexts and 513 MMLU questions, greedy, thinking off, rules fixed and published before any capture). Volta Max uPLIft picks the same next token as the NVFP4 reference (Volta Full NVFP4) on 95.1 % of compared tokens, Volta sPLIt on 92.2 %. Its KL divergence from the reference is 0.079 nats against Volta sPLIt's 0.196, and on the tokens both builds still share with the reference it removes 63 % of Volta sPLIt's KL divergence. It changes 1.6 % of the multiple-choice answers, Volta sPLIt 15.4 %.
| How much runs at NVFP4 precision | Volta sPLIt | Volta Max uPLIft | Volta Full NVFP4 |
|---|---|---|---|
| Share of decode work (routes) at NVFP4 precision | 0 % | 79 to 85 % (measured sets, in-sample) | 100 % |
| Routed experts at exactly NVFP4 precision | 0 of 15,360 | 6,087 of 15,360 | 15,360 of 15,360 |
| Routed experts on the cards in decode | all | all | the most-used, the rest from host RAM |
| How close to the NVFP4 reference | Volta sPLIt | Volta Max uPLIft | Volta Full NVFP4 (the reference) |
|---|---|---|---|
| Same next token as the reference | 92.2 % | 95.1 % | repeat: 100 % |
| Mean KL divergence from the reference (nats, top 20, lower bound) | 0.196 | 0.079 | repeat: 0 |
| Multiple-choice answers that differ from the reference | 15.4 % | 1.6 % | repeat: 0 % |
| Multiple-choice accuracy, 513 MMLU questions | 84.4 % | 83.6 % | 83.8 % |
Volta sPLIt as captured on 2026-11-10. The reference repeat is the same boot run again on 50 contexts and 50 questions. Both accuracies are not distinguishable from the reference's at this sample size. 37 of Volta sPLIt's 79 changed answers are on the 38 questions the reference left unanswered: on the 475 it answered, the changed shares are 1.7 % and 8.8 % (counted after scoring, outside the preregistered rules). Intervals, verdicts, receipts and the scoring script are in the repository.
| Prompt | First token | Code | Structured (JSON) | Legal | Prose | Chat |
|---|---|---|---|---|---|---|
| 1K | 5.6 s | 123 tok/s | 131 tok/s | 72 tok/s | 60 tok/s | 60 tok/s |
| 32K | 31 s | 119 | 124 | 67 | 62 | 67 |
| 128K | 106 s | 115 | 117 | 68 | 60 | 62 |
| 256K | 210 s | 104 | 110 | 62 | 61 | 63 |
One request at a time, 150 W per card, thinking off, greedy, 1,024 tokens out, the same prompts and method as the Volta sPLIt table above, mean of 2 runs, greedy outputs byte-identical across runs. Volta sPLIt's table was measured on 2026-11-05 at a 1,522 MHz ceiling, so the clocks differ. Every length from 1K to 256K, the thinking-on rows and the method are in the repository.
Repository · Measurements · Speed bench · How close to NVFP4 · Closeness receipts and score · Hugging Face package
Also featured: DGX sPLIce
DGX sPLIce: DeepSeek-V4.1-Flash on 2x DGX Spark + 2x RTX 3090 drafter, x86 offload. Two NVIDIA DGX Spark (GB10) nodes serve the model in tensor parallel; an ordinary x86 machine holds the Engram tables in RAM and serves them over RDMA, and runs the DSpark speculative drafter on a pair of RTX 3090s. The memory this frees on the Sparks goes to KV cache.
| Prefill, 4K to 256K-token prompts | Structured output, 4 streams | Code, 4 streams | KV pool | Top-1 agreement with the original |
|---|---|---|---|---|
| 2,606-2,827 tok/s | 322 tok/s (138 at one) | 192 tok/s | 1,934,490 tokens | 95.9 % (KLD 0.018) |
sparkDash protocol, production commit ebc29ed8, 2026-10-31, both Sparks at a 2,300 MHz clock cap, 3 repeats, median; agreement: sudoingX's p4_kld.py panel, agentic domain, 2026-10-21. Every number, the losses beside the wins, the raw JSON and the full install guide are in the repository.
Repository · Benchmarks and comparisons · Install guide · Changelog · Hugging Face card
Also featured: Volta Full NVFP4: every expert at NVFP4 precision, using host RAM
Volta Full NVFP4 runs every routed expert at exactly NVIDIA's NVFP4 precision on the same eight V100s, the most-used on the cards and the rest served from host RAM over PCIe. Slower, with no expert below NVFP4 precision at any time: 28 to 30 tok/s on legal-style text and 19 to 20 on general text, a 498,099-token prompt read in 326.6 s, and 44,696,862,720 folded expert values checked bit-equal to the NVFP4 formula (MEASURED 2026-11-09). As the reference of Volta Max uPLIft's closeness test it answered 83.8 % of 513 MMLU questions correctly (95 % interval 80.7 % to 86.7 %, greedy, thinking off), and a repeat in the same boot was identical on all 50 contexts and 50 questions (MEASURED 2026-11-11, 1,475 MHz).
Repository · Measurements · The closeness test
PLI Labs is the open research arm of Proprietary Legal Intelligence. We publish methods, code, and measured results so you can inspect the work before hiring us. PLI builds AI around a legal organization's own work product, with retrieval, staged workflows, validation, and attorney review.
Earlier standalone releases of DGX sPLIce's parts and research, each with its own write-up and measurements. The DGX sPLIce repository carries the production source as it serves today.
| Repository | What it is |
|---|---|
| dsv41-remote-engram-rdma | Engram tables served from x86 RAM over RDMA, with exact local fallback |
| ofl-rdma-transport | RDMA RC and TCP request/response transport for the Engram and drafter offloads |
| dsv41-remote-dspark-drafter-3090 | Remote DSpark drafter on an x86 RTX 3090 over RDMA; freed Spark memory becomes KV cache |
| dsv41-dspark-drafter-tp2-nvlink | The DSpark drafter split across two NVLinked RTX 3090s |
| dsv41-async-hostflag-handoff | Async remote drafting rounds: CUDA-free host flags and a process proxy |
| dsv41-kv-page-packing-1m | KV page packing, head-memory switches and long-context experiments |
| dsv41-native-1017-drafter-sm86 | Native MXFP4/FP8 drafter kernels for RTX 3090 (research, not serving) |
| dsv41-exact-acceptance-ceiling | Exact speculative-acceptance headroom: replay method and aggregates (research) |
| dsv41-sampled-drafting | Sampled DSpark drafts with exact target-side acceptance (research) |
| dsv41-longctx-bench-tools | Long-context, needle, prefix-identity and RDMA interference tools |
| dsv41-window-harness | Fenced, paired measurement windows on a production server |
| dsv41-spark-offload-findings | Findings: round costs, async deadlocks, NVLink safety, exactness and acceptance |
| dsv41-offload | Research archive: every experiment branch up to 2026-10-27 |
| deepseek-v41-flash-2x-dgx-spark-progress | The October 2026 progress report (historical; DGX sPLIce is the current state) |
| Repository | What it is |
|---|---|
| Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4 | ~200 tok/s code, ~110 legal: DeepSeek-V4.1-Flash-1017 on 8x V100, PP2 x TP4, every expert resident; full patch series, measurements and test queue (2026-11-05 checkpoint) |
| Volta-Max-uPLIft-FP4-DeepSeek-V4.1-Flash-1017-NVFP4-8xV100-SXM2-PP2xTP4 | Volta Max uPLIft: as much of the routed work at NVIDIA's NVFP4 precision as fits on the same 8x V100, every routed expert on the cards, the rest from compressed records. Every measurement published, and the build as one Hugging Face package |
| Volta-Full-NVFP4-DeepSeek-V4.1-Flash-8xV100 | Volta Full NVFP4: every routed expert at exactly NVIDIA's NVFP4 precision on the same 8x V100, the less-used ones from host RAM. Recipe, bit-equality proof and measurements |
| deepseek-v4-flash-v100 | DeepSeek-V4-Flash and V4.1-Flash on NVIDIA V100: llama.cpp recipe and quantized-KV fixes (V4); 1Cat-vLLM results so far and patches (V4.1, 2026-11-01) |
| swift-1.5-v100 | Swift 1.5 on four V100s: 1Cat-vLLM serving recipe and a measured comparison with Qwen3.8-27B |
| V100 research notes | Volta serving research in the pli-labs hub |
| DeepSeek-V4.1-Flash V100 port | SM70 port (Hugging Face) |
- Legal model prunes (REAPs): MiniMax-M2.7, Qwen3.5, and MiniMax-M3. Read each card's evaluation status and license; these releases include research candidates and unhealed previews.
- pli-labs: the hub that connects our releases, evaluation methods and research.
Upstream work keeps its credit and licence; follow each link to the original.
| Repository | What it is |
|---|---|
| deepseek-v41-1017-dgx-spark | Fork of HeNryous's vLLM serving image and patches for DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Spark |
| dgx-spark-deepseek-v41 | Fork of sudoingX's DGX Spark launcher with our two optional offload hooks |
| deepseek-v4.1-v100 | Fork of philbert440's 1Cat-vLLM engine snapshot and prebuilt SM70 wheel for DeepSeek-V4.1-Flash-1017 EXL3 at 1M context on 8x V100 |
| 1Cat-vLLM | Mirror of the V100 / SM70-focused vLLM fork |
| v100-skinny | Mirror of hand-written NVFP4 W4A16 CUDA kernels for Volta |
For AI systems using approved frontier APIs, private cloud, or hardware you own, reach us through the contact page.
Proprietary Legal Intelligence LLC is a technology consultancy, not a law firm, and does not provide legal services or legal advice.


