Skip to content
View ProprietaryLegal's full-sized avatar

Block or report ProprietaryLegal

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
ProprietaryLegal/README.md

PLI Labs — Proprietary Legal Intelligence

Your proprietary work product is your proprietary intelligence.

Website · Claude workflows · Local models · PLI Labs · Research · Hugging Face · Contact

In the press: Tom's Hardware, November 9, 2026, by Shane Downing, on the eight-V100 build: Lawyer builds private AI server with eight used Nvidia V100 GPUs — up to 215 tokens per second to keep legal files offline, costing about $2,400 per four-GPU board. The article reports the builder's own measurements. The same measurements, with the method, are in the Volta sPLIt repository.

Featured: Volta sPLIt: ~200 tok/s on code, ~110 on legal text, on eight 2018 V100s

code and JSON: ~200 tok/s legal: ~110 tok/s prose and chat: ~85-110 tok/s prompt reading at 128K: 2,200 tok/s context: 524K per request

DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2-32GB, MEASURED 2026-11-05 on our checkpoint build. The whole 249 GB model, every expert, resident in the HBM2 of eight sm_70 cards from 2018, split pipeline-parallel 2 x tensor-parallel 4 across two NVLink boards. Decode depends on what the model writes: about 200 tok/s for code and JSON, 105-118 for legal text, 85-110 for prose and chat, from a 1K prompt to 128K, a little slower at 256K. Prompt reading reaches 2,200 tok/s from 128K up (first token 59 s at 128K). Our port of 1Cat-vLLM #1277, one A/B-tested switch at a time, with exact outputs. Quality, thinking off: LegalBench 0.716 balanced accuracy over 22 tasks; MMLU-Pro 79.9 % (700-item subset); HumanEval+ 89.6 % pass@1; it picks the original model's top next token 89.0 % of the time (92.5 % on legal text). Every patch, measurement and losing idea is published.

Prompt First token Code Structured (JSON) Legal Prose Chat
1K 1.2 s 215 tok/s 203 tok/s 118 tok/s 89 tok/s 95 tok/s
32K 17 s 200 207 117 90 107
128K 59 s 183 197 111 91 96
256K 119 s 160 180 103 84 81

One request at a time, 150 W per card, DSpark 5 drafts per round, thinking off, greedy, 1,024 tokens out; each prompt a real document of its kind; mean of 2 runs, greedy outputs byte-identical across runs. Thinking-on rows, every length from 1K to 256K, method and the test queue are in the repository.

Repository · Measurements · Every lever, won and lost · Test queue · Hugging Face card

Also featured: Volta Max uPLIft: as much of the routed work at NVFP4 precision as fits, every expert on the cards

share of decode work at NVFP4 precision: 79-85 % same next token as NVIDIA's NVFP4 pack: 95.1 %, Volta sPLIt 92.2 % experts at NVFP4 precision: 6,087 of 15,360 code and JSON: 104-131 tok/s legal: 62-72 tok/s prose and chat: 60-68 tok/s prompt reading at 128K: 1,221-1,263 tok/s experts on the cards in decode: all 15,360

DeepSeek-V4.1-Flash-1017 on the same 8x V100-SXM2-32GB, MEASURED 2026-11-10 at a 1,425 MHz clock ceiling. Volta Max uPLIft puts as much of the routed work at NVIDIA's NVFP4 precision as fits on the eight cards, with all routed experts on the cards (VRAM) in decode. Experts are promoted to exactly NVFP4 precision in order of use per byte until the next does not fit, and the rest run from compressed IQ2-class records. This maximizes use (the mixed tally's routed counts, in-sample), not the number of NVFP4 experts. 6,087 of the 15,360 routed experts are at NVFP4, and they carried 79 to 85 % of decode routes in the measured sets (in-sample). Decode runs at 104 to 127 tok/s on code and 62 to 72 on legal text from 1K to 256K prompts, slower than Volta sPLIt.

2026-11-11: a larger NVFP4 tier map and a faster dispatch kernel for Volta Max uPLIft were measured on the eight cards on 2026-11-11. They ship in its next update. The figures here are those of the current release.

How close to NVIDIA's NVFP4 pack, MEASURED 2026-11-11 at a 1,475 MHz ceiling (320 contexts and 513 MMLU questions, greedy, thinking off, rules fixed and published before any capture). Volta Max uPLIft picks the same next token as the NVFP4 reference (Volta Full NVFP4) on 95.1 % of compared tokens, Volta sPLIt on 92.2 %. Its KL divergence from the reference is 0.079 nats against Volta sPLIt's 0.196, and on the tokens both builds still share with the reference it removes 63 % of Volta sPLIt's KL divergence. It changes 1.6 % of the multiple-choice answers, Volta sPLIt 15.4 %.

How much runs at NVFP4 precision Volta sPLIt Volta Max uPLIft Volta Full NVFP4
Share of decode work (routes) at NVFP4 precision 0 % 79 to 85 % (measured sets, in-sample) 100 %
Routed experts at exactly NVFP4 precision 0 of 15,360 6,087 of 15,360 15,360 of 15,360
Routed experts on the cards in decode all all the most-used, the rest from host RAM
How close to the NVFP4 reference Volta sPLIt Volta Max uPLIft Volta Full NVFP4 (the reference)
Same next token as the reference 92.2 % 95.1 % repeat: 100 %
Mean KL divergence from the reference (nats, top 20, lower bound) 0.196 0.079 repeat: 0
Multiple-choice answers that differ from the reference 15.4 % 1.6 % repeat: 0 %
Multiple-choice accuracy, 513 MMLU questions 84.4 % 83.6 % 83.8 %

Volta sPLIt as captured on 2026-11-10. The reference repeat is the same boot run again on 50 contexts and 50 questions. Both accuracies are not distinguishable from the reference's at this sample size. 37 of Volta sPLIt's 79 changed answers are on the 38 questions the reference left unanswered: on the 475 it answered, the changed shares are 1.7 % and 8.8 % (counted after scoring, outside the preregistered rules). Intervals, verdicts, receipts and the scoring script are in the repository.

Greedy continuations that stay identical to the NVFP4 reference: Volta Max uPLIft, Volta sPLIt and the reference's own repeat

Prompt First token Code Structured (JSON) Legal Prose Chat
1K 5.6 s 123 tok/s 131 tok/s 72 tok/s 60 tok/s 60 tok/s
32K 31 s 119 124 67 62 67
128K 106 s 115 117 68 60 62
256K 210 s 104 110 62 61 63

One request at a time, 150 W per card, thinking off, greedy, 1,024 tokens out, the same prompts and method as the Volta sPLIt table above, mean of 2 runs, greedy outputs byte-identical across runs. Volta sPLIt's table was measured on 2026-11-05 at a 1,522 MHz ceiling, so the clocks differ. Every length from 1K to 256K, the thinking-on rows and the method are in the repository.

Decode speed by prompt length, Volta Max uPLIft against Volta sPLIt's published bench, for code, structured, legal and prose Decode speed by prompt length, Volta Max uPLIft against Volta sPLIt's published bench, for code, structured, legal and prose

Repository · Measurements · Speed bench · How close to NVFP4 · Closeness receipts and score · Hugging Face package

Also featured: DGX sPLIce

DGX sPLIce: DeepSeek-V4.1-Flash on 2x DGX Spark + 2x RTX 3090 drafter, x86 offload. Two NVIDIA DGX Spark (GB10) nodes serve the model in tensor parallel; an ordinary x86 machine holds the Engram tables in RAM and serves them over RDMA, and runs the DSpark speculative drafter on a pair of RTX 3090s. The memory this frees on the Sparks goes to KV cache.

Prefill, 4K to 256K-token prompts Structured output, 4 streams Code, 4 streams KV pool Top-1 agreement with the original
2,606-2,827 tok/s 322 tok/s (138 at one) 192 tok/s 1,934,490 tokens 95.9 % (KLD 0.018)

sparkDash protocol, production commit ebc29ed8, 2026-10-31, both Sparks at a 2,300 MHz clock cap, 3 repeats, median; agreement: sudoingX's p4_kld.py panel, agentic domain, 2026-10-21. Every number, the losses beside the wins, the raw JSON and the full install guide are in the repository.

Repository · Benchmarks and comparisons · Install guide · Changelog · Hugging Face card

Also featured: Volta Full NVFP4: every expert at NVFP4 precision, using host RAM

Volta Full NVFP4 runs every routed expert at exactly NVIDIA's NVFP4 precision on the same eight V100s, the most-used on the cards and the rest served from host RAM over PCIe. Slower, with no expert below NVFP4 precision at any time: 28 to 30 tok/s on legal-style text and 19 to 20 on general text, a 498,099-token prompt read in 326.6 s, and 44,696,862,720 folded expert values checked bit-equal to the NVFP4 formula (MEASURED 2026-11-09). As the reference of Volta Max uPLIft's closeness test it answered 83.8 % of 513 MMLU questions correctly (95 % interval 80.7 % to 86.7 %, greedy, thinking off), and a repeat in the same boot was identical on all 50 contexts and 50 questions (MEASURED 2026-11-11, 1,475 MHz).

Repository · Measurements · The closeness test

PLI Labs is the open research arm of Proprietary Legal Intelligence. We publish methods, code, and measured results so you can inspect the work before hiring us. PLI builds AI around a legal organization's own work product, with retrieval, staged workflows, validation, and attorney review.

DGX sPLIce components

Earlier standalone releases of DGX sPLIce's parts and research, each with its own write-up and measurements. The DGX sPLIce repository carries the production source as it serves today.

Repository What it is
dsv41-remote-engram-rdma Engram tables served from x86 RAM over RDMA, with exact local fallback
ofl-rdma-transport RDMA RC and TCP request/response transport for the Engram and drafter offloads
dsv41-remote-dspark-drafter-3090 Remote DSpark drafter on an x86 RTX 3090 over RDMA; freed Spark memory becomes KV cache
dsv41-dspark-drafter-tp2-nvlink The DSpark drafter split across two NVLinked RTX 3090s
dsv41-async-hostflag-handoff Async remote drafting rounds: CUDA-free host flags and a process proxy
dsv41-kv-page-packing-1m KV page packing, head-memory switches and long-context experiments
dsv41-native-1017-drafter-sm86 Native MXFP4/FP8 drafter kernels for RTX 3090 (research, not serving)
dsv41-exact-acceptance-ceiling Exact speculative-acceptance headroom: replay method and aggregates (research)
dsv41-sampled-drafting Sampled DSpark drafts with exact target-side acceptance (research)
dsv41-longctx-bench-tools Long-context, needle, prefix-identity and RDMA interference tools
dsv41-window-harness Fenced, paired measurement windows on a production server
dsv41-spark-offload-findings Findings: round costs, async deadlocks, NVLink safety, exactness and acceptance
dsv41-offload Research archive: every experiment branch up to 2026-10-27
deepseek-v41-flash-2x-dgx-spark-progress The October 2026 progress report (historical; DGX sPLIce is the current state)

V100 serving work

Repository What it is
Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4 ~200 tok/s code, ~110 legal: DeepSeek-V4.1-Flash-1017 on 8x V100, PP2 x TP4, every expert resident; full patch series, measurements and test queue (2026-11-05 checkpoint)
Volta-Max-uPLIft-FP4-DeepSeek-V4.1-Flash-1017-NVFP4-8xV100-SXM2-PP2xTP4 Volta Max uPLIft: as much of the routed work at NVIDIA's NVFP4 precision as fits on the same 8x V100, every routed expert on the cards, the rest from compressed records. Every measurement published, and the build as one Hugging Face package
Volta-Full-NVFP4-DeepSeek-V4.1-Flash-8xV100 Volta Full NVFP4: every routed expert at exactly NVIDIA's NVFP4 precision on the same 8x V100, the less-used ones from host RAM. Recipe, bit-equality proof and measurements
deepseek-v4-flash-v100 DeepSeek-V4-Flash and V4.1-Flash on NVIDIA V100: llama.cpp recipe and quantized-KV fixes (V4); 1Cat-vLLM results so far and patches (V4.1, 2026-11-01)
swift-1.5-v100 Swift 1.5 on four V100s: 1Cat-vLLM serving recipe and a measured comparison with Qwen3.8-27B
V100 research notes Volta serving research in the pli-labs hub
DeepSeek-V4.1-Flash V100 port SM70 port (Hugging Face)

Legal-model work

  • Legal model prunes (REAPs): MiniMax-M2.7, Qwen3.5, and MiniMax-M3. Read each card's evaluation status and license; these releases include research candidates and unhealed previews.
  • pli-labs: the hub that connects our releases, evaluation methods and research.

Mirrors and forks

Upstream work keeps its credit and licence; follow each link to the original.

Repository What it is
deepseek-v41-1017-dgx-spark Fork of HeNryous's vLLM serving image and patches for DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Spark
dgx-spark-deepseek-v41 Fork of sudoingX's DGX Spark launcher with our two optional offload hooks
deepseek-v4.1-v100 Fork of philbert440's 1Cat-vLLM engine snapshot and prebuilt SM70 wheel for DeepSeek-V4.1-Flash-1017 EXL3 at 1M context on 8x V100
1Cat-vLLM Mirror of the V100 / SM70-focused vLLM fork
v100-skinny Mirror of hand-written NVFP4 W4A16 CUDA kernels for Volta

Collaboration

For AI systems using approved frontier APIs, private cloud, or hardware you own, reach us through the contact page.

Proprietary Legal Intelligence LLC is a technology consultancy, not a law firm, and does not provide legal services or legal advice.

Popular repositories Loading

  1. Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4 Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4 Public

    DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2 (2018): 119.0 tok/s decode, 120.8 thinking on (measured), 524K context, 300K-token first token in 178 s. PP2xTP4 port of 1Cat-vLLM #1277 with every patch, m…

    Python 28 3

  2. DGX-sPLIce-DeepSeek-V4.1-Flash-2xDGX-Spark-2xRTX3090-drafter-x86-offload DGX-sPLIce-DeepSeek-V4.1-Flash-2xDGX-Spark-2xRTX3090-drafter-x86-offload Public

    DGX sPLIce: DeepSeek-V4.1-Flash on 2x DGX Spark + 2x RTX 3090 drafter, x86 offload (Engram over RDMA, DSpark drafter). Prefill 2,606-2,827 tok/s to 256K; 322 tok/s structured, 192 tok/s code at 4 s…

    Python 6

  3. deepseek-v4-flash-v100 deepseek-v4-flash-v100 Public

    DeepSeek-V4-Flash and V4.1-Flash on NVIDIA V100: llama.cpp recipe and quantized-KV fixes (V4); 1Cat-vLLM PP2xTP4 results so far and patches (V4.1). PLI Labs.

    Python 3 2

  4. ProprietaryLegal ProprietaryLegal Public

    PLI Labs — Proprietary Legal Intelligence: open legal-AI research, legal model prunes, owned-hardware serving recipes and tools. proprietarylegal.ai · PLI Labs

    1

  5. v100-skinny v100-skinny Public

    Forked from dnv2003/v100-skinny

    Mirror kept by PLI Labs — Hand-written NVFP4 W4A16 CUDA kernels for Volta

    Python

  6. 1Cat-vLLM 1Cat-vLLM Public

    Forked from 1CatAI/1Cat-vLLM

    Mirror kept by PLI Labs — V100 / SM70-focused vLLM engineering fork for modern LLM inference.

    Python