Repository navigation
Conversation
…efresh 9-family DCGAN scaling
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Proposes, implements, and benchmarks a new clock-free ParticleGAN formulation family — Relativistic Hellinger-Born-Infeld Transport (
rhbi) (rhbi-v1) — built around a single Debiased Slack-Screened Unbalanced Sinkhorn variational operator with zero schedule annealing, zero EMA critic copy (critic_ema_decay = 0.0), and zero input-shape or step-count gates.develop): https://github.com/255BITS/ParticleGAN/blob/develop/reports/forge/technique-inventory.mdfeat/rhbi-family):reports/forge/technique-inventory.mdreports/forge/families/rhbi.mdreports/forge/rhbi/README.mdFormulation Highlights (
rhbi-v1)float32-overflow-safe):Tracks the detached 25th-quantile real nearest-neighbor distance $\ell_t = (1-\beta_\ell)\ell_{t-1} + \beta_\ell,\operatorname{stopgrad}(Q_{0.25}(d^{\mathrm{NN}}Y) + 10^{-6})$ entirely on-device (zero host-device syncs, exact checkpointing of
ell_emaandell_initialized) and evaluates $c{\mathrm{phys}}(x_i,y_j) = \sqrt{\ell_t^2 + \lVert x_i - y_j\rVert_2^2} - \ell_t$ viafloat64GEMM + algebraic rationalizationCouples active particles (
logsumexpSinkhorn scaling (Masks diagonal $L^{(XX)}{ii} = -\infty$ with zeroed critic shift in self-coupling and scales symmetric repulsive weights by $\sqrt{a_i a_k}$ ($a_i = \operatorname{clamp}(B\sum_j P^{\star(XY)}{ij}, 0, 1)$), cancelling entropic variance shrinkage inside multi-particle modes while leaving Poisson singletons unrepelled.
Replaces chord interpolation and EMA critic anchors with a softplus-squared endpoint input-gradient cap (
optimizer_dense_profile="polar_cpu_v1"(single-buffer batched PCIe CPU LAPACK polar SVD) to eliminate tiny-matrixcuSOLVERoverhead on dense MLP hosts.9-Family Leaderboard Comparison (Protocol Seed 0,
NVIDIA RTX A6000)Untuned
rhbi-v1(1 declared candidate card, 0 configuration searches) achieves 23/27 Tier 1 view requirements — the highest Tier 1 view-requirement total on the board — with 0 BLOCKED / 0 ERROR / 0 INCOMPLETE across Tier 1:adaptationT1clockfreeT1disc_stabT1formulationT1host_transferT1qualityT1rhbi-v1bispf-optimized-quintic-v1recipe-prior-refactor-bcap-pure-v1recipe-prior-refactor-release07-gan-v3-v1recipe-prior-refactor-k3p-v1recipe-prior-refactor-ka2-v1recipe-prior-refactor-r1r2-v1atlas-particle-normal-v4e22Uncontended DCGAN Scaling Performance (
GPU-548116b7,clear, 54/54 cells)RHBI(rhbi-v1)BISPF(quintic-v1)BCAP(bcap-pure-v1)Atlas(v4)dcgan_performance_r32(32², B16, W64)dcgan_performance_r64(64², B16, W64)dcgan_performance_w128(64², B16, W128)dcgan_performance_b64(64², B64, W64)dcgan_performance_r128(128², B16, W64)dcgan_performance_r256(256², B16, W64)Diagnosis of the 4 Required Tier 1 Misses &
rhbi-v2RoadmapAll 4 required Tier 1 misses in
discriminator_stabilityreach strong mode coverage/final quality (model_vae_categorical: all 13 final bounds met, 12/24 passing checks;model_vae_hard:decoder_mean_hq=0.9934,likelihood_hq=0.9814, 12/24 passing checks;model_ae_gan_multimodal: 14/24 passing checks;ring16_acquisition:16/16modes,hq=0.946, covariance spill1.617 > 0.85), failing on the 5-check consecutive stability suffix or mode-covariance spill due to two coupled optimizer/prior effects:DualNormPolar Smoothing (0.001): At equilibrium, finite-batch (DualNorm's0.001polar smoothing floor, soDualNormnormalizes stochastic shot noise back to unit spectral step norm (prior_lr_mult = 2.5withrownorm): Row-normalized particle updates of size0.03per step inflate intra-mode latent dispersion onring16_acquisition(spill = 1.617).Recommended
rhbi-v2next steps:g <- g * tanh(E_excess / E_ref)) to attenuate parameter gradients belowDualNorm's0.001smoothing threshold once active transport cost approaches hollow self-coupling energy.prior_lr_mult = 0.02–0.25) to eliminate intra-mode covariance spill onring16_acquisitionwhile retaining nonlocal Born-Infeld mode capture.Verification
python -m experiments.forge validate&python -m experiments.forge compile --check(CURRENT)python ops/refresh_forge_readouts.py --check --reports-only(Status: CURRENT (stale stages: none))pytestacrosstests/test_rhbi.py,tests/test_refresh_forge_readouts.py,tests/test_docs_links.py,tests/test_leaderboard_index.py,tests/test_forge_current_technique_inventory.py,tests/test_forge_comparison_policy.py,tests/test_forge_recorded_formulaic_display.py,tests/test_atlas_particle_normal_v4.py,tests/test_forge_scaling.py,tests/test_swappable_priors.py(388 passed)python scripts/check_lint.py(0new findings) & wheel size gate (399,571 < 600,000bytes)particlegan/recipe_compat.pyorexperiments/forge/behavior_adapters.py; all 8 existing family pins preserved byte-for-byte.