From ce919d13c44191985fbd09b688f254744cac0e9a Mon Sep 17 00:00:00 2001 From: pepepeboom Date: Sat, 18 Jul 2026 20:37:45 +0800 Subject: [PATCH] [docs] remove link to unmaintained HEIM in evaluation guide HEIM is no longer officially supported or actively maintained (stanford-crfm/helm#2161, stanford-crfm/helm#3741), so drop it from the list of suggested evaluation frameworks in the evaluation guide's TIP. Fixes #14033 Co-Authored-By: Claude Fable 5 --- docs/source/en/conceptual/evaluation.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/en/conceptual/evaluation.md b/docs/source/en/conceptual/evaluation.md index 4af38254bea6..707f931b6a31 100644 --- a/docs/source/en/conceptual/evaluation.md +++ b/docs/source/en/conceptual/evaluation.md @@ -18,7 +18,7 @@ specific language governing permissions and limitations under the License. > [!TIP] > This document has now grown outdated given the emergence of existing evaluation frameworks for diffusion models for image generation. Please check -> out works like [HEIM](https://crfm.stanford.edu/helm/heim/latest/), [T2I-Compbench](https://huggingface.co/papers/2307.06350), +> out works like [T2I-Compbench](https://huggingface.co/papers/2307.06350) and > [GenEval](https://huggingface.co/papers/2310.11513). Evaluation of generative models like [Stable Diffusion](https://huggingface.co/docs/diffusers/stable_diffusion) is subjective in nature. But as practitioners and researchers, we often have to make careful choices amongst many different possibilities. So, when working with different generative models (like GANs, Diffusion, etc.), how do we choose one over the other?