Skip to content

roofline: emit per-launch topology edges for graph reconstruction - #66

Merged
roberteg16 merged 2 commits into
gfx11from
rogarcia.roofline-graph-topology
Jul 27, 2026
Merged

roofline: emit per-launch topology edges for graph reconstruction#66
roberteg16 merged 2 commits into
gfx11from
rogarcia.roofline-graph-topology

Conversation

@roberteg16

Copy link
Copy Markdown

Record per-invocation storage-id identity (out/in) so the consumer can link each launch to its producer via last-writer-wins on storage roots, reconstructing the execution graph. Fused spans elide internal tensors.

Counter part of: https://gitenterprise.xilinx.com/FaaSApps/rocm-scripts/pull/781

Comment thread ggml/src/ggml-cuda/ggml-cuda-roofline.cpp Outdated
Record per-invocation storage-id identity (out/in) so the consumer can
link each launch to its producer via last-writer-wins on storage roots,
reconstructing the execution graph. Fused spans elide internal tensors.

Co-Authored-By: Claude Opus 4 (1M context) <noreply@anthropic.com>
@roberteg16
roberteg16 force-pushed the rogarcia.roofline-graph-topology branch 2 times, most recently from 83ed463 to 70e402b Compare July 27, 2026 11:25
…_ids

Each launch's topology now carries, 1:1 with in_storage_ids, the source operand's
tensor name (in_names), dtype (in_types) and shape (in_ne). The name makes
weight-vs-input unambiguous for the consumer -- a model weight is named e.g.
"blk.0.ffn_gate.weight" / "*.bias", a dynamic input "inp_pos" / "cache_k_l0" -- and
the per-operand type/shape are correct even for a fused span's non-head operands,
which the shared (head-only) geometry record does not describe. The name is taken
from the storage root so a view/reshape of a weight keeps the weight's name.
@roberteg16
roberteg16 force-pushed the rogarcia.roofline-graph-topology branch from 70e402b to c7060bd Compare July 27, 2026 11:27
@roberteg16
roberteg16 merged commit a37cb98 into gfx11 Jul 27, 2026
5 checks passed
@roberteg16
roberteg16 deleted the rogarcia.roofline-graph-topology branch July 27, 2026 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants