Benchmarks for dotnet/runtime#121223 (for @teo-tsirpanis)

[EgorBot]

Processing benchmark request from PR dotnet/runtime#121223.

Targets: ubuntu24_azure_turin
Commits: main;PR_121223

• ubuntu24_azure_turin: live logs

Results will be posted here once they are ready.

[EgorBot]

ubuntu24_azure_turin — Failed

@teo-tsirpanis

Cancelled by admin.

Job | Full logs

[EgorBo]

@EgorBot -amd -arm

using BenchmarkDotNet.Attributes;
using BenchmarkDotNet.Running;
using System.Reflection.Metadata;

public class BlobWriterBenchmarks
{
    private readonly BlobWriter _blobWriter = new BlobWriter(1024 * sizeof(int));

    private readonly BlobBuilder _blobBuilder = new BlobBuilder();

    [Benchmark]
    public Blob BlobWriter()
    {
        _blobWriter.Clear();
        for (int i = 0; i < 1024; i++)
        {
            _blobWriter.WriteInt32(i);
        }
        return _blobWriter.Blob;
    }

    [Benchmark]
    public int BlobBuilder()
    {
        _blobBuilder.Clear();
        for (int i = 0; i < 1024; i++)
        {
            _blobBuilder.WriteInt32(i);
        }
        return _blobBuilder.Count;
    }
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• ubuntu24_azure_turin: live logs
• macos15_helix_arm64: live logs

[EgorBot]

Results for macos15_helix_arm64

@EgorBo

BenchmarkDotNet v0.15.8, macOS Sequoia 15.3.1 (24D70) [Darwin 24.3.0]
Apple M2, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.3.26166.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
BlobWriter	PR #121223	683.6 ns	2.28 ns	1.00
BlobWriter	main	682.6 ns	2.74 ns	1.00
BlobBuilder	PR #121223	2,088.1 ns	7.20 ns	1.00
BlobBuilder	main	2,088.1 ns	25.10 ns	1.00

Full logs

[EgorBot]

Results for ubuntu24_azure_turin

@EgorBo

BenchmarkDotNet v0.15.8, Linux Ubuntu 24.04.4 LTS (Noble Numbat)
AMD EPYC 9V45 2.60GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK 11.0.100-preview.3.26166.111
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), X64 RyuJIT x86-64-v4

Method	Toolchain	Mean	Error	Ratio
BlobWriter	PR #121223	442.5 ns	4.71 ns	1.00
BlobWriter	main	444.0 ns	3.24 ns	1.00
BlobBuilder	PR #121223	917.2 ns	14.45 ns	1.00
BlobBuilder	main	926.3 ns	12.16 ns	1.01

Full logs

[teo-tsirpanis]

@EgorBot -arm

using BenchmarkDotNet.Attributes;
using System.Reflection.Metadata;

public class WriteConstantBenchmarks
{
    private readonly BlobWriter _blobWriter = new BlobWriter(1024 * sizeof(int));

    private readonly BlobBuilder _blobBuilder = new BlobBuilder();

    private object[] _data;

    [GlobalSetup]
    public void Setup()
    {
        _data = Enumerable.Range(0, 1024).Select(i => (object)i).ToArray();
    }

    [Benchmark]
    public Blob BlobWriter()
    {
        _blobWriter.Clear();
        foreach (var x in _data)
        {
            _blobWriter.WriteConstant(x);
        }
        return _blobWriter.Blob;
    }

    [Benchmark]
    public int BlobBuilder()
    {
        _blobBuilder.Clear();
        foreach (var x in _data)
        {
            _blobBuilder.WriteConstant(x);
        }
        return _blobBuilder.Count;
    }
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• macos15_helix_arm64: live logs

[EgorBot]

Results for macos15_helix_arm64

@teo-tsirpanis

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M2, 1 CPU, 8 logical and 8 physical cores
.NET SDK 11.0.100-preview.3.26167.112
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

Method	Toolchain	Mean	Error	Ratio
BlobWriter	PR #121223	5.882 μs	0.0794 μs	1.00
BlobWriter	main	3.193 μs	0.0354 μs	0.54
BlobBuilder	PR #121223	6.481 μs	0.0694 μs	1.00
BlobBuilder	main	3.556 μs	0.0055 μs	0.55

Full logs

[teo-tsirpanis]

@EgorBot -arm

using BenchmarkDotNet.Attributes;
using System.Reflection.Metadata.Ecma335;
using System.Runtime.CompilerServices;

public class WriteConstantBenchmarks
{
    private readonly MetadataBuilder _metadataBuilder = new();

    private static readonly object _value = 1;

    [Benchmark]
    public void Run()
    {
        ClearBlobs(_metadataBuilder);
        for (int i = 0; i < 32; i++)
        {
            _ = _metadataBuilder.GetOrAddConstantBlob(_value);
        }
    }

    [UnsafeAccessor(UnsafeAccessorKind.Method)]
    private static extern void ClearBlobs(MetadataBuilder metadataWriter);
}

[EgorBot]

Benchmark job submitted. The results will be posted here once they are ready.

• macos15_helix_arm64: live logs

[EgorBot]

Results for macos15_helix_arm64

@teo-tsirpanis

BenchmarkDotNet v0.15.8, macOS Sequoia 15.4.1 (24E263) [Darwin 24.4.0]
Apple M4, 1 CPU, 10 logical and 10 physical cores
.NET SDK 11.0.100-preview.3.26168.106
  [Host]     : .NET 10.0.5 (10.0.5, 10.0.526.15411), Arm64 RyuJIT armv8.0-a

RatioSD=?  

Method	Toolchain	Mean	Error	Ratio
Run	PR #121223	NA	NA	?
Run	main	NA	NA	?

Benchmarks with issues:
WriteConstantBenchmarks.Run: PR #121223)
WriteConstantBenchmarks.Run: main)

Full logs