Ruby LLM tool_concurrency Messes Up Logs

[justwiebe]

When I enable Ruby LLM's new tool_concurrency then the tools all get pulled into their own traces.

RubyLLM.configure do |config|
  config.tool_concurrency = true
  config.use_new_acts_as = true
end

Without Concurrency

With Concurrency

[justwiebe]

This is a workaround:

config/initializers/braintrust.rb

  require 'opentelemetry-api'
  require 'ruby_llm'

  module RubyLLMToolConcurrencyContextPropagation
    def run(mode, tool_calls, on_result: nil, &execute)
      context = OpenTelemetry::Context.current

      super(mode, tool_calls, on_result:) do |tool_call|
        OpenTelemetry::Context.with_current(context) { execute.call(tool_call) }
      end
    end
  end

  RubyLLM::ToolConcurrency.singleton_class.prepend(RubyLLMToolConcurrencyContextPropagation)

[delner]

Sorry for the late reply, thanks for sharing! I'll take a look at this, see what I can make of this.