feat(agent evals): add the Pi agent as well as pointcloud sim evals

[hvent90]

Contribution path

• Small, safe change that does not need a tracking issue

Problem

We should have a control or baseline when doing agent evals. None such existed. An example of a control or baseline would simply be having Claude Code, Codex, OpenCode, Pi, or some similar established coding agent run against our agent evals.

Solution

Add a wrapper for the Pi agent harness.

How to Test

uv run dimos evals run dimos.evals.suites.dimsim_pointcloud_mapping \
    --agent dimos.evals.agents.pi \
    --set max_steps=30 \
    # --set instructions="custom instructions that are appended to the prompt that will influence the agent to approach the task in a particular way"

AI assistance

I used Fable 5 to write this PR and I further iterated on it from there.

Checklist

• I have read and approved the CLA.

[codecov]

❌ 1 Tests Failed:

Tests completed	Failed	Passed	Skipped
4914	1	4913	40

View the top 1 failed test(s) by shortest run time

dimos.teleop.hosted.test_go2_command::test_repeated_estop_reissues_damp

Stack Traces | 0.023s run time

module = <dimos.teleop.hosted.go2_command.Go2CommandModule object at 0x7f51f3d7cf80>
monkeypatch = <_pytest.monkeypatch.MonkeyPatch object at 0x7f51f3d7d010>

    def test_repeated_estop_reissues_damp(
        module: Go2CommandModule, monkeypatch: pytest.MonkeyPatch
    ) -> None:
        module.go2.sport_command.return_value = True
        acks: list[tuple[Any, bool]] = []
        monkeypatch.setattr(module, "_send_ack", lambda nonce, ok: acks.append((nonce, ok)))
    
        module._on_state_json(b'{"type": "estop", "nonce": 1}')
        wait_until(lambda: module.go2.sport_command.call_count == 1, timeout=2.0)
        module._on_state_json(b'{"type": "estop", "nonce": 1}')  # retransmit, same nonce
        wait_until(lambda: module.go2.sport_command.call_count == 2, timeout=2.0)
    
>       assert acks.count((1, True)) == 2
E       assert 1 == 2
E        +  where 1 = <built-in method count of list object at 0x7f520ba09980>((1, True))
E        +    where <built-in method count of list object at 0x7f520ba09980> = [(1, True)].count

acks       = [(1, True), (1, True)]
module     = <dimos.teleop.hosted.go2_command.Go2CommandModule object at 0x7f51f3d7cf80>
monkeypatch = <_pytest.monkeypatch.MonkeyPatch object at 0x7f51f3d7d010>

.../teleop/hosted/test_go2_command.py:251: AssertionError

To view more test analytics, go to the Test Analytics Dashboard
_{📋 Got 3 mins? Take this short survey to help us improve Test Analytics.}