[FLINK-39379][table] Add state management to PTF test harness

[autophagy]

What is the purpose of the change

The PTF Test Harness currently does not support any use of state. This PR adds support for PTFs with state (map, list and pojo) and injects the state into the eval of the PTF being tested (based on the partition key/s). When eval completes, the state is then converted into an internal format (Map/List/RowData) to also provide testing of state serialization.

It currently doesn't support state TTL.

Brief change log

• Added state support for ProcessTableFunctionTestHarness.
• Refactored some minor things (argument info, how scalar argument values are stored/handled)

Verifying this change

This change added tests and can be verified by the state tests in ProcessTableFunctionTestHarnessTest.

Does this pull request potentially affect one of the following parts:

• Dependencies (does it add or upgrade a dependency): (no)
• The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
• The serializers: (no)
• The runtime per-record code paths (performance sensitive): (no)
• Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no)
• The S3 file system connector: (no)

Documentation

• Does this pull request introduce a new feature? (yes)
• If yes, how is the feature documented? (docs)

---

Was generative AI tooling used to co-author this PR?

• Yes (please specify the tool below)

Generated-by: 2.1.145 (Claude Code)

[flinkbot]

CI report:

• 2a07d3e Azure: SUCCESS

Bot commands

The @flinkbot bot supports the following commands:

• @flinkbot run azure re-run the last Azure build