perf: add SIMD-accelerated UTF-8 validation to core arrow crates

[lyang24]

Which issue does this PR close?

• Touches Support using simdutf8 for validate_string_view and other utf8 validation #7014.

Rationale for this change

Add simdutf8 for fast UTF-8 validation in arrow-data, arrow-array, arrow-row, and arrow-csv. A shared check_utf8() utility in arrow-data uses SIMD on the happy path and falls back to std::str::from_utf8 on error for detailed Utf8Error. The feature is default-enabled in the arrow umbrella crate.

What changes are included in this PR?

simd impl of utf8 instead of the standard lib method

Are these changes tested?

all tests passed

Are there any user-facing changes?

no

[Dandandan]

Can we unify this with the existing utf8 check?

[lyang24]

Hi, do you mean unifying it with the one in parquet folder?

[Dandandan]

Yeah

[alamb]

run benchmark json_reader arrow_reader

[adriangbot]

🤖 Arrow criterion benchmark running (GKE) | trigger
Linux bench-c4092122248-466-b4wdv 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing simdutf8 (83b4782) to 442e1b8 (merge-base) diff
BENCH_NAME=json_reader
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench json_reader
BENCH_FILTER=
Results will be posted here when complete

[adriangbot]

🤖 Arrow criterion benchmark running (GKE) | trigger
Linux bench-c4092122248-467-khvpz 6.12.55+ #1 SMP Sun Feb 1 08:59:41 UTC 2026 aarch64 GNU/Linux
Comparing simdutf8 (83b4782) to 442e1b8 (merge-base) diff
BENCH_NAME=arrow_reader
BENCH_COMMAND=cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader
BENCH_FILTER=
Results will be posted here when complete

[adriangbot]

🤖 Arrow criterion benchmark completed (GKE) | trigger

Details

group                                  main                                   simdutf8
-----                                  ----                                   --------
large_bench_primitive                  1.00   1518.6±2.79µs        ? ?/sec    1.01   1535.3±5.21µs        ? ?/sec
small_bench_list                       1.00      7.9±0.02µs        ? ?/sec    1.01      8.0±0.02µs        ? ?/sec
small_bench_primitive                  1.01      4.4±0.02µs        ? ?/sec    1.00      4.4±0.01µs        ? ?/sec
small_bench_primitive_with_utf8view    1.00      4.4±0.01µs        ? ?/sec    1.00      4.4±0.02µs        ? ?/sec

Resource Usage

base (merge-base)

Metric	Value
Wall time	41.9s
Peak memory	2.1 GiB
Avg memory	2.1 GiB
CPU user	40.9s
CPU sys	0.7s
Disk read	0 B
Disk write	576.4 MiB

branch

Metric	Value
Wall time	40.6s
Peak memory	2.1 GiB
Avg memory	2.1 GiB
CPU user	40.5s
CPU sys	0.1s
Disk read	0 B
Disk write	1.9 MiB

[lyang24]

some work is needed to unify utf8 checks with parquet. taking this one to draft for now