use PyArrowFileIO as default for abfs and wasb schemes

[alessandro-nori]

Rationale for this change

Now that pyarrow FileIO supports ADLS, we can update the SCHEMA_TO_FILE_IO mapping for abfs and wasb to use ARROW_FILE_IO, similar to how it’s handled for s3

We’re keeping FsspecFileIO as the preferred default, since the PyArrowFileIO implementation is only available in pyarrow >= 20.0.0

Are these changes tested?

Are there any user-facing changes?

Add mapping SCHEMA_TO_FILE_IO for wasb and abfs to FsspecFileIO and PyArrowFileIO

[NikitaMatskevich]

Very good catch!

[kevinjqliu]

thanks for the PR @alessandro-nori

i would prefer to swap the order and default to fsspec for now. Users can still optionally pick pyarrow. the pyarrow AzureFileSystem implementation is only available for versions >= 20.0.0, which is quite recent

iceberg-python/pyiceberg/io/pyarrow.py

Lines 518 to 523 in 3eecdad

	MIN_PYARROW_VERSION_SUPPORTING_AZURE_FS = "20.0.0"
	if version.parse(pyarrow.__version__) < version.parse(MIN_PYARROW_VERSION_SUPPORTING_AZURE_FS):
	raise ImportError(
	f"pyarrow version >= {MIN_PYARROW_VERSION_SUPPORTING_AZURE_FS} required for AzureFileSystem support, "
	f"but found version {pyarrow.__version__}."
	)

we can revisit this in the future when we bump up our pyarrow version

WDYT?

[alessandro-nori]

Thanks for the review @kevinjqliu !
I agree, I inverted the default 👍

[kevinjqliu]

LGTM!

[kevinjqliu]

Thanks @alessandro-nori and thank you for the review @NikitaMatskevich