Support fsspec s3 addressing_style properties

[fcfangcc]

Rationale for this change

Impl #2516

Then changed it like

catalog = load_catalog(
    "docs",
    **{
        "type": "rest",
        "uri": "http://lakekeeper:8181/catalog",
        "s3.force-virtual-addressing": True ,
        ...
    },
)

Are these changes tested?

Add test case for fsspec s3 addressing_style properties

Are there any user-facing changes?

The default behavior is not modified

[Fokko]

I see we already have this one, should we re-use that one? I'm not sure why it isn't being used 🤔 Seems like a faulty refactor somewhere

[fcfangcc]

I see we already have this one, should we re-use that one? I'm not sure why it isn't being used 🤔 Seems like a faulty refactor somewhere

Because two different S3 dependency libraries are used, the configuration parameters for this in the two libraries are different.

[fcfangcc]

@Fokko I modified and used the same parameter s3.force-virtual-addressing to changed addressing_style

In fsspec impl, s3 api dependent s3fs -> aiobotocore, this lib use s3.addressing_style to control.

But in pyarrow impl, s3 api dependent from pyarrow.fs import S3FileSystem, this lib use force-virtual-addressing to control.

[kevinjqliu]

LGTM!

[kevinjqliu]

👍
config_kwargs is passed to botocore.client.Config
https://s3fs.readthedocs.io/en/latest/api.html#s3fs.core.S3FileSystem

botocore.client.Config expects botocore.client.Config in s3 dict
https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html

[kevinjqliu]

Thanks for the fix @fcfangcc