Skip to content

fallback for truncated ListObjects V1 responses without NextMarker#1584

Draft
387809109 wants to merge 1 commit into
Unidata:maint-5.xfrom
387809109:swift-s3-pagination
Draft

fallback for truncated ListObjects V1 responses without NextMarker#1584
387809109 wants to merge 1 commit into
Unidata:maint-5.xfrom
387809109:swift-s3-pagination

Conversation

@387809109

@387809109 387809109 commented Jul 16, 2026

Copy link
Copy Markdown

Description of Changes

For non-AWS endpoints, netCDF-Java 5.9.1 selected ListObjects V1.

The original pagination logic was:

String continuationToken =
    useV2
        ? responseV2.nextContinuationToken()
        : responseV1.nextMarker();
updateObjectList(continuationToken);

A direct AWS SDK ListObjects V1 request for Swift returned:

count=1000
isTruncated=true
nextMarker=null

The page was valid and truncated, but Swift did not return NextMarker, therefore netCDF-Java repeatedly requested the first page.

changed that part to add a fallback for truncated ListObjects V1 responses without NextMarker

PR Checklist

  • Link to any issues that the PR addresses
  • Add labels
  • Open as a draft PR
    until ready for review
  • Make sure GitHub tests pass
  • Mark PR as "Ready for Review"

@CLAassistant

CLAassistant commented Jul 16, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants