Skip to content

feat: Announce geoparquet mirror size via STAC file extension - #93

Merged
A-Behairi merged 2 commits into
mainfrom
parquet-filesize
Sep 7, 2026
Merged

A-Behairi merged 2 commits into
mainfrom
parquet-filesize

Conversation

@A-Behairi

Copy link
Copy Markdown
Contributor

Geoparquet collection mirrors now include their byte size, so the client can fetch the parquet footer without first probing for the file length. GitHub Pages compresses the file and a HEAD request does not return the actual file size, which points at the wrong offset.
This covers both catalogs generated with -gp, and collections pointing at an external ParquetSource. In the case of ParquetSource, the file could be republished without the collection reflecting its updated file:size , the client will have to expect the possibility of that and fallback accordingly.

@A-Behairi
A-Behairi requested a review from lubojr September 7, 2026 09:48

@lubojr lubojr left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!
Good point with the ParquetSource catalog ref falling out of sync with the remote parquet file size, but as long as the client handling stays a possible optimization and not a mandatory property, that's fine!

@A-Behairi
A-Behairi merged commit 2a52ef5 into main Sep 7, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants