Skip to content

Fix for metadata entries table for MOR tables containing Delete Files.#1902

Merged
Fokko merged 3 commits into
apache:mainfrom
guptaakashdeep:bugfix/mor_entries
Apr 16, 2025
Merged

Fix for metadata entries table for MOR tables containing Delete Files.#1902
Fokko merged 3 commits into
apache:mainfrom
guptaakashdeep:bugfix/mor_entries

Conversation

@guptaakashdeep

@guptaakashdeep guptaakashdeep commented Apr 9, 2025

Copy link
Copy Markdown
Contributor

Closes #1884

Rationale for this change

table.inspect.entries() fails when table is MOR table and has Delete Files present in it. Iceberg MOR Table is created via Apache Spark 3.5.0 with Iceberg 1.5.0 and it's being read via PyIceberg 0.9.0 using StaticTable.from_metadata()

Are these changes tested?

Yes

Are there any user-facing changes?

No

@guptaakashdeep

guptaakashdeep commented Apr 9, 2025

Copy link
Copy Markdown
Contributor Author

This fixes #1884

@kevinjqliu Can this fix be reviewed once please?

@Fokko Fokko left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working on this @guptaakashdeep, that's a great catch 🙌 It looks good, I just suggested a bit more concise syntax. LMKWYT

Comment thread pyiceberg/table/inspect.py Outdated
@Fokko

Fokko commented Apr 15, 2025

Copy link
Copy Markdown
Contributor

@guptaakashdeep The CI should be fixed? Can you pull in main once more?

@guptaakashdeep

Copy link
Copy Markdown
Contributor Author

@Fokko Alright done.

@Fokko Fokko added this to the PyIceberg 0.9.1 milestone Apr 16, 2025
@Fokko Fokko merged commit b440682 into apache:main Apr 16, 2025
@Fokko

Fokko commented Apr 16, 2025

Copy link
Copy Markdown
Contributor

Thanks @guptaakashdeep 🙌

Fokko pushed a commit that referenced this pull request Apr 17, 2025
#1902)

<!--
Thanks for opening a pull request!
-->

<!-- In the case this PR will resolve an issue, please replace
${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
Closes #1884 

# Rationale for this change
table.inspect.entries() fails when table is MOR table and has Delete
Files present in it. Iceberg MOR Table is created via Apache Spark 3.5.0
with Iceberg 1.5.0 and it's being read via PyIceberg 0.9.0 using
StaticTable.from_metadata()


# Are these changes tested?
Yes

# Are there any user-facing changes?
No

<!-- In the case of user-facing changes, please add the changelog label.
-->
gabeiglio pushed a commit to Netflix/iceberg-python that referenced this pull request Aug 13, 2025
apache#1902)

<!--
Thanks for opening a pull request!
-->

<!-- In the case this PR will resolve an issue, please replace
${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
Closes apache#1884 

# Rationale for this change
table.inspect.entries() fails when table is MOR table and has Delete
Files present in it. Iceberg MOR Table is created via Apache Spark 3.5.0
with Iceberg 1.5.0 and it's being read via PyIceberg 0.9.0 using
StaticTable.from_metadata()


# Are these changes tested?
Yes

# Are there any user-facing changes?
No

<!-- In the case of user-facing changes, please add the changelog label.
-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Metadata entries table breaks when the table configured as Merge-on-Read and has Delete Files

2 participants