Skip to content

Core, Spark: Fix row lineage last updated sequence inheritance#17264

Merged
huaxingao merged 1 commit into
1.11.xfrom
backport-17039-1.11.x
Jul 21, 2026
Merged

Core, Spark: Fix row lineage last updated sequence inheritance#17264
huaxingao merged 1 commit into
1.11.xfrom
backport-17039-1.11.x

Conversation

@manuzhang

@manuzhang manuzhang commented Jul 17, 2026

Copy link
Copy Markdown
Member

Summary

Backports #17039 to 1.11.x.

  • Fixes _last_updated_sequence_number inheritance to use a data file's data_sequence_number in scan constants.
  • Adds regression coverage for a v2 rewrite/compaction followed by a v3 upgrade and row ID assignment.
  • Applies the Spark regression to the versions supported on this branch: 3.4, 3.5, 4.0, and 4.1.

AI Disclosure

@manuzhang
manuzhang marked this pull request as ready for review July 17, 2026 04:33
@manuzhang manuzhang changed the title [1.11.x] Core, Spark: Fix row lineage last updated sequence inheritance Core, Spark: Fix row lineage last updated sequence inheritance Jul 17, 2026
@manuzhang manuzhang added this to the Iceberg 1.11.1 milestone Jul 17, 2026
Backport #17039 to 1.11.x by inheriting _last_updated_sequence_number from a data file data sequence number. Add core and Spark regression coverage for v2 compaction followed by a v3 upgrade.

Co-authored-by: Codex <codex@openai.com>
@manuzhang

Copy link
Copy Markdown
Member Author

I removed [1.11.x] from PR title since it fails PR title check, and opened #17265 to fix that.

@manuzhang
manuzhang force-pushed the backport-17039-1.11.x branch from 5cc6d2e to 570c54b Compare July 17, 2026 05:02

@singhpk234 singhpk234 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thanks @manuzhang ~

@huaxingao
huaxingao merged commit 74c0456 into 1.11.x Jul 21, 2026
34 checks passed
@huaxingao
huaxingao deleted the backport-17039-1.11.x branch July 21, 2026 15:17
@huaxingao

Copy link
Copy Markdown
Contributor

Thanks @manuzhang @wgtmac for the PR! Thanks @singhpk234 for the review!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants