Skip to content

PR3 incremental_strategy conflict - #2238

Open
SuchodolskiEdvin wants to merge 3 commits into
dataproc-pocfrom
pr3-incremental-strategy-conflict
Open

PR3 incremental_strategy conflict#2238
SuchodolskiEdvin wants to merge 3 commits into
dataproc-pocfrom
pr3-incremental-strategy-conflict

Conversation

@SuchodolskiEdvin

@SuchodolskiEdvin SuchodolskiEdvin commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Description

Merging commit dfbad6df (Support incremental_strategy parameter and new insert_overwrite strategy (#2195)) from main into dataproc-poc.

⚠️ Where to Look for Review (Conflict Resolution)

Out of the 18 files in this commit, 17 merged cleanly automatically.
The ONLY file that had a merge conflict was protos/core.proto.

Please only review the conflict resolution in protos/core.proto.

apilaskowski and others added 3 commits July 7, 2026 10:33
* Define DefaultIcebergConfig message

Move DefaultIcebergConfig message from configs.proto to core.proto.

This now prevents using core.proto messages in config.proto.

The way protos are used across the project lets this change work without additional changes in code.

* Remove DefaultIcebergConfig message

Removed DefaultIcebergConfig message definition from configs.proto.

* Remove import of configs.proto from core.proto

* Remove unused import from configs.proto

Removed import statement for core.proto.
…egy (#2195)

* Support incremental_strategy parameter and new insert_overwrite strategy

- updated proto with new parameters
- added new tests
- added validation for chosen incremental_strategies
- added new insert_overwrite strategy logic

* Implement incrementalPredicates config for BigQuery incremental tables

- Replaced legacy 'T' and 'S' MERGE aliases with explicit 'DATAFORM_DEST' and 'DATAFORM_SOURCE' in the BigQuery adapter.
- Updated `incremental_table_test.ts` assertions.
- Documented the new `incrementalPredicates` property in the OSS API reference.
@SuchodolskiEdvin
SuchodolskiEdvin requested review from a team and kolina August 3, 2026 11:14
@SuchodolskiEdvin
SuchodolskiEdvin marked this pull request as ready for review August 3, 2026 11:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants