Currently 2 phase commit support is only added for destination iceberg , the same needs to be done for parquet destination as well
|
// TODO: implement 2pc in parquet writer (difficulty: hard) |
|
return p.closePqFiles(ctx, finalMetadataState, ctx.Err() != nil) |
|
} |
|
|
|
// validate schema change & evolution and removes null records |
This issue was generated by todo-issue based on a TODO comment in 2c441eb. It's been assigned to @vaibhav-datazip because they committed the code.
Currently 2 phase commit support is only added for destination iceberg , the same needs to be done for parquet destination as well
olake/destination/parquet/parquet.go
Lines 346 to 350 in 2c441eb
This issue was generated by todo-issue based on a
TODOcomment in 2c441eb. It's been assigned to @vaibhav-datazip because they committed the code.