currently the schema validation , which also removes primary key and cursor field validation are being skipped, as these were heavy weight operations and were hampering the sync timing. These can be added back as an optional run based on the parameters, the option to discover schema during sync.
|
// TODO: addition of validation of fields during sync |
|
// along with option to discover schema during sync |
|
err := elem.Validate(source) |
|
if err != nil { |
|
logger.Warnf("Skipping; Configured Stream %s found invalid due to reason: %s", elem.ID(), err) |
|
return false |
This issue was generated by todo-issue based on a TODO comment in f6df343. It's been assigned to @vaibhav-datazip because they committed the code.
currently the schema validation , which also removes primary key and cursor field validation are being skipped, as these were heavy weight operations and were hampering the sync timing. These can be added back as an optional run based on the parameters, the option to discover schema during sync.
olake/protocol/sync.go
Lines 196 to 201 in f6df343
This issue was generated by todo-issue based on a
TODOcomment in f6df343. It's been assigned to @vaibhav-datazip because they committed the code.