You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In our pipeline we want to use Copy Activity to move data from SAP HANA source into Avro file sink pointing to a unique location in ADLSv2.
Activity is statically configured with MaxRowsPerFile = 500000 and may be dynamically configured for parallel copy.
We anticipate that source might sometimes fail due to transient connectivity issues and want to configure the activity to perform a number of retries.
At this point we want to understand: is it possible to get incomplete state in sink location in case of source failure? And if its possible, what are our options to keep sink location empty between retries, or before next pipeline run, if all retry attempts ended with failure?
Thanks for the help!
-s
The text was updated successfully, but these errors were encountered:
In our pipeline we want to use Copy Activity to move data from SAP HANA source into Avro file sink pointing to a unique location in ADLSv2.
Activity is statically configured with MaxRowsPerFile = 500000 and may be dynamically configured for parallel copy.
We anticipate that source might sometimes fail due to transient connectivity issues and want to configure the activity to perform a number of retries.
At this point we want to understand: is it possible to get incomplete state in sink location in case of source failure? And if its possible, what are our options to keep sink location empty between retries, or before next pipeline run, if all retry attempts ended with failure?
Thanks for the help!
-s
The text was updated successfully, but these errors were encountered: