Brief Description
Very occasionally the upload of the dataset XML or ZIP to the Azure blob storage cache seems to fail, and the BDS doesn't retry. When this happens, the function azure_upload_to_blob_and_verify in azure.py still returns the URL of the cached file, with an ETag of None), and that then gets saved and output in the JSON index. So the file is reported as having a cached version even when it doesn't.
It should be changed to blank out the cached URL if the upload fails.
It would also be good to re-try the upload to Azure once, just in case it were a very temporary blib.
Severity
High
Brief Description
Very occasionally the upload of the dataset XML or ZIP to the Azure blob storage cache seems to fail, and the BDS doesn't retry. When this happens, the function
azure_upload_to_blob_and_verifyinazure.pystill returns the URL of the cached file, with an ETag of None), and that then gets saved and output in the JSON index. So the file is reported as having a cached version even when it doesn't.It should be changed to blank out the cached URL if the upload fails.
It would also be good to re-try the upload to Azure once, just in case it were a very temporary blib.
Severity
High