Failing to upload a file on storage account with "[Errno 104] Connection reset by peer" message.

Question

Hi All
I am trying to upload a file (5GB) to storage account using put page blob api of azure python sdk.
example-  blob_service.put_page_blob_from_path('container', 'windows.vhd', '/mnt/23/Windows.vhd').
But after sometime connection gets reset, i am getting same error in other regions as well. Following is the connection reset log-
>> blob_service.put_page_blob_from_path('container', 'windows.vhd', '/mnt/snapshotted_images/23/Windows7-flat.vhd')
*** error: [Errno 104] Connection reset by peer
Thanks,
Vaibhav Kale

Answer 1

Hello Vaibhav,
Directly uploading a 5GB file may last long time due to client network, then in that time period, if certain network latency or exception happens, then the upload action will be impacted.
To overcome this type of issue, you can consider to apply existing tool to upload vhd: azcopy
http://azure.microsoft.com/en-us/documentation/articles/storage-use-azcopy/
http://blogs.msdn.com/b/windowsazurestorage/archive/2012/12/03/azcopy-uploading-downloading-files-for-windows-azure-blobs.aspx
you can either start the tool by your python code to upload the target vhd file or manually run azcopy command to upload(if this uploading happens very rarely to you).
in azcopy, as the tutorial, there is option for you to specify the target blob to be page blob:
/BlobType:<block | page>
Specifies whether the destination blob is a block blob or a page blob. This option is applicable only when uploading blob; otherwise, an error is generated. If the destination is a blob and this option is not specified, then by default AzCopy will create
a block blob.
hopes this helps in your project.
In addition, I tested the python sdk here
https://github.com/Azure/azure-sdk-for-python, as it described, the function for create page blobs (from a stream, a file, or a string) worked for me. could you also try to reload this sdk and test?
let me know if there is any question.
Jian Wu