Uploaded BlockBlob in UTF-8 format but downloads as ANSI

Hi,
I'm uploading some UTF-8 encoded CSV files to Azure Storage using the API. When using the SDK I'm explicitly setting ContentType and using UTF-8.
        outputBlob.Properties.ContentType = "text/html; charset=utf-8";
        outputBlob.UploadText(content, new UTF8Encoding(true));
When I use Azure Storage Explorer or CyberDuck to download the files and inspect them with Notepad++ it tells me they are in ANSI format and the chars are corrupt.
How do I overcome this and ensure the files are treated as UTF-8?
Thanks,
Mike

Hi,
Yes the ContentType displays as expected in Azure Storage Explorer. After more investigation it seems some files open in Notepad++ and report ANSI whereas others with special characters report UTF-8 without BOM.
I'm wondering if UTF-8 without BOM can't be detected by NotePad++ unless the file contains special characters, and is otherwise assumed to be ANSI?
The lost of the BOM is a small issue as without it Excel opens the CSV with corrupt characters. Converting the file to UTF-8 with BOM fixes it. Is there a way to force the UTF-8 with BOM encoding?
Thanks,
Mike

Similar Messages

  • Conversion to UTF-16 format

    Hi,
    i have a requirement where i need to convert data in my internal table which is in text format to UTF-16 format before downloading it to a file,
    is there any function module which can be used .
    Regards,
    Raghavendra

    Hi Raghavendra,
    As per my knowledge it is not possible to directly to convert to UTF-16. But there is a way to download into application server.
    Write data to file
    open dataset DSN in text mode for output encoding utf-16.
    transfer STRUC2 to DSN.
    close dataset DSN.
    After converting like that you can download the data.
    Regards,
    Ameer Baba.

  • Utf-8 format

    hi every one,
    i want to create an xml file from my forms 6i application, i create the file but forms 6i save it as ANSI file, but i want to save it as UTF-8 format, but with TEXT_IO package i don't know if it's possible to do that,
    can any one help me, thank you
    Edited by: ramzi_ALG on 23 nov. 2011 10:53

    i found some programs like "Sisulizer's Kaboom" , UTFCast or NoteTab Light and they all convert to utf8 but i want something else like a line of command or a plsql's codes to convert my files. so please if anyone have an ideas please help me .
    thank you all

  • TS1967 My computer failed and the main drive had to be formatted but all my music was on a separate internal hard drive. So I downloaded the latest iTunes , problem is it has found all my songs but seems to not recognize half of the album data, half of th

    My computer failed and the main drive had to be formatted but all my music was on a separate internal hard drive. So I downloaded the latest iTunes , problem is it has found all my songs but seems to not recognize half of the album data, half of the artists, all of the dates and all ratings data.
    I had a large part of it backed up on DVD's but it does not want to recognise them either?
    Any tips?

    Hey briannagrace96,
    Welcome to Apple Support Communities! I'd check out the following article, it looks like it applies to your situation:
    iPod: Appears in Windows but not in iTunes
    http://support.apple.com/kb/ts1363
    You'll want to go through the following troubleshooting steps, and for more detail on each step follow the link to the article above:
    Try the iPod troubleshooting assistant:
    If you have not already done so, try the steps in the iPod Troubleshooting Assistant (choose your iPod model from the list).
    If the issue remains after following your iPod's troubleshooting assistant, follow the steps below to continue troubleshooting your issue.
    Restart the iPod Service
    Restart the Apple Mobile Device Service
    Empty your Temp directory and restart
    Verify that the Apple Mobile Device USB Driver is installed
    Change your iPod's drive letter
    Remove and reinstall iTunes
    Disable conflicting System Services and Startup Items
    Update, Reconfigure, Disable, or Remove Security Software
    Deleting damaged or incorrect registry keys
    Take care,
    David

  • I've a MacBook, iPhoto 09, Kodak Easyshare camera. Importing photos working last wk, but today says can't import unrecognized format but it's jpg. Only change since last wk is I downloaded updates. Works fine if I attach camera to unupdated iMac

    I've a MacBook, iPhoto 09, Kodak Easyshare camera. Importing photos working last wk, but today says can't import unrecognized format but it's jpg. Only change since last wk is I downloaded updates. Works fine if I attach camera to unupdated iMac

    What update are you referring to?  If you do a search for "Kodak" in the iPhoto community you'll find numerous posts regarding problems with Kodak cameras. 
    So far there's no known fix.  The best workaround is to use a card reader with the memory card of the camera.
    OT

  • HELP!!!!!!!!, I WANNA UPLOAD VIDEOS IN MP4 FORMAT BUT..

    HELP!!!!!!!!, I WANNA UPLOAD VIDEOS IN MP4 FORMAT BUT ITUNES SAYS THERE IS A PROBLEM AND SHUTS DOWN THE PROGRAM!!!!!!!!!!!!, PLEASE HELP I FEEL I HAVE GOTTEN RIPPED OFF!!!!!!!!!, I HAVE MICROSOFT XP. I ALRADY REBOOTED ITUNES LIKE 5 TIMES. I USED VIDORIA TO CONVERT THEM INTO MP4. i WENT TO ITUNES TO UPLOAD THE VIDEOS THEN IT SAYS ERROR WE NEED TO CLOSE THE PROGRAM AND I DONE EVEN HAVE A VIDEO ON THERE. PLEASE HELP!!!!!!!!!!!!!!!!!!!

    Hold Please, i am having this very same problem and i feel the same way. I was having the problem every sents i got the video ipod. So Could you please tell me how you solve this problem. please!!

  • PS downloads uploads for my CS5 (fully licensed) but "can't install" - offers no explanation. Help appreciated. Greg

    PS downloads uploads for my CS5 (fully licensed) but "can't install" - offers no explanation. Help appreciated. Greg

    32 versus 64 doesn't make a difference.
    "I've seen similar issues on httP://feedback.photoshop.com You should maybe post there to report the bug."
    Thanks.  I searched there and found what might be a workaround. I think this is simply a bug in CS5. If (as indicated in posts revealed by searching the forum you linked me to) I temporarily change Printer Manages Color to Photoshop Manages Color in the PS window, I can then access Print Settings again to make changes, Save and then change Photoshop Manages Color back to Printer Manages Color.
    Go figure.
    Thanks a lot for the help.
    What I don't understand is why everyone isn't experiencing the same issue.

  • Slow Upload but Download is OK

    Dear Verizon,
    I have been experiencing slow Upload Speeds (<.1mbps) but Download is OK for the last 6 months or more. I have been on countless screen share sessions and have talked with expert technicians over this time. I have followed all suggestions and troubleshooting. I have tried four different modems, including one that I purchased at your recommendation, from Verizon. I have performed virus scans using two different antivirus programs, and spyware scans. My computer is a new i5 with lots of RAM, and I am running Windows 8. I have tried three different web browsers.
    Below, please find a copy of a forum post by a person having a problem identical to mine. Please note that it was determined that the problem was "a fault at the exchange." Also please note that a technician who has seen this problem suggested "ask BT to connect your line to a new "slam" dedicated to your "subscribed speed". That should cure the problem."
    Thank you!
    {edited for privacy}
    https://community.bt.com/t5/ADSL-Copper-Broadband-Speed/Slow-upload-speed-but-download-fine/td-p/419...

    Your issue has been escalated to a Verizon agent. Before the agent can begin assisting you, they will need to collect further information from you.
    Please go to your profile page for the forum, and look in the middle, right at the top where you will find an area titled "My Support Cases". You can reach your profile page by clicking on your name beside your post, or at the top left of this page underneath the title of the board.
    Under “My Support Cases” you will find a link to the private board where you and the agent may exchange information. This should be checked on a frequent basis as the agent may be waiting for information from you before they can proceed with any actions.
    To ensure you know when they have responded to you, at the top of your support case there is a drop down menu for support case options. Open that and choose "subscribe".
    Please keep all correspondence regarding your issue in the private support portal.

  • Convert data from ANSI to UTF-8 format

    Hello,
    We have data in ANSI format (binary) which we need to convert into UTF-8 format. We are able to do it using FM's GUI_UPLOAD and GUI_DOWNLOAD but as the amount of data is huge we are planning to get the conversion done using background job. But, we are not able to get it yet. Can anybody suggest ways to resolve this? Can class CL_ABAP_CONV_X2X_CE be used for the same?
    Thanks...
    With Regards,
    Mukul Kulkarni

    Hello,
    If you have the data in Binary mode, you can use the addition IN BINARY MODE while uploading.
    For downloading in UTF-8, you can use the addition TEXT MODE ENCODING UTF-8.
    BR,
    Suhas

  • Creating XML file with UTF-8 format

    Hi,
    I have written the below code to download an XML file. but ia m able to in UTF-16 format.how do i download in UTF-8 format.
    can somebody send i sample code for UTF-8 format.
    types: begin of x_mara,
           matnr type matnr,
           mtart type mtart,
           end of x_mara.
    TYPES: BEGIN OF ttab,
           record(50000) TYPE c,
           END OF ttab.
    data: t_mara type standard table of x_mara.
    DATA: xml_out TYPE string,
          xml_table type table of ttab.
    select matnr
           mtart
           from mara up to 10 rows
           into table t_mara.
    CALL TRANSFORMATION id
    SOURCE output = t_mara
    RESULT XML xml_out.
    append xml_out to xml_table.
    CALL FUNCTION 'GUI_DOWNLOAD'
      EXPORTING
      BIN_FILESIZE                    =
        FILENAME                        = 'C:\Users\sirishac\Desktop\Siri.xml'
       FILETYPE                         = 'BIN'
      APPEND                          = ' '
      WRITE_FIELD_SEPARATOR           = ' '
      HEADER                          = 'BCWEB'
      TRUNC_TRAILING_BLANKS           = ' '
      WRITE_LF                        = 'X'
      COL_SELECT                      = ' '
      COL_SELECT_MASK                 = ' '
      DAT_MODE                        = ' '
      CONFIRM_OVERWRITE               = ' '
      NO_AUTH_CHECK                   = ' '
      CODEPAGE                        = ' '
      IGNORE_CERR                     = ABAP_TRUE
      REPLACEMENT                     = '#'
      WRITE_BOM                       = ' '
      TRUNC_TRAILING_BLANKS_EOL       = 'X'
      WK1_N_FORMAT                    = ' '
      WK1_N_SIZE                      = ' '
      WK1_T_FORMAT                    = ' '
      WK1_T_SIZE                      = ' '
      WRITE_LF_AFTER_LAST_LINE        = ABAP_TRUE
    IMPORTING
      FILELENGTH                      =
      TABLES
        DATA_TAB                        = xml_table
      FIELDNAMES                      =
    EXCEPTIONS
       FILE_WRITE_ERROR                = 1
       NO_BATCH                        = 2
       GUI_REFUSE_FILETRANSFER         = 3
       INVALID_TYPE                    = 4
       NO_AUTHORITY                    = 5
       UNKNOWN_ERROR                   = 6
       HEADER_NOT_ALLOWED              = 7
       SEPARATOR_NOT_ALLOWED           = 8
       FILESIZE_NOT_ALLOWED            = 9
       HEADER_TOO_LONG                 = 10
       DP_ERROR_CREATE                 = 11
       DP_ERROR_SEND                   = 12
       DP_ERROR_WRITE                  = 13
       UNKNOWN_DP_ERROR                = 14
       ACCESS_DENIED                   = 15
       DP_OUT_OF_MEMORY                = 16
       DISK_FULL                       = 17
       DP_TIMEOUT                      = 18
       FILE_NOT_FOUND                  = 19
       DATAPROVIDER_EXCEPTION          = 20
       CONTROL_FLUSH_ERROR             = 21
       OTHERS                          = 22
    IF SY-SUBRC <> 0.
    MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
             WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
    ENDIF.
    Thanks in Advance,
    Neha

    hi
    good
    go through this link
    http://help.sap.com/saphelp_nw04/helpdata/en/bc/bb79d6061007419a081e58cbeaaf28/content.htm
    thanks
    mrutyun^

  • A user uploads a new pdf (using Dreamweaver) but still gets the old version back in browser.

    She downloads the file from the site, and gets the old version of the file instead of the one she just uploaded. I tried it myself and everything is done correctly: the new file is on the server but download keeps displaying the old version. Dreamweaver ticks off the bytes as they are going upstream. I can RDP to the server and see that the newer version is there (by datetime stamp). She is using IE 8 if relevant.
    This only happens with pdf, no caching is turned on in IIS6 - all content updates are instant.
    I have gone in to the temp internet files and deleted the cached version of the file and emptied the trash (Win XP) but it still serves the old version.
    This issue has been reported by other users, but I thought it was user error until it was staring me in the face.
    My final verification was to upload the new document with a new name, delete the old document, and rename the new name to the old name - after that it delivered the new document
    How do I tell the (non-tech) user fix this?
    I've seen references to this on other sites (now that I know it is real, I dug deeper) but the solutions proposed mostly seem to involve changing the query string by adding somthing to the end of it.
    This is out of reach of my user.
    I can't be the first person to encounter this right?
    And note that I went into the server... the document was uploaded, and IIS caching is off.
    I was told by someone here (and I can't reproduce it in my office) that I should tell the user to go to Adobe Reader | Edit | Preferences | Internet.
    Then tell her to uncheck all three boxes (display in browser, allow fast, and allow speculative)
    But I don't see how that would fix it - remember that I deleted the pdf from the internet cache and that didn't solve it.
    Thanks,
       -Chris C. 1972

    I've faced this before too.
    I've tried many different approaches but the most reliable way I've ever found of handling it is to rename the new PDF each time (e.g. adding the revision date into the filename) and update the link in the web page to point to the renamed PDF.
    Works every time.
    Chris C. 1972 wrote:
    I was told by someone here (and I can't reproduce it in my office) that I should tell the user to go to Adobe Reader | Edit | Preferences | Internet.
    Then tell her to uncheck all three boxes (display in browser, allow fast, and allow speculative)
    But I don't see how that would fix it
    Nor me.

  • Identify UTF-8 and UTF-16 formats

    hi,
    Clients submit there unicode messages (arabic,telugu etc langs) in hex format then our application accepts that message and process it.
    But there are many tools in the market which will convert the unicode to UTF-8 and UTF-16 formats.
    so i need to idetify whether the message is in
    UTF-8 or
    UTF-16 or
    hex(no problem)
    something like
    isUTF8(String message)
    isUTF16(String message)
    so that i can convert them back to hex and dump it into database.
    regards
    Heral raj

    You can identify whether it is UTF16 or UTF8 by looking at it's BOM (byte order mark). These are first 2 bytes of the stream.
    Check this link http://www.websina.com/bugzero/kb/unicode-bom.html
    I do not think implementation should be a problem
    Thanks
    Gaurav

  • I cannot find information to help me change the orientation of a video filmed in portrait format but only able to be played back lying on its side  (landscape) instead of upright. All the rotation buttons for iPhoto are not 'engaged' when it is in video .

    I cannot find information to help me change the orientation of a video filmed in portrait format but it can only able to be played back lying on its side  (landscape) instead of upright. All the rotation buttons for iPhoto are not 'engaged' when it is in video .

    Thanks OT,
    I tried the Export function but it would not allow me to choose the option of exporting to iMovie. I think you are right about needing Quicktime Pro. I opened iMovie and imported the clip from iPhoto and with some searching found the 'cropping, rotation' mechanism. So I now have a copy in the correct orientation. I plan to import/export it back to iPhoto because I want to have a copy on my iPhone to show people and I wanted to have it available as part of a slideshow I am making in iPhoto of my recent overseas trip. It is a pain that there is no simple orientating tool for the movie clips downloaded to iPhoto with the photos from the one camera.

  • Create new text file in UTF-8 format by default

    I'm working a lot with UTF-8 text files and mainly in this format. It's becoming annoying when I have to manually save every text file as UTF-8.  After several trial-and-errors, I've made up a procedure that I've put in a blog. I think I could share
    it here for those who need it.  Hope it helps.
    http://instrumenti-meliora.blogspot.com/2014/04/create-new-text-file-in-utf-8-format-by.html

    You've made a procedure?
    Are you sure you didn't :
    Didn't what?
    https://www.google.com/#q=change+notepad+default+encoding
    Well, I'm not sure what you want me to see, but your search keywords do
    NOT make sense.  You do note change *Notepad* default encoding.  What you can change is a
    TEXT file's default encoding.
    Well, of course, if you have access to Notepad source code and you're able to change it and re-compile again, then you could really say you change Notepad's "default encoding", which I suppose would mean "default encoding every time we save".
    Why wouldn't you just provide a link (or some attribution) to the top result
    http://answers.microsoft.com/en-us/windows/forum/windows_7-windows_programs/default-utf-8-encoding-for-new-notepad-documents/525f0ae7-121e-4eac-a6c2-cfe6b498712c
    or a link to watch this done on youtube?
    http://www.youtube.com/watch?v=GnL6smxQE9k
    The title of that forum post and Youtube video is a non-sense.  New
    "Notepad" document?  Come on!  That's apparently how a newbie think what it is and it's very likely he has not a clue what it is and what he is doing.  And what if I don't use Notepad to create such file?  If I
    use UltraEdit, then mine should be "UltraEdit" document and that should be different from Notepad document, correct? LOL
    The fact that you're able to find this video would also mean you're thinking like him in that the file is really called Notepad document LOL
    For your information, that's called a text file (or document if you prefer this prettier term).  It's also called plain text file.
    Now, let's see the content of both links:
    First of all, why did they tell people to create a new text file somewhere and then
    COPY it to template folder?  That's really so dumb
    LOL  Isn't it more intelligent to create such file directly INSIDE the folder?
    Secondly, their procedures are not foolproof.  What if the Windows directory is not c:\windows?  They should tell people to open %Systemroot%\ShellNew instead.  I suppose they don't even know how this folder is called because
    nowhere is the term "template folder" ever mentioned.
    Thirdly, what if that folder doesn't work for unknown reason (which might happen in XP)?  Did they give any hint to a "failover" folder?  No, they didn't.  But I do in my procedure.
    Fourthly, they are saying as if the file name has to be "TXTUTF-8.txt", but actually we can call it whatever we like.  But smart people would have figured this out at the end.
    5 (I'd stop saying fifthly and so on LOL) I'm not sure it's necessary (or recommended) to change "fSavePageSettings" & "fSaveWindowPositions" DWORD values for Notepad as "advised" in that answer.
    As a side-note, I don't know what
    http://www.pc1news.com/saving-changes-to-notepad-configuration-1216.html is supposed to give but when I open this, I got some uTorrent warning.  Really seems like some malware webpage which tries to deceive people!
    I actually searched how a (generic) new file is created and started from there.
    So, maybe next time when you want to criticize or discredit somebody else, try to be more expert first? ;)

  • Files placed were not in UTF-8 format

    Hi Experts,
    In our project we have a pass through(no IR part) Interface from Source -
    >>PI -
    >>Target(where both Source and Target are File servers).PI should pick the file and place it in Target Directory by converting into UTF-8 format.For this we used File Type as Text and File Encoding as UTF-8 in the Receiver File channel.
    Recently the Target file server migrated to UNIX OS from WINDOWS OS and nothing was changed in PI but after the migration the Target system is facing an error saying "File is not in UTF-8 format"
    Previous when the OS is windows PI placed the files in UTF-8 format only but now after the OS migration to UNIX PI is placing ANSI files eventhough we are maintaining File Type as Text and File Encoding as UTF-8 in the Receiver File channel.
    Can anyone say how to overcome this problem and convert the files into UTF-8 and place in the Target Directory.
    Thanks and Regards,
    Prajwal Kumar

    Hi Shabarish,
    Can you please explain a bit more about issue with the line feeds.
    and also please let me know what should I check with the end system.
    Will the module help us to convert the file into UTF-8 format..?
    Thanks for your reply.
    Regards,
    Prajwal

Maybe you are looking for