Can't show content of Invoke-WebRequest in Unicode

Question

I am trying to get Japanese web pages through  Invoke-WebRequest but the contents get garbled in Console.
PS> $JP_MSSITE = Invoke-WebRequest http://www.microsoft.co.jp
PS> $JP_MSSITE.ParsedHtml.title
a?\a?￢a??a??a?￣a?-a??a??a??a??Microsoft Japan: a??a??a??a?|a?§a?￠, a?aa?3a?ca??a?3, a?1a??a??a??a??a?ca?3, a?μa??a??a??, a?≫a?-a?\a?aa??a?￡, a?€a?|a?3a?-a??a??, a?￠a??a??a??a??a??, a??a??a??a?1a?¨a?μa??a??a?1
PS>
http://www.microsoft.co.jp is encoded in UTF8.
The tile has "日本マイクロソフト..." which should be "97e6e6a5ac9c83e3e39ea48282e3e3af.."  in UTF8 bytes.
$JP_MSSITE.ParsedHtml is not even in Unicode(UTF-16) which should be "65e5672c30de30a430af30ed30bd30d530c8.." for "日本マイクロソフト..."
PS > [Convert]::ToString([Convert]::ToByte($JP_MSSITE.ParsedHtml.title[0]),16)
e6
PS > [Convert]::ToString([Convert]::ToByte($JP_MSSITE.ParsedHtml.title[1]),16)
97
PS > [Convert]::ToString([Convert]::ToByte($JP_MSSITE.ParsedHtml.title[2]),16)
a5
PS > [Convert]::ToString([Convert]::ToByte($JP_MSSITE.ParsedHtml.title[3]),16)
e6
What am I doing wrong

Answer 1

Hi,
It's a bit of a roundabout way of doing it but you can convert the page to bytes and then back in to text using the [text.encoding] accelerator:
$JP_MSSITE = Invoke-WebRequest -ContentType "text/xml;charset=utf8" http://www.microsoft.co.jp
$con = $JP_MSSITE.ParsedHtml.title
$la = [system.text.encoding]::UTF8.GetBytes($con)
[text.encoding]::Unicode.GetString($la)
Produces:
ꛃ韂ꗂꛃ鳂곂ꏃ菂黂ꏃ苂꓂ꏃ苂꿂ꏃ菂귂ꏃ苂뷂ꏃ菂闂ꏃ菂裂ꋃ铂苂楍牣獯景⁴慊慰㩮쌠슣슂쎽슣슃쎕슣슃쎈슣슂쎦슣슂쎧슣슂Ⲣ쌠슣슂쎪슣슃쎳슣슃쎩슣슂쎤슣슃ⲳ쌠슣슂쎹슣슃쎞슣슃쎼슣슃쎈슣슃쎕슣슂쎩슣슃ⲳ쌠슣슂쎵슣슃쎝슣슃쎼슣슃Ⲉ쌠슣슂쎻슣슂쎭슣슃쎥슣슃쎪슣슃쎆슣슂ⲣ쌠슣슃쎀슣슂쎦슣슃쎳슣슃쎭슣슃쎼슣슃ⲉ쌠슣슂쎢슣슃
쎃슣슃쎗슣슃쎇슣슃쎼슣슃Ⲉ쌠슣슃쎇슣슃쎐슣슂쎤슣슂쎹슣슁쎨슣슂쎵슣슃쎼슣슃쎓슣슂
It might need tweaking a bit to get exactly what you are after though.