RemoteFX configured and running - but still very slow

Question

Hello!
The goal:
To install and test RemoteFX performance before purchase expensive server/vga.
The success so far:
installed and configured Windows 2008 R2 SP1 with Hyper-V
installed and configured Windows 7 Enterprice SP1 virtual machine with RemoteFX video adapter enabled
running Windows 7 SP1 client with the supported version (7.1) RDP
successful RDP connection and confirmed RemoteFX running (the shut down button + event with ID:2 on the VM and so on)
no errors/warnings in the event viewer, RDP client is 10mbit or more etc.. all settings seems to be perfect.
The hardware used (I know it's not a real server, but the idea is to "feel" the RemoteFX performance before purchase and for a single VM it's quite enough):
AMD 6800k (SLAT enabled) cpu
nVidia GTX560 1G GDDR5 (also tested with ATI R7 240 2G)
8g DDR3 2400mhz memory
The problem:
The performance is.. let say the same as with the normal RDP connection. Pretty much no difference.
I checked almost every problem on the internet related to the RemoteFX, but without a single log/message I just can't do more.
The VGA is not Quadro/FirePro.. but from what I saw, the people are just using normal cards without any problems and for test purposes should be fine.
I also tried to install the cap driver (dism / ...), without any difference (actually I'm not 100% sure that this is needed, can someone explain?).
I'll be happy if someone can point me the way I can "debug" it.
Best!

Answer 1

So I was typing out a long detailed reply indicating how I was seeing exactly the same issues, and why I was pretty sure it was happening for all of us.
However, it now appears that I've been able to get it up and running pretty well. Like the OP, I am simply using desktop hardware at first to test it out but here's what I'm working with:
Windows Server 2012R2 with 8.1 Enterprise VM connecting using an 8.1 Pro machine.
AMD FX-8150
16GB DDR3
120GB SSD
Radeon HD6950 - 1GB
Asus M5A99X EVO R2.0 Motherboard
When I was seeing the issues you all are seeing, it was when RemoteFX was working fine. This was verified by dxdiag and openhardwaremonitor on the server itself watching the GPU utilization rise while rendering the fishbowl.
However, another thing I noticed was that due to the AMD software of desktops (what I have installed on the windows server itself), the CPU and GPU both clock down to conserve power. Because of this, the one VM wasn't enough to raise them both to max. Once
I forced the CPU and GPU to both stay at max frequency, everything runs pretty amazingly. VM is using 4 cores, No limit on RAM (hits about 4GB max), vGPU is set to 3 monitors at 1920x1080, and a 35GB chunk of the SSD. Here's what I see now:
HTML5 Fishbowl - Fullscreen at 1680x1050 on Auto makes it to 250 fish at 60FPS
HTML5 Fishbowl - Windowed at about 1/3rd size Auto makes it to 850 fish at 60FPS
Borderlands 2 - Able to install, use XBOX controller with USB Passthrough at about 25FPS at 1280x1024.
I would also like to point out that the biggest bottleneck it seems is actually the VM's ability to encode the data stream sending to the client at the far end. Evidence of this is shown by just taking a window and placing it over the fishbowl (I used the
task manager). Once you cover some of the fish, you'll see the framerate go up fairly significantly. (since not as many pixels are changing, and so there's less traffic to send).
Anyway, just thought I'd share! Hope you're all doing better on this!