Store Asymmetric Key Container In Load Balanced Cloud Environment

Question

I've been tasked with signing some data with the
RSACryptoServiceProvider.SignData() Method. In order to generate the public and private key i've used the RSACryptoServiceProvider and passed a keycontainername in order to store the keys safely. 
When i run the MSDN example
to generate a set of public/private keys on my machine with the fixed keycontainername, the expected public / private keys are generated every time the same. 
This will work fine on a single server environment, however, we are operating on an elastic environment where the servers are load balanced. If i encrypt the data with a private key on any one single machine and store this data in through the RSACryptoServiceProvider
the data will only exist at the machine level. Each machine will use a different key to sign the data and the user of the public key won't be able to verify the signature. 
Is it that important that i use the RSACryptoServiceProvider to store the private key, the example is explicit in that i should never store the key in a text file but why is this more of a risk than storing the keycontainername in a text file? 
Thanks 
Aaron

Answer 1

Yes, It is important. Per my understanding, there is a X509Certificate2 class to create RSACryptoServiceProvider to get a private key. The certificate and private key itself would be kept in the
Windows certificate store. You can then limit access to the private key through the certificate store to certain accounts.