Spark Cluster not in HDInsight like in Amazon Web Services

Can a Spark Cluster be created in Azure?
VM's and storage that will be controlled from Spark and not be part of a HDinsight deployment.
Thanks,
Marc

Hi,
Thanks for posting here.
Spark is introduced on Azure HDInsight. Please refer this article for more details.
http://azure.microsoft.com/blog/2015/03/16/how-to-install-spark-1-2-on-azure-hdinsight-clusters/
http://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-spark-install/
Hope this helps you.
Girish Prajwal

Similar Messages

  • FMS on Amazon Web Services License. Does it need enter License(Serial Key)?

    FMS on Amazon Web Services License. Does it need enter License(Serial Key)?
    After Subscribe on adobe.com(Adobe Flash Media Server 4.5 on Amazon Web Services)
    I build the Amazon EC2 successfully.
    In amazonpayments, the amazon show me an Activation Key.
    On  Application Activation:
    The screen give me following information.
    Generate an Amazon Activation Key  
    An activation key may be required as part of an application's registration process. If your application requires it, follow the steps below:
    Step 1: Click on the Generate Key link to generate an activation key for an application.
    Step 2: Copy the activation key.
    Step 3: Click on Go to Application to access the application.
    Step 4: Paste the activation key if and where the application specifies.
    But in Adobe Flash Media Administration console, It is missing the License(Serial Key)
    Does it need enter License(Serial Key)?
    How can I use the  Activation Key?

    Hi,
    This Activation Key is only for identification purposes. In most cases, you will not have to use it. Once you subscribe to FMS on AWS, you are ready to go and use FMS AMI's.
    Also, FMS on AWS does NOT require any License or Key. It works on a separate Licensing model.
    Thanks!

  • Persisting legal FMS 5.0 licenses on Amazon Web Services through future up-sizing?

    I am running the developer version Flash Media Server 5.0.1 (Windows) on a x64 Amazon Web Services small instance VM. The starter AMI for the server was one of the stock AMIs built by Amazon.
    I have a shiny new license for FMS Professional but not yet applied to FMS.
    I want to apply the license now and continue running as a small instance until I need more performance. Eventually I will want to gradually and periodically up-size it to increasingly larger AWS instances.
    Is this possible with the FMS license?
    Will I have any issues of invalidating the license because the underlying hardware configuration changes?
    What will I need to do to ensure that I can upsize the same server (not create a new one) without invalidating the FMS license?
    What other issues should I know about that I am too ignorant to ask?
    Thanks,
    Ken

    I understand that I must terminate one instance.
    I am not trying to run two instances (virtual computers) with a single AMS license.
    Are you saying that I can freely "move" the license from one instance to another as long as the license is applied to only one instance (server) at a time?
    I need to know if changing the number of virtual cpus and/or the ram will invalidate the AMS license activation.

  • Crystal Reports on AWS(Amazon Web Services)

    Hi All,
    Can someone share there experiences or Insights on Installtion/Migration of Crystal Reports on AWS(Amazon Web Services Cloud).
    I have a requirement of Installation and Migration of about 100 Crystal Reports on AWS.
    Thank you in Advance.
    Regards,
    Nachiket

    Thank you for the update Shreejith and Dell.
    @Dell: My requirement is to Install Crystal Reports Server on AWS and also my reports will be running off the database on AWS.
    I wanted to know if there are any specific settings that need to be done with regards to AWS.
    This KBA also helps :
    1588667 - SAP on AWS: Overview of related SAP Notes and Web-Links
    After researching a bit I came across the below Information:
    Build your own SAP environment on AWS
    AWS and SAP have collaborated to offer customers options and convenience when deploying SAP applications in the cloud. Customers can now license SAP applications to run in the AWS cloud computing environment from an authorized SAP reseller, or use their existing SAP software licenses on Amazon EC2, with no additional SAP license fees. AWS cloud infrastructure services can be purchased directly from AWS or through one of our Resellers. SAP software licenses are sold directly by SAP or their affiliated channel partners. System integration, deployment, and hosting services are available through SAP partners and AWS Solution Providers.
    The following are the steps required to get started building your own SAP environment on AWS:
    Step 0: Planning
    In order to properly size and configure SAP solutions on Amazon Elastic Compute Cloud (EC2) instances, customers should follow these guidelines established by SAP and AWS
    Use the SAP Quick Sizer
    Follow the technical guidelines outlined in SAP Note 1588667
    Step 1: New to AWS?
    Sign up for an AWS Account
    Read the Getting Started with AWS Guide
    Step 2: Implement the Required Compute, Storage, and Network Resources
    For detailed information and best practice guidelines on the steps necessary to implement SAP solutions on the required AWS infrastructure for an SAP environment please read the Implementing SAP Solutions on AWS Guide.
    Step 3: How to Install/Deploy SAP Solutions
    The AWS Management Console provides an easy-to-use graphical interface to manage your compute, storage, and other cloud resources. Most AWS products can be used from inside the console, and the console supports the majority of functionality for each service.
    To begin to install SAP software on Amazon EC2 start with a base Windows Server, SUSE Linux Enterprise or Red Hat Enterprise Linux system image and then install the SAP software just as you would on any physical or virtual server.
    Automate your deployment or launch directly into your AWS account using the SAP HANA on the AWS Cloud Quick Start Reference Deployment, which serves as a reference and provides architectural considerations and configuration steps necessary for deploying SAP HANA on AWS utilizing a “Bring Your Own License (BYOL)” scenario.
    Step 4: Run SAP Solutions on AWS
    Now that you have installed the software on the AWS cloud, there are special considerations that need to be taken into account to run SAP solutions on AWS.
    The SAP on AWS Operations Guide
    The http://d0.awsstatic.com/enterprise-marketing/SAP/sap-on-aws-backup-and-recovery-guide-v2-2.pdf
    Regards,
    Nachiket

  • TS4055 How do I use my MacBook Air to access the Amazon Web Service?

    How do I use my MacBook Air to access AWS (Amazon web Service)?  The information provided to me by Apple Care seems to be about allowing outside access to my MacBook.

    Sorry, but does this relate to Apple Remote Desktop, Apple's software for managing networked Macs, in some way? If so, how are you using ARD in relation to Amazon's services?

  • How do I use Adobe Media Server 5 on Amazon Web Services?

    Adobe Media Server 5 on Amazon Web Services was suggested to my project manager as a way to deal with some of the video we have to host at work, but after signing up and poking around, I'm wondering: how do you actually use it? Is it something that requires the Media Server software, or is there a web interface through AWS? I follow the links, and they tell me it's already active for my account - but I still see no way to use it.
    Thanks in advance for help on this seemingly remedial question!

    Hi,
    Please have a look at the document and let me know if it helps you get started: http://help.adobe.com/en_US/adobemediaserver/amazonec2/adobemediaserve r_5.0_amazonec2.pdf
    Thanks,
    Apurva

  • Migrate oracle database to Amazon web services

    Has anyone migrated an existing oracle database 11g or higher to the AWS  Amazon web services ?
    I don't believe we can use AWS's RDS Oracle service so we would have to customize it.
    We are presently on a linux server and use Oracle Flexible Arch. 
    How do you tell/set AWS to replicate the file names and directory that oracle would use?
    Appreciate any tips or documents that you can point me to.

    Hi,
      You should also ask this question in the RDBMS forum -
    General Database Discussions
    Regards,
    Mike

  • MySQL RDS in Amazon Web Services with EM12c

    I have MySQL RDS in Amazon Web Services.  Can I setup monitoring in EM12c for that?  My version of EM12c is 12.1.0.4 and my version of MySQL is 5.6.22

    Hi,
    This question was asked in the Oracle Portal Community.  It has been moved to the Enterprise Manager Community.
    Thanks,
    Phil

  • Amazon Web Service

    Hi,
    I have to write a java application for Amazon web service. It has to send the ISBN number of a book and receive the lowest selling price.
    I am a good java programmer but never used web services before. Familar with XML (parsing).
    1. Could anyone please give me a rough estimate of how long it would probably need to implement that?
    2. Which software packages will I need? Is Tomcat really necessary?
    Any help is deeply appreciated!
    Richy

    If the Amazon Web Service has a pubclished WSDL, you can use tools such as JAX-WS (http://jax-ws.dev.java.net) to do most of the work for you.

  • Not able to registred the external Web service on CF8

    I am not able to registred the external Web service on CF8 (Error creating web service. Please ensure that you have entered a correct Web Service name or URL.), but same Web service has no problem on CF6.1

    Hi,
    Please close this duplicated thread.
    Thanks & Regards,
    Nagarajan

  • Is there a tutorial for hosting CF on Amazon web services?

    I'm interested in a getting started tutorial.  I know Coldfusion but don't know the hosting process with Amazon.

    Either of these might help:
    http://www.adobe.com/devnet/coldfusion/articles/coldfusion-cloud-aws.html
    http://www.adobe.com/au/products/coldfusion-amazon-web-services.html
    Regards, Carl.

  • Itemsearch - Amazon Web Service

    Dear all,
    I am a beginner of Java and Web service and encountered some problems while doing my school project. when I using Netbeans 5.5 to created a new Web Service Client (Amazon Web Service) and try to use its ItemSearch operatoion. I found I don't know how to convert "ItemSearchRequest" to a List, could anyone help as the project deadline is coming.
    NetNBeans generated following codes for me:
    ===================================================
    org.bos.project.client.AWSECommerceService service = new org.bos.project.client.AWSECommerceService();
    org.bos.project.client.AWSECommerceServicePortType port = service.getAWSECommerceServicePort();
    // TODO initialize WS operation arguments here
    java.lang.String subscriptionId = "";
    java.lang.String associateTag = "";
    java.lang.String xmlEscaping = "";
    java.lang.String validate = "";
    org.bos.project.client.ItemSearchRequest shared = null;
    java.util.List<org.bos.project.client.ItemSearchRequest> request = null;
    javax.xml.ws.Holder<org.bos.project.client.OperationRequest> operationRequest = null;
    javax.xml.ws.Holder<java.util.List<org.bos.project.client.Items>> items = null;
    port.itemSearch(subscriptionId, associateTag, xmlEscaping, validate, shared, request, operationRequest, items);
    ========================================================
    I shall input my search papameter at "request" then convert it to a java.util.List and pass it to port.itemSearch(). Am I correct and how can I convert this.
    Regards,
    Kan

    Actually, my bad. It works quite well. I will post what I was asking for soon.
    Thanks
    Manish

  • Is Flash Media Server available as an AMI in Amazon Web Services' new Sydney region?

    Is Flash Media Server available as an AMI in Amazon Web Services' new Sydney region?
    Thanks,
    Blake

    Any ETA on this??? Currently using Flash Media Server on EC2 in Singapore. Would love to know when I'll be able to use in Australia

  • "File Not Found" when addCourse through iTunesU web service.

    I have problem to add Course to my institute's iTunesU site through Web Service.
    I was able to get the xml doc back through showTree operation and here is part of it:
    <Site>
    <Name>my institute's name</Name>
    <Handle>123</Handle>
    <AggregateFileSize>63057465318</AggregateFileSize>
    <Section> <Name>Your Classes</Name>
    <Handle>456</Handle>
    <AggregateFileSize>57423912007</AggregateFileSize>
    <Course>
    <Name>course 1</Name>
    <Handle>111</Handle>
    </Course>
    </Section>
    <Section>
    I was able to get the uploadURL back too. The URL to get the uploadURL request:
    https://deimos.apple.com/WebObjects/Core.woa/API/GetUploadURL/myInstitute.edu.45 6?type=XMLControlFile
    The uploadURL I got back looks like:
    https://deimos2.apple.com/WebObjects/Files.woa/Upload/myInstitute.edu.456/X_1371095208_1a.43c06fa3.467dc4f2/%5Banonymous1371095208%5D/0046e71254900a071aa9241221a469d98ff1ef6fa973544c45ef9 5260dac6c64f05b10aefc
    But when I use the uploadURL above and post the addCourse.xml:
    <ITunesUDocument>
    <AddCourse>
    <ParentHandle>456</ParentHandle>
    <Course>
    <Name>Jing Test iTunesU Web service Course</Name>
    <ShortName>Jing Test</ShortName>
    </Course>
    </AddCourse>
    </ITunesUDocument>
    The response I got
    <error>File Not Found</error> File Not Found
    I used myInstitute.edu.456 to get the uploadURL and set it to ParentHandle on addCourse.xml since 456 is the section handler in whoch I want to add the course.
    I tried to remove 456 from the myInstitute.edu to get the uploadURL and then use it to add course, got the same error.
    Is there something wrong with the URL I used to get the uploadURL?
    here is the code and the values pass to the methodI used to send addCourse request:
    url = uploadURl on above
    name="file"
    fileName="file.xml";
    data=addCourse xml on above
    contentType="text/xml"
    public String invokeAction(String url,
    String name,
    String fileName,
    String data,
    String contentType) throws MessagingException {
    // Send a request to iTunes U and record the response.
    StringBuffer response = null;
    System.out.println("xml doc: ---" + data);
    try {
    // Verify that the communication will be over SSL.
    if (!url.startsWith("https")) {
    throw new MalformedURLException("ITunesUFilePOST.invokeAction(): URL \""
    + url + "\" does not use HTTPS.");
    // Build the multipart data.
    MimeMultipart multipart = new MimeMultipart();
    MultipartFormBuilder.addMultipartFormBody(multipart,
    name,
    fileName,
    data,
    contentType);
    // Create a connection to the requested iTunes U URL.
    HttpURLConnection connection =
    (HttpURLConnection) new URL(url).openConnection();
    connection.setUseCaches(false);
    connection.setDoOutput(true);
    connection.setRequestMethod("POST");
    connection.setRequestProperty("Content-Type",
    "multipart/form-data; boundary="
    + MultipartFormBuilder.getMultipartBoundary(multipart));
    String multipartData = MultipartFormBuilder.getMultipartData(multipart);
    // Send the multipart data to iTunes U.
    connection.connect();
    OutputStream output = connection.getOutputStream();
    output.write(multipartData.getBytes("UTF-8"));
    output.flush();
    output.close();
    // Read iTunes U's response.
    response = new StringBuffer();
    InputStream input = connection.getInputStream();
    Reader reader = new InputStreamReader(input, "UTF-8");
    reader = new BufferedReader(reader);
    char[] buffer = new char[16 * 1024];
    for (int n = 0; n >= 0;) {
    n = reader.read(buffer, 0, buffer.length);
    if (n > 0) response.append(buffer, 0, n);
    // Clean up.
    input.close();
    connection.disconnect();
    } catch (UnsupportedEncodingException e) {
    // ITunes U requires UTF-8 and ASCII encoding support.
    throw new java.lang.AssertionError("ITunesUFilePOST.invokeAction(): UTF-8 encoding not supported!");
    } catch (IOException e) {
    // Report communication problems.
    throw new java.lang.AssertionError("ITunesUFilePOST.invokeAction(): I/O Exception " + e);
    // Return the response received from iTunes U.
    System.out.println("response from ITunesUFilePOST: " + response.toString());
    return response.toString();
    }

    I'm having a similar "File Not Found" error, but it's happening for any API request other than GetUploadURL. I'm sending a POST request to the GetUploadURL, and that part is working correctly, as I get a URL such as the following:
    https://deimos2.apple.com/WebObjects/Files.woa/Upload/wvu.edu/X_1372071795_4d9433be.4c3fdd3d.4c3fdd3e/%22Chris%20Scharf%22%20%3Ccbscharf%40mail.wvu.edu%3E%20%28cbscharf%29%20%5B3258 7%5D/0046eaaaf078cf5d6b60f18926106a50a5050cf8f9c91a7608074e6d2949a8759017969ece
    Then, I've tried using curl (within 90 seconds) to submit a simple XML document containing a ShowTree request:
    <?xml version="1.0" encoding="UTF-8"?>
    <ITunesUDocument>
    <ShowTree>
    <KeyGroup>most</KeyGroup>
    </ShowTree>
    </ITunesUDocument>
    The command executed is "curl -F file=test.xml URL" (where URL is the URL retrieved from GetUploadURL. But I simply get "<error>File Not Found</error>"
    I'm correctly sending credentials, since I'm getting upload URLs. And it's not an issue with the XML document, since it's not even getting to the server.

  • Amazon Web services

    Has any one been able to create a web service for Amazon?
    When I enter the WSDL location:
    http://webservices.amazon.com/AWSECommerceService/US/AWSECommerceService.wsdl
    I get the following Error:
    The WSDL document could not be understood by the HTML DB engine.
    I'm looking for any help/workarounds.
    I'm on version 1.6.1.00.03 of HTML DB
    Thank you

    No one have any luck with this?

Maybe you are looking for