Is HDInsight only available on Azure

We are exploring Hadoop for processing of web click related data. We use Microsoft products so I wanted to find if HDInsight from Microsoft is only available on Azure or can you set this up on your local servers.
Secondly if we are able to setup Hadoop (from Apache) on our windows server can we still use the .Net SDK for Hadoop to develop our MapReduce jobs.
Thanks

Hi,
HDInsight is only available as a service in Azure. Microsoft offers an
emulator for HDInsight which is for Windows on premise, but that is a single node HDInsight setup. As the name suggests, the emulator is for testing/evaluation purposes as Azure services incur some cost.
HDInsight uses Hortonworks Data platform (HDP) internally to deploy the hadoop stack. If you require a multi-node on premise hadoop cluster on Windows, you can use
HDP.
Hadoop Streaming is a facility for writing map-reduce jobs in the language of you choice. So, you can use the .NET SDK to develop and submit MR jobs to your Apache hadoop cluster via Hadoop Streaming. Hadoop API for .NET is a wrapper to Streaming that provides
a convenient experience for .NET developers. An understanding of the concepts and general functionality provided by Hadoop Streaming is necessary for successful use of this API: see http://hadoop.apache.org/common/docs/r0.20.0/streaming.html for this background
information.
Regards.
Debarchan Sarkar - MSFT ( This posting is provided AS IS with no warranties, and confers no rights.)

Similar Messages

  • SSAS High Availability in Azure (not SQL DBE)

    Hello,
    I was wondering what would be my options for having an SSAS environment with High Availability in Azure?
    Please refrain from mentioning HA solutions for the SQL Database Engine itself - that is
    not the issue at hand.
    The issue is that as far as I know (and please correct me if I am wrong), the only way to provide SSAS HA is through clustering that involves share storage -- which is not available in Azure.
    So I was wondering if anyone has come across such requirement before and if there are any sort of novel/original solutions
    (thinking outside the box).
    Regards,
    P.

    Hi Pmdci,
    According to your description, you need implement SSAS environment with High Availability in Microsoft Azure, the problem is that you need to use share storage in this environment which is not available in Azure, right?
    Based on my research, a clustered implementation of SSAS can be configured in Microsoft Azure.
    A clustered implementation of SSAS can also span from on premises to Azure (or any qualified cloud) if networking is properly configured so that the nodes on premise and in the cloud can see each other, talk to Active Directory, and access storage.
    http://azure.microsoft.com/en-in/documentation/articles/storage-dotnet-how-to-use-files/
    Regards,
    Charlie Liao
    If you have any feedback on our support, please click
    here.
    Charlie Liao
    TechNet Community Support

  • Music downloads to iPod Nano from songs that are only available in iCloud.

    I'm trying to add music to my sons iPod Nano that myself and my older son have on our iPhone and iPod touch. When I try to copy these songs over to the Nano it tells me it cannot be copied because it is only available in iCloud. It then states I need to download the items from iCloud before they can be copied to the iPod. How to I download songs from iCloud that are currently showing in my music library?

    See these previous discussions:
    https://discussions.apple.com/thread/5611266?tstart=0
    https://discussions.apple.com/thread/5711119
    https://discussions.apple.com/thread/5693855?tstart=30
    https://discussions.apple.com/thread/5397140

  • I have a annual plan, it supposed must be used in two terminals, but i haven´t been able to install any app in a second computer, it always says that the app is only available as a trial download. What can I do to solve this issue, and be able to use my p

    I have a annual plan, it supposed must be used in two terminals, but i haven´t been able to install any app in a second computer, it always says that the app is only available as a trial download. What can I do to solve this issue, and be able to use my paid plan in two computers?

    Hi Susan,
    Please refer to the help document to fix this issue:
    Creative Cloud applications unexpectedly revert to trial mode | CS6, CCM
    You may also refer to the thread as below:
    creative cloud software says my free trial has expired, but I have a paid subscription
    Regards,
    Sheena

  • I am using a work laptop and have the same problem. When I try to change the "configure proxy", they only available option is "use this proxy server for all protocols". Could it be that my system administrator blocked me from changing it since they don'

    I am using a work laptop and have the same problem. When I try to change the "configure proxy", they only available option is "use this proxy server for all protocols". Could it be that my system administrator blocked me from changing it since they don't want us to use Firefox.
    == User Agent ==
    Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6.4; FNGP_SYS)

    Start Firefox in [[Safe Mode]] to check if one of your add-ons is causing your problem (switch to the DEFAULT theme: Tools > Add-ons > Themes).
    See [[Troubleshooting extensions and themes]] and [[Troubleshooting plugins]]
    If it does work in Safe-mode then disable all your extensions and then try to find which is causing it by enabling one at a time until the problem reappears.
    You can use "Disable all add-ons" on the ''Safe mode'' start window.
    You have to close and restart Firefox after each change via "File > Exit" (on Mac: "Firefox > Quit")

  • I signed up for my apple account while living in Canada, and now I lives in the US. I am looking for a specific app that apparently is only available through the US app store. How can I change my account to the US Apple Store?

    I signed up for my apple account while living in Canada, and now I lives in the US. I am looking for a specific app that apparently is only available through the US app store. How can I change my account to the US Apple Store?

    As long as you have a form of payment (credit or debit card) with a USA source, and with a billing address in the USA, then you just need to change your payment information on your account to that, change your country in the store settings, and you will then be able to shop in the USA store.
    Your AppleID will work in any country's store, as long as your payment source and billing addres are also specific to that country (and you are in that country as well, as there may be IP filters in place to stop use outside of the country).

  • Is it possible for someone in the UK to gift me, someone in the US, a show that is only available in the UK?

    I'm pretty desperate to watch this show that is only available in the UK iTunes Store. Is this a plausible solution to my problem, since I live in the US and can't make purchases from the UK store?

    Sorry... Not possible.

  • Syntax error: annotations are only available if source level is 5.0

    In eclipse, I am trying a hello world JMS tutorial.
    In the code below, it doesn't like the @ sign for some reason... And I don't know how to make it happy....
    It give this error:
    Syntax error: annotations are only available if source level is 5.0
    --------------code------------
    public class MessageSender {
       @Resource(mappedName = "jms/GlassFishBookConnectionFactory")
       private static ConnectionFactory connectionFactory;
    Here is my path if that helps.
    Path=C:\oracle\product\10.2.0\client_1\bin;C:\Program Files (x86)\Java\jre8\bin;c:\glassfish4\glassfish\bin;C:\Program Files (x86)\Java\jdk1.8.0\bin
    Thanks for any leads!
    Jim

    It give this error:
    Syntax error: annotations are only available if source level is 5.0
    That exception is telling you that the java compiler version being used to compile your java source is not 5.0 or later.
    Eclipse uses 'some' version of Java to run itself. And, by default, your java code will use that same version of java unless you configure it to use a different version.
    http://wiki.eclipse.org/Eclipse.ini#Specifying_the_JVM
    One of the most recommended options to use is to specify a specific JVM for Eclipse to run on. Doing this ensures that you are absolutely certain which JVM Eclipse will run in and insulates you from system changes that can alter the "default" JVM for your system. Many a user has been tripped up because they thought they knew what JVM would be used by default, but they thought wrong. eclipse.ini lets you be CERTAIN.
    Check the version of java that eclipse is using. Just because that version of java is not on your path doesn't mean eclipse isn't using it.
    Then repost your question in an eclipse forum.

  • Certain Java methods only available on Tomcat, when logged in as a user

    Certain java methods are only available in a Tomcat webapp, when the Tomcat server is started in a terminal window, while the user is directly logged into the system
    When one of those methods are called from a command line app, for a split second an app pops up in the dock, even though no UI-method is called directly.
    For example include a method like javax.imageio.ImageIO.createImageInputStream into a servlet inside a tomcat webapp and start tomcat through a ssh-connection.
    The servlet will crash with following exception:
    java.lang.NoClassDefFoundError: Could not initialize class sun.java2d.Disposer
    javax.imageio.stream.FileImageInputStream.<init>(FileImageInputStream.java:82)
    javax.imageio.stream.FileImageInputStream.<init>(FileImageInputStream.java:57)
    com.sun.imageio.spi.FileImageInputStreamSpi.createInputStreamInstance(FileImage InputStreamSpi.java:37)
    javax.imageio.ImageIO.createImageInputStream(ImageIO.java:331)
    com.sage.utility.ImageUtil.getFormatName(ImageUtil.java:76)
    When Tomcat is started from a normal terminal window, while being logged into Mac OS, the very same method works without a problem.
    It looks like the problem only exists on Mac OS X... on Linux it runs without a problem under the same configurations
    I just noticed, that when the user logs out, the server will remain active, but another exception is raised:
    Can't connect to window server - not enough permissions.
    It looks like the reason for this is a crooked implementation of the java api by apple.
    Since it doesn't really work for us, doing all out administration though screen sharing, I would love to hear, that there is a way around this.

    After I filed a bug-report an Apple engineer contacted me, and asked me to try running java in headless mode: http://java.sun.com/developer/technicalArticles/J2SE/Desktop/headless/
    That solved the problem!

  • Surprise! Mountain Lion only available as a download? Mac Pro 3,1 Early 2008

    Just purchased Mountain Lion to upgrade one of my Mac Pro's 3,1 Early 2008 hoping to get the CD but it seems like it's only available as a download. Is that accurate? Did I miss a link to get the actual physical item? If the download version happens to be the only one available, how should I work around this, given that I would like to upgrade my 2 Mac Pro's and probably my work MacBook Pro? Help please...

    I have made backup installers of Lion through Mavericks on flash drives using Lion DiskMaker, which BTW is now called DiskMakerX.  It works really well. Before creating the flash drive installer, don't immediately run the "Install OS X Mountain Lion" application, which you will find in your Applications folder: save a copy of it to another location. After ML is installed, the install application gets sent to the cornfield (thanks, Apple), so you will need a backup copy of it.
    For Yosemite, I followed these instructions to make a flash drive installer: http://osxdaily.com/2014/10/16/make-os-x-yosemite-boot-install-drive/. I'm not sure if DiskMakerX works with Yosemite. Anyone else know?

  • How to install a big program that is only available for PC on a Mac.

    Hi everyone,
    I really need help about that, I've just start a new job that requiered 20-20 Design, witch is only support by PC. But I don't want change my Mac for PC My iMac has Bootcamp already so I need to know, if I'm installing Windows Vista or 7 (witch is requiered by my program/software...I don't know how I'm suppose to call it in english), will I be able to make it work? And if it can help, my 20-20 design is working with an USB key not an installation CD. I've read a lot of topics but no one answer my question
    Thanks for your help....you can save my life, my job and my Mac :P

    How to install a big program that is only available for PC on a Mac.
    Run the Boot Camp Setup Assistant. Install Windows. Install your "big program"

  • I'm a new potential FCP X user.  Can I buy software to load onto my imac and macbook pro or is FCP X only available as a download?  I'd like to be able to edit on the road.

    I'm a new potential FCP X user.  Can I buy software to load onto my imac and macbook pro or is FCP X only available as a download?  I'd like to be able to edit on the road as well as at home.

    Here's a short tutorial video about how to move back and forth between your base computer and the on-the-go machine.  Very important info about which things can be copied within Finder and which things MUST be copied from within FCP X.  Best wishes.
    stephen
    http://library.creativecow.net/mcauliffe_kevin/FCPX-media-on-the-go/1

  • HT201209 So I have redeemed my $25 iTunes Gift Card on my iPad Gen4.  Will this $25 be available for in App purchases or App purchases or is it only available for the use of purchasing music or other media through iTunes?

    I have redeemed my $25 Gift Card and was wondering if that $25 can be redeemed for in app purchases or other app purchases or is it only available for music or media purchases through iTunes?

    You can use an iTunes gift card for app, music, movies and other media.To redeem one see:
    iTunes Store: How to redeem a code

  • Edits will not be saved. Any Edits made to the enterprise global template items are only available during this session.

    Hi,
    I am getting a pop-up message(Edits will not be saved. Any Edits made to the enterprise global template items are only available during this session.Make edits in checked-out enterprise global template to make them
    available for all users of this project server) when trying to insert a new column in the Gannt Chart View.
    Due to this what all are the columns that inserted in the project plan, will be lost when open the project in the next time.
    I have opened the Enterprise Global Template and cross checked for Gaant Chart view it is showing the table as "Entry" only.
    The requirement is what all columns are required for the project plan, manager will insert in the project first time. Next time on-wards it needs to be display the columns when opened the project from server by default.
    We are unable to reproduce this issue in our Dev Envt.
    Could anyone of you please help me.
    Thanks in Advance!
    Regards,
    Venkat

    Hi Venkat,
    I suggest to remove Gantt Chart view and Entry table from Eglobal. These are default views from client and it is highly recommended to not use them in Enterprise Global.
    Whatever a user ist doing on a view or table which is included in Enterprise Global will be reset on next open - therefore you receive this message.
    If you need some server wide defined views and tables, create them. But remove Gantt Chart and Entry.
    Does that help?
    Regards
    Barbara
    To increase the value of this forum, please mark the replies that helped to solve your issue as answer. If you find answers to questions from other forum participants to be helpful, please mark them as helpful. Your participation will help others to find
    an appropriate solution faster. Thanks for your support!

  • Have been here before but still have not resolved a fix for a black screen when I try to access a PDF file...Now I've got a new iPad and need the User Guide which is only available inPDF

    Have been here before but still have not resolved a fix for a black screen when I try to access a PDF file using Safari...Now I've got a new iPad and need the User Guide which is only available in PDF and FireFox will not work.

    Hello,
    '''Try Firefox Safe Mode''' to see if the problem goes away. Safe Mode is a troubleshooting mode, which disables most add-ons.
    ''(If you're not using it, switch to the Default theme.)''
    * On Windows you can open Firefox 4.0+ in Safe Mode by holding the '''Shift''' key when you open the Firefox desktop or Start menu shortcut.
    * On Mac you can open Firefox 4.0+ in Safe Mode by holding the '''option''' key while starting Firefox.
    * On Linux you can open Firefox 4.0+ in Safe Mode by quitting Firefox and then going to your Terminal and running: firefox -safe-mode (you may need to specify the Firefox installation path e.g. /usr/lib/firefox)
    * Or open the Help menu and click on the '''Restart with Add-ons Disabled...''' menu item while Firefox is running.
    [[Image:FirefoxSafeMode|width=520]]
    ''Once you get the pop-up, just select "'Start in Safe Mode"''
    [[Image:Safe Mode Fx 15 - Win]]
    '''''If the issue is not present in Firefox Safe Mode''''', your problem is probably caused by an extension, and you need to figure out which one. Please follow the [[Troubleshooting extensions and themes]] article for that.
    ''To exit the Firefox Safe Mode, just close Firefox and wait a few seconds before opening Firefox for normal use again.''
    ''When you figure out what's causing your issues, please let us know. It might help other users who have the same problem.''
    Thank you.

Maybe you are looking for

  • Characteristic Relationship Error

    Hi I am deriving 0fiscper by concatenating 0fiscper3 and 0fiscyear. This works perfrectly in BPS. However, when I define the characteristic relationship in IP I get hte following error when checking: Characteristic relationships for InfoProvider ZSEM

  • Crashed, file won't open, "Invalid File Format"

    working in DVD SP 4, program crashed, and now I can't open my file. I get a "Invalid Project File Format" error when I try. I've done some searching on here, and tried a few things I've found (making a copy of it, changing some stuff in the resource

  • REG- SYSTEM

    Plz help me my system is not proprly working plz call    [edited phone by moderator]

  • 92 photos have been found in the iPhoto library that were not imported.

    Hi, Everytime I connect my iPhone or iPad to my MacBook Pro, the above message appears twice, followed by "Would you like to import them?". Also, everytime the phone is connected, it tells me there's a "new photo" to be imported, but it can't import

  • Face Time Audio available? If so, how to activate it?

    HI there. Anybody knows if FaceTimeAudio only is available? I can do only full Face Time with video. My understanding was, that this feature will be available in iOS7 and when released, also in Maverics. Am I missing something? Thanks, mp