Hive and pig jobs to any container in storage account

Hi
While creating HDInsight account, we choose a storage account. 
A container will be created in the name of the cluster and the required jars will be added to this.
Can we submit pig, hive and sqoop jobs to any container in the storage account or only to the container that is created while creating a cluster.
If we can submit data container and If I am using hive shell in RDP of headnode, then how to specify the container.

Hi Sridevi_K
It should work. While creating external table in hive you can define location (here considering file is at root location of an container) like 'wasb://[email protected]/'.
Next time when you query the table it's knows where to look for the data since this info will be there in metadata. In case you want to check it type this command on hive console "DESCRIBE EXTENDED TABLE_NAME". In pig script you can also define
the file location while loading the data like loaddata = LOAD 'wasb://[email protected]/FILE_NAME.EXTENSION';.
You can check it on your environment. However I am curious why you want to do that.
Thanks,
Please mark it answered if it's answer your question.
Sudhir Rawat

Similar Messages

  • I recently uploaded a gift card with a balance of $25.00, I make a purchase in a game for $5.99 and my balance on my gift card is now $12.18.  I did not receive an email confirming the purchase and do not see any activity on my account. Where is my money?

    I recently uploaded a gift card with a balance of $25.00, I make a purchase in a game for $5.99 and my balance on my gift card is now $12.18.  I did not receive an email confirming the purchase and do not see any activity on my account. Where did my money go? How can I get it returned??

    The receipt usually takes more time to receive. I got my receipt from about 7:00pm yesterday at about 10:00pm today.

  • I can't purchase on my candy crush game and there isn't any problems with my account.

    I periodically can't purchase on candy crush and there isn't any problems with my account. Help!

    Open current iTunes on your computer. Connect iPhone to the computer with USB Cable. Follow directions or click the Restore button of iTunes.

  • What is the wad-control-container container in storage account

    Hi,
    I have noticed one container created automatically in the storage account by the name wad-control-container.
    I have no idea what is it used for, please help.
    Thank you!
    Regards,
    Krishna

    Hi,
    wad-control-container blob- A control configuration blob will be created for each role instance whenever a role without a blob starts.  The wad-control-container blob has the highest precedence for controlling behavior and any changes
    to the blob will take effect the next time the instance polls for changes.  The default polling interval is once per minute.  The mechanisms described below are used to update the contents of the wad-control-container blob.
    See more at:
    https://msdn.microsoft.com/en-us/library/azure/dn205146.aspx
    Best Regards,
    Jambor
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • I used a partitioned HDD for time machine, using a partition already containing other data files. I am now no longer able to view that partition in Finder. Disk Utility shows it in grey and "not mounted". Any suggestions of how to access the files?

    I used a partitioned HDD for time machine, using a partition already containing other data files. I am now no longer able to view that partition in Finder. Disk Utility shows it in grey and "not mounted". Any suggestions of how to access the files? Does using time machine mean that that partition is no longer able to be used as it used to be?
    HDD is a Toshiba 1TB, partitioned into two 500GB partitions.
    OS X version 10.9.2

    Yes, sharing a TM disk is a bad idea, and disks are cheap enough so that you don't need to.
    Now
    Have you tried to repair the disk yet

  • I'm trying to download games or anything but its makeing me answer sacruity ?s like what was your first pet name and dream job and idk any of that

    I'm trying to download games or anything but its makeing me answer sacruity ?s like what was your first pet name and dream job and idk any of that

    If you can't remember your answers then if you have a rescue email address (which is not the same thing as an alternate email address) set up on your account then go to https://appleid.apple.com/ and click 'Manage your Apple ID' on the right-hand side of that page and log into your account. Then click on 'Password and Security' on the left-hand side of that page and on the right-hand side you should see an option to send security question reset info to your rescue email address.
    If you don't have a rescue email address (you won't be able to add one until you can answer 2 of your questions) then you won't get the reset option - you will need to contact iTunes Support or Apple to get them reset.
    e.g. you can try contacting iTunes Support : http://www.apple.com/support/itunes/contact/ - click on Contact iTunes Store Support on the right-hand side of the page, then Account Management , and then 'Forgotten Apple ID security questions'
    or try ringing Apple in your country and ask to talk to the Accounts Security Team : http://support.apple.com/kb/HE57
    When they've been reset (and if you don't already have a rescue email address) you can then use the steps half-way down this page to add a rescue email address for potential future use : http://support.apple.com/kb/HT5312 . Or, if it's available in your country, you could change to 2-step verification : http://support.apple.com/kb/HT5570

  • Guys am using an iphone 5s that is sealed new, and i tried to restore my backup from my itunes and it was restored a wrong backup that doesnt belong to me and it contains an icloud account, and i want to delete this account. Any help please.

    Guys am using an iphone 5s that is sealed new, and i tried to restore my backup from my itunes and it was restored a wrong backup that doesnt belong to me and it contains an icloud account, and i want to delete this account. Any help please.

    This phone was new. And it was sealed from the box that was closed. And the backup was on my laptop. And this icloud account was saved by mistake on my laptop.

  • How to create a new variant and a job sheduled to use it for the ......

    How to create a new variant and a job sheduled to use it for the exisisting programs

    Hi
    1. The ALV Grid Control is a tool with which you can output non-hierarchical lists in a
    standardized format. The list data is displayed as a table on the screen.
    The ALV Grid Control offers a range of interactive standard list functions that users need
    frequently (find, sort, filter, calculate totals and subtotals, print, print preview, send list,
    export list (in different formats), and so on. These functions are implemented in the
    proxy object class. You as the programmer have the possibility to turn off functions not
    needed. In most cases the implementations of the standard functions provided by the
    control are sufficient. However, if required, you can adjust these implementations to
    meet application-specific needs.
    You can add self-defined functions to the toolbar, if necessary.
    The ALV Grid Control allows users to adjust the layout of lists to meet their individual
    requirements (for example, they can swap columns, hide columns, set filters for the
    data to be displayed, calculate totals, and so on). The settings (list customizing) made
    by a specific user are called a display variant. Display variants can be saved on a userspecific
    or on a global basis. If such display variants exist for a list, they can be offered
    to the user for selection. If a display variant is set as the default variant, the associated
    list is always displayed based on the settings of this variant.
    2. REUSE_ALV_LIST_DISPLAY
    REUSE_ALV_GRID_DISPLAY
    REUSE_ALV_FIELDCATALOG_MERGE
    REUSE_ALV_COMMENTARY_WRITE
    3. Use of Field Catalog is to determines the technical properties & add formating information of the column.
    6. all the definition of internal table, structure, constants are declared in a type-pool called SLIS.
    7.fieldcat-fieldname
    fieldcat-ref_fieldname
    fieldcat-tabname
    fieldcat-seltext_m
    5. Form user_command using r_ucomm like sy-ucomm rs_selfield type slis_selfield.
    Sap provides a set of ALV (ABAP LIST VIEWER) function modules which can be put into use to embellish the output of a report. This set of ALV functions is used to enhance the readability and functionality of any report output. Cases arise in sap when the output of a report contains columns extending more than 255 characters in length.
    In such cases, this set of ALV functions can help choose selected columns and arrange the different columns from a report output and also save different variants for report display. This is a very efficient tool for dynamically sorting and arranging the columns from a report output.
    The report output can contain up to 90 columns in the display with the wide array of display options.
    <b>The commonly used ALV functions used for this purpose are;</b>
    1. REUSE_ALV_VARIANT_DEFAULT_GET
    2. REUSE_ALV_VARIANT_F4
    3. REUSE_ALV_VARIANT_EXISTENCE
    4. REUSE_ALV_EVENTS_GET
    5. REUSE_ALV_COMMENTARY_WRITE
    6. REUSE_ALV_FIELDCATALOG_MERGE
    7. REUSE_ALV_LIST_DISPLAY
    8. REUSE_ALV_GRID_DISPLAY
    9. REUSE_ALV_POPUP_TO_SELECT
    Purpose of the above Functions are differ not all the functions are required in all the ALV Report.
    But either no.7 or No.8 is there in the Program.
    <b>
    How you call this function in your report?</b>
    After completion of all the data fetching from the database and append this data into an Internal Table. say I_ITAB.
    Then use follwing function module.
    CALL FUNCTION 'REUSE_ALV_GRID_DISPLAY'
    EXPORTING
    I_CALLBACK_PROGRAM = 'Prog.name'
    I_STRUCTURE_NAME = 'I_ITAB'
    I_DEFAULT = 'X'
    I_SAVE = 'A'
    TABLES
    T_OUTTAB = I_ITAB.
    IF SY-SUBRC <> 0.
    WRITE: 'SY-SUBRC: ', SY-SUBRC .
    ENDIF.
    ENDFORM. " GET_FINAL_DATA
    The object F_IT_ALV has a field, the activity ACTVT, which can
    contain four permitted values: 01, 02, 03 and 70. Each of the
    activities 01, 02 and 70 controls the availability of particular
    functions (in the menu and the toolbar) of the ALV line item list:
    a) 01: "Settings -> Display variant -> Save..."
    b) 02: "Settings -> Display variant -> Current..." and
    "Settings -> Display variant -> Current header rows "
    c) 70: "Settings -> Display variant -> Administration..."
    Activity 03 corresponds to the minimum authorization, which is the
    most restricted one: The user can only select layouts which have
    been configured already. In particular, all of the other functions
    named above are inactive with activity 03.
    Now if you want to permit a user to change the column selection and
    the headers as well as to save the layout thus created, for example,
    but if you do not want to permit the user to administrate the
    layouts, you grant him or her the authorization for activities 01
    and 02.
    Check this link it will be mosty usefull for u
    http://www.sap-img.com/fu017.htm
    Reward all helpfull answers
    Regards
    Pavan

  • What is the Diffrence between Adaptive and Webi Job Server

    Hello,
    What is the diffrence between Adaptive Job server and Webi Job server?
    In my BO server we didn't have Webi Job server but we are able to schedule the webi reports successfully.
    Any Idea on this.
    Thanks,
    Nimesh.

    I believe the Adaptive Job Server is on a generic shell server that behave as a Webi Job Server when it processes webi reports, as a program job server when it processes program object etc.

  • OFFLINE backup and DB13 jobs configuratins error in MSCS cluster with OFS

    Hello,
    We have recently installed SAP ERP 6.0 EhP4 SR1 in MSCS cluster using Oracle Fail Safe.
    The installation is successful and all the failover scenarios work fine.
    I need to schedule offline backups and DB13 jobs, which is not possible in current scenario as once the database shuts down it fails over to node2.
    I am following sapnote 657999 to install standalone gateway on both the nodes of the cluster and assigned the service to ORACLE<SID> group. the gw<SID> is different from the ERP<SID>.
    However, the  service SAP<gwSID>_<gwSN> fail to come up with the following error.
    The service SAPSGA_30 cannot be started on local computer
    error 1067: the process terminated unexpectedly.
    The ../SapCluster/sapgw and associated directories have full permission.
    Following are the contents of the profiles in ../SapCluster/sapgw
    default.pfl
    SAPDBHOST = ORACLEPRD
    gw30.pfl
    SAPSYSTEMNAME = SGA
    INSTANCE_NAME = GW30
    SAPSYSTEM = 30
    DIR_PROFILE=C:\WINDOWS\SapCluster\sapgw
    DIR_EXECUTABLE=C:\WINDOWS\SapCluster\sapgw
    DIR_INSTANCE=C:\WINDOWS\SapCluster\sapgw
    SAPLOCALHOST = ORACLEPRD
    SAPLOCALHOSTFULL = ORACLEPRD
    startgw.pfl
    SAPSYSTEMNAME = SGA
    INSTANCE_NAME = GW30
    SAPSYSTEM = 30
    DIR_EXECUTABLE = C:\WINDOWS\SapCluster\sapgw
    DIR_PROFILE = C:\WINDOWS\SapCluster\sapgw
    DIR_INSTANCE = C:\WINDOWS\SapCluster\sapgw
    _GW=gwrd.exe
    Start_Program_00 = local $(DIR_EXECUTABLE)\$(_GW) pf=$(DIR_PROFILE)\gw30.pfl
    Now as the service is a part of my ORACLE<ERP SID> group, everytime I try to bring the group online, it fails due to the gw service and toggles many times in the two nodes before coming to rest on one node withfailed gw service and database in the  up condition.
    Any insight in this regard will be really helpful.
    Thanks
    Nischal

    Hello,
    Yes we were able to configure offline backups.
    We opted to install standalone gateway on both nodes and added it to the DB group. That provides the essential shell console.
    You need to follow the SAP Note 657999 and then 378648 for setting the necessary environment variables.
    One piece of advice, use the SID and system no. for the independent gateway, different from any of your SAP installations.
    Thanks
    Nischal

  • ALV, initialization and background job

    Hi,
    I've got a basic report that is causing some problems.
    On my selection screen there are 2 buttons ,say Button 1 and Button 2. If you click button 1 set gv_var to 'A', click button 2 and gv_var is set to 'B'.
      IF sy-ucomm = 'PB_1'.
        gv_ var = 'A'.
      ELSEIF sy-ucomm = 'PB_2'.
        gv_var = 'B'.
    ENDIF.
    In the initialization section gv_var is initialized to A.
    When I execute this report in the foreground there are no problems. However, when I Execute it in the background gv_var doesn't change. It just stays at the value it was set at in the Initialization section.
    Any ideas?

    Hi,
    Please note that AT USER-COMMAND will not get triggered for background jobs.
    Even your custom defined Menu bar will not be available for Background jobs.
    The reason is: According to SAP system, you have scheduled a job, and the job is run. And if the job status is completed, you will view the output.
    There you cannot capture the Sy-ucomm value, since according to SAP system the job is completed, meaning that the report is run and the output is displayed. No more events can be triggered at that place.
    Which is not the case with foreground mode, since, until you leave the program, the program is still under execution only.
    Best Regards,
    Suresh

  • Java Printing Service (JPS) How to get printer status and pending jobs list

    Hi,
    I am trying to determine what is the current status of a printer in my computer as well as what is the list of pending printing jobs at any moment.
    I want to monitor activity on a printer in my computer, so I can capture and log the jobs that are sent to my printer over time.
    I would like to do so by monitoring the printer pending jobs list (if that can be retrieved through any java method) and make a log of changes in that list.
    Any advice on how to get the list of pending jobs of a printer?
    I checked the API and JobState class seems to be a descriptor of one single job... I suppose the method to retrieve a list of pending jobs in a printer would return an array of JobState objects... but I have not being able to find yet such method...
    Thanks in advance,
    JN

    Moderator Action:
    This post has been moved from the Java Programming,
    to the ADF forum, for closer topic alignment.
    *... and Comment:*
    Get help from people that work with ADF.
    They may have already done something like this.

  • Passing Partner function and Partner number in Action container editor

    Hi all,
    We have a requirement to create a follow up transaction with different business units as partner functions depending on some logic. I tried defining one action using copy_document method and was able to pass the container values of partner function (CRMT_PARTNER_FCT) and partner number (CRMT_PARTNER_NO) along with transaction type (process_type). However, still the follow up transaction does not contain the relevant partner function and value.
    Please let me know is there a way I can default differnt partner function and partner number while creating a transaction based on my actions.
    Thanks and Regards,
    Varun Gupta

    Thanks maggie, I know couple of options using code like the one you mentioned in copy badi. There is another BADI only for partner function. I can activate it in the access sequence and can do my code over there. However, in actions (copy_document specifically) we can pass parameter like transaction type, activity category etc. SAP standard implementation automatically takes those parameter into consideration and create subsequent transaction with right transaction type and activity category. On similar basis I have also tried sending partner function and partner number without any success. So I thought of raising this and need all CRM experts advice on it.

  • Destination and publication job servers - missing

    Hi,
    Hi the destination and publication job servers seem to be missing. I need them to setup "Publication via SNC with SAP BW." Am I OK to set them up as follows in CMC?
    DESTINATION JOB SERVER - Service Category: Core Services, Service: Destination Delivery Scheduling Service
    PUBLICATION JOB SERVER - Service Category: Core Services, Service: Publication Scheduling Service
    Also, do I need to include any of the additional services when creating the servers?
    Thanks

    Seems that it is correct.
    But wondering, how come the servers are missing.
    You can add those core services.
    You can also check by creating new SIA node using CCM. You can try that too.
    Regards
    Gowtham

  • Sap bw responsbilities and daily  job

    Hi Guru's
    Can anyone guide as i am taking over the sap bw project for that i want to know the list of responsibilities and daily job.
    Thanks in Advance
    Satya

    Hi Satya,
    From a high level, at our comapny we have the following roles:
    Analysis - Gathering the business requirements, and writing any spec
    Developer - Create the BW objects and process based on the Analysis specs
    Tester - Test all BW objects and process created for the project
    Support - Beside the roles defined by Krishna, they also set up the Process Chains and Data loads, approve and move any transport between systems
    End-User - We have self service application, so we have our super users set up any queries for their user community
    Basis - Monitor the system, and perform any performance tuning as needed.
    Cheers! Bill

Maybe you are looking for

  • External display is blurry and choppy

    I have recenty bought a Belkin mini display port to hdmi adapter for my mac book pro. When i plug it in it does not fill my entire tv screen and theh image is blurry and the colors are horrible. I set the resolution to 1080p which my tv can handle an

  • Hp hdx 16t laptop, hooked it philips 52 tv via hdmi cable and get video but no audio

    Hp HDX 16t laptop Windows vista home prem, 64 bit, 4 gig ram, (512) 9600m gt nvidia geforce video card. Hi I have a hp hdx 16t laptop, hooked it up to philips 52 inch LED tv via an  hdmi cable and get video on tv but no audio.  Only sound from laptop

  • ResourceDescriptor Exception on initXAResource

    I can see the following error in the weblogic logs and after this error the transactions are getting commited before the actual commit. Can someone help me on this issue. ####<Oct 31, 2006 8:55:21 AM CST> <Debug> <JTA> <server> <server_7004> <main> <

  • Combining 3 descriptions in a hierarchy as one description for a Row

    Hello Expert, If a hierarchy has levels 1, 2,3,4 with descriptions Level 1 --- Brands Level 2 --- Colors Level 3 --- Flavors In BEx, I showed row as Brands and users can drill down on this hierarchy to see the volume and then drill further down to se

  • 11g on Oracle Ent Linux ./runInstaller fails: Error: can't open display:...

    X-server stuff is killing me... As root: [root@blackbox ~]# xclock the xclock starts right up. [root@blackbox ~]# su - oracle [oracle@blackbox ~]$ /usr/bin/xclock xclock DOES NOT start. Permissions are fine and command just sits there until Ctl-C to