XI Tunneling - File to File scenario - BIG Files

We have a big size file that we are going to drop using XI.
I have read that we can do tunnelling in XI to improve the performance since we do not have any mappings in XI.
How does this work? Please suggest....
John

I cannot split the file into multiple files. Our files can go upto 150 MB.
Do I have any other option without spliting the file? How exactly can tunneling help in this case?
What other option do I have as the File is created in SAP and needs to go another UNIX server to be processed?
I initially thought I can use XI to transfer it but now is causes big overhead due to File Adapter being very slow.

Similar Messages

  • File to idoc scenario with file size 16 MB

    Hi experts
    We are developing  a file to idoc scenario.The file is a 16 mb CSV txt file.Is it feasible to poll a 16 mb file at a single shot or any mechanism can be followed which would split the 16 mb file into manageable size files so that it can be polled from the adapter engine side.Will there be any performance bottleneck fr polling 16 mb file .Plz provide help in this regard

    Hi Sabyasachi,
    There would be absolutely no problem , you need not worry. I myself am using a 16 MB master record file.
    The problem only arises when you need to open this 16 MB file for into some errors or some other changes then invariably what happens is that my desktop hangs.
    Regards
    joel

  • I'd like Time Machine to backup my personal account's files separately from my guest account's files. Both have big files.  What's the best way to do this?  Should I connect 2 external HD to my new iMac, one for each account?

    I'd like Time Machine to backup my personal account's files separately from my guest account's files. Both have big files.  What's the best way to do this?  Should I connect 2 external HD to my new iMac, one for each account?

    NeuroBrain wrote:
    Since my new external hard drive is have a lot of space, I'm thinking of splitting it for Time Machine and external storage.
    This is a common mistake and I highly advise against it.
    1: TimeMachine saves states of changes and thus requires more room on the TM drive than the boot drive it's backing up.
    2: Something happens to the TM drive, loss, theft, dropped, power surge, etc., you lose both backups.
    3: The storage drive might become a portable need, with it being on the TM drive, now your increasing the risk to the TM backup that something could happen to it along with the storage drive, due to increased movement.
    Seriously, have a read,
    Most commonly used backup methods
    it's ASC User Tip that saves us regulars all the trouble of having to repeat ourselves over and over again in the posts, because we tend to forget things too, or not here sometimes etc.
    "Plan for the worst and the good will take care of itself" - Donald Trump

  • File to Mail scenario? File not received only namespace

    Hi,
    I tried to do file to mail scenario. I read blogs and forum questions before posting this.
    My problem is that I am sending.dat file in file to mail scenario.
    I used XIPAYLOAD and without Mail adapter
    When i received mail it contains attachement Untitled.xml and it does not contain my file data it contains only this.
      <?xml version="1.0" encoding="UTF-8" ?>
      <ns1:Mail xmlns:ns1="http://sap.com/xi/XI/Mail/30" />
    I do not know how to create file with payload containing To, from subject, content things. I tried Michal blog and disabled unneccessary fields etc. and when i send email as file but now In RWB it gives error
    Message processing failed. Cause: com.sap.aii.af.ra.ms.api.RecoverableException: java.io.IOException: no sender address specified
    regards
    hussaan

    Hi again,
    Simple message types and i use ximail30_xsd.txt from sap note as external defination
    Message mapping is also simple according to SDN TV.
    Adapter: Mail
    Transport Protocol: SMTP
    Message Protocol:XIPayload
    Adapter Engine: Integration Server
    smtps://smtp.googlemail.com:465
    Authetication Method: Plain
    User: complete email address
    Mail Attributes:
    From: email address
    To: email address
    Subject: test
    Content encoding: base 64
    Keep attachement: Option Checked
    No other change i did, With this configuration i receive email with untitled.xml attachement which contains only namespace info (no data).
    In my other try i changed message mapping and uses to create payload which michal refers by using constants(text to describe TO, from, subject) and text functions(concat)  in message mapping fields.
    Integration driectory setting for that
    Adapter: Mail
    Transport Protocol: SMTP
    Message Protocol:XIPayload
    Adapter Engine: Integration Server
    smtps://smtp.googlemail.com:465
    Authetication Method: Plain
    User: complete email address
    Mail Attributes: option checked
    Content encoding: base 64
    Keep attachement: Option Checked
    With this option it gives error in RWB that no sender  found
    Regards
    hussaan

  • How can I import several small audio files to create one BIG file in iTunes

    I have ONE cd with THREE audio stories contained in EIGHTEEN audio files (6 files make each story). I also have an iMac. Not sure if they're mp3 or not, but they play on computers and car radios.
    How can I take this CD, whisper abracadabra and end up with three files (each with one story)? Don't need to re-burn a CD, but just need to get them on to an iPod.
    I've tried inserting the CD and using the right mouse click/info/options to select 6 files and identify them as a 'gapless album' - but this did not link the files together.
    Any help you can offer would be appreciated. I have read pages & pages of topics, but could not find this particular issue.

    Insert the CD.
    Don't Import it yet.
    Select the CD in iTunes.
    Select the consecutive tracks uyou want joined as one file.
    Go to menu Advanced > Join CD tracks.
    Do this for each set of tracks you want as one file.
    Then Import the CD.
    If the tracks are already in iTunes, no need to import them again.
    Use this -> Join Together
    "Join Together automates the process of joining the files of selected iTunes tracks together with QuickTime and exporting them as a single AAC Music or Audiobook file/track. Optionally, you can then create a "chapterized" audio file of the exported AAC file with pointers to the individually joined tracks."

  • Error in File to JDBC Scenario using File Content Conversion.

    Hi ,
    I am sending a text file in CSV format, with all the configurations done in the sender and receiver channels.
    But the adapter monitoring says this:
    Initialization error: Conversion initialization failed with java.lang.Exception: java.lang.Exception: java.lang.Exception: Error(s) in XML conversion parameters found:
    Parameter 'EmployeeDetails.fieldFixedLengths' or 'EmployeeDetails.fieldSeparator' is missing
    Consistency check: no. of arguments in 'EmployeeDetails.fieldFixedLength' does not match 'EmployeeDetails.fieldNames' (0 <> 6)
    One thing to note here is that
    1. EmployeeDetails.fieldSeparator is given as ','
    2. I haven't used any fieldFixedLengths.
    Pointers in this regard would be higly appreciated.
    Regards,
    Younus

    cross check if you have specified EmployeeDetails.fieldFixedLengths and EmployeeDetails.fieldSeparator. only one must be used.
    in case you have already specified,
    EmployeeDetails.fieldSeparator as ',' , then delete that line and reenter the details again, activate and run the scenario.

  • File content conversion scenario-empty file

    Hi all,
    I am doing file content conversion for my sender flat file. And I want to generate XML file in my receiver location.When I check with test tab in my message map in IR , no structure gets generated in RESULT.Overalls cenario is working fine and message is processed successfully but empty file is getting generated in target directory.When I check the payload in message content in RWB communication channel monitoring,it's picking data correctly from the file.I am not getting what might have gone wrong with my message mapping in IR. It's not showing any syntax error.Even it's not generating target message structure in Results window of test Messsage mapping.Could you suggest what mistake might be there in message mapping.

    Hi all,
       I am getting this message in message monitor(SXMB_MONI).
    com.sap.aii.utilxi.misc.api.BaseRuntimeException
    thrown during application mapping
    com/sap/xi/tf/_MM_Flat_content_conv_:
    RuntimeException in Message-Mapping transformatio~
    I am able to see the output structure in test window of message mapping in IR and communication channel monitoring is also showing successful message.
    fcc parameters used are:
    Header.fieldNames KEY,EMPID,NAME,COMPANY,PHONE
    Header.fieldFixedLengths 1,4,20,15,12
    Header.processConfiguration FromConfiguratiion
    Header.keyFieldValue H
    Detail.fieldNames KEY,COMPANY,LOCATION
    Detail.fieldFixedLengths 1,15,10
    Detail.processConfiguration FromConfiguratiion
    Detail.keyFieldValue D
    Please suggest the mistake in mapping
    Edited by: Jaya on Mar 3, 2010 12:45 PM
    Edited by: Jaya on Mar 3, 2010 12:47 PM

  • Verification of signature failed for file - when locally publish big file

    Hi, I try to locally publish a package that is made of a 486 MB file. And I get this error message :
    Verification of signature failed for file : ...
    It works if I try with a smaller file (30~40 MB). So the issue is not related to the certificate. It's just like if there was a 'Timeout' that occurs during the process of publishing. But I can't see what to do to fix this.
    Any advices are welcome.
    David COURTEL
    IT Technician
    Wsus Third-Party Softwares Publishing :
    Wsus Package Publisher

    David, there's a natural filesize limit for publishing CABs of 384MB.
    This
    article from myITForum.com has a PowerShell script that can be used to set the value higher.
    Also, SolarWinds has a
    free tool (useful if PowerShell is not an option) to set this value. In addition, the utility can be run remotely. All it needs is a local API connection. It has built in help, but here's the syntax you'll need:
    /action setmaxcabsize /targetwsusname
    WSUSServerName /targeetwsususessl {YES|NO} /targetwsusport portnumber /maxcabfilesize
    sizeInMB
    Lawrence Garvin, M.S., MCSA, MCITP:EA, MCDBA
    SolarWinds Head Geek
    Microsoft MVP - Software Packaging, Deployment & Servicing (2005-2014)
    My MVP Profile: http://mvp.microsoft.com/en-us/mvp/Lawrence%20R%20Garvin-32101
    http://www.solarwinds.com/gotmicrosoft
    The views expressed on this post are mine and do not necessarily reflect the views of SolarWinds.

  • IDocs not created in file to IDoc scenario

    Hi all
    I am trying this file to IDoc scenario.
    File picked up successfully and sent to R/3 Backend…But Idoc is not posted…the status records
    In /n we05 in R/3 Backend shows that EDI: Partner profile inbound not available
    I created/tested all basics like RFC dest, port etc.
    File service that I am using is a business service …hence I am specifying a Logical system name in
    <b>Adapter specific Identifiers</b> of the file service.
    I disabled EDI_DC40 control tag record as IDoc adapter
    takes care of it.
    So at first I tried the configuration of IDoc comm. Channel by checking the Apply control record values from payload
    But SXMB monitor gave an error regarding this control record tag…I guess as we have disabled it so there won’t be any values
    for control record in payload (correct me if I am wrong).
    So I unchecked the checkbox Apply control record values from payload and monitor showed up as successfully processed.
    But in the backend I am getting this error regarding partner profile.
    I also tried to use an existing profile (<b>LS</b> type) by modifying it’s inbound parameters to accept <b>CREMAS</b> Idoc.
    But the error is as persistent as me
    Pls help
    Sudhir

    Hi
    Sender --> LEGACY, maintained in SLD (Logical system).
    Receiver--> ENI maintained in SLD with logical sys name M700.
    Partner Profile LEGACY maintained in R3.
    <b>Following is the IDocOutbound in SXMB monitor in XI</b>.
      <?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
    - <!--  Response
      -->
    - <SAP:IDocOutbound xmlns:SAP="http://sap.com/xi/XI/Message/30">
      <SAP:TABNAM>EDI_DC40</SAP:TABNAM>
      <SAP:MANDT>100</SAP:MANDT>
      <SAP:DOCREL>640</SAP:DOCREL>
      <SAP:DOCNUM>0000000000001013</SAP:DOCNUM>
      <SAP:DIRECT>2</SAP:DIRECT>
      <SAP:IDOCTYP>CREMAS03</SAP:IDOCTYP>
      <SAP:CIMTYP />
      <SAP:MESTYP>CREMAS</SAP:MESTYP>
      <SAP:MESCOD />
      <SAP:MESFCT />
      <SAP:SNDPOR>SAPAXI</SAP:SNDPOR>
      <SAP:SNDPRN>LEGACY</SAP:SNDPRN>
      <SAP:SNDPRT>LS</SAP:SNDPRT>
      <SAP:SNDPFC />
      <SAP:RCVPOR>SAPENI</SAP:RCVPOR>
      <SAP:RCVPRN>M700</SAP:RCVPRN>
      <SAP:RCVPRT>LS</SAP:RCVPRT>
      <SAP:RCVPFC />
      <SAP:TEST />
      <SAP:SERIAL />
      <SAP:EXPRSS />
      <SAP:STD />
      <SAP:STDVRS />
      <SAP:STATUS />
      <SAP:OUTMOD />
      <SAP:SNDSAD />
      <SAP:SNDLAD />
      <SAP:RCVSAD />
      <SAP:RCVLAD />
      <SAP:STDMES />
      <SAP:REFINT />
      <SAP:REFGRP />
      <SAP:REFMES />
      <SAP:CREDAT>0000-00-00</SAP:CREDAT>
      <SAP:CRETIM>00:00:00</SAP:CRETIM>
      <SAP:ARCKEY>DF57A2C0532811D9AD84000F206A031B</SAP:ARCKEY>
      </SAP:IDocOutbound>
    <b>Control record of IDoc in R3</b>
    Tab: Typeinfo
         Basic type-->CREMAS03
         Message Type-->CREMAS
    Tab: Partner
         Recipient
          Port  -->SAPENI
          Partner Number--> M700
          Partner Type-->LS
         Sender
          Port  -->SAPAXI
          Partner Number--> LEGACY
          Partner Type-->LS
    Pls help
    Regards
    Sudhir

  • Xml file to mail scenario with zip file as an attachment

    Hi experts,
    I have  a file to mail scenario. File is in xml format.
    At receiver side, first I want to zip this file and send the zip file as an attachment using mail adapter.
    How can i achieve this?
    Regards
    Divia

    Hi Shabarish,
    In the module tab i have specified the below beans
    localejbs/AF_Modules/MessageTransformBean                           contentType
    AF_Modules/PayloadZipBean                                                    zip
    sap.com/com.sap.aii.adapter.mail.app/XIMailAdapterBean           mail
    In the module configuration i mentioned as
    Transform.ContentDescription   file
    Transform.ContentDisposition   attachment:filename="file.xml"
    zip.filenameKey                      contentType
    zip.mode                                zipOne
    Now i am getting the mail with zip file as an attachment.But the name of the attachment i got is MainDocument.zip
    Even the file name inside the zip is MainDocument.xml.
    How can i specify my own file name for both zip file and the file inside the archieve folder.Please help me.
    Regards
    Divia

  • Handling Large files in PI scenarios?

    Hello,
    We have lot of scenarios (almost 50) where we deal with file interfaces atleast in receiver or sender side. Some of them are just file transfers where we use AAE and some are where we have to do message mapping (sometimes very complex ones).
    the interfaces work perfectly fine will a normal file which dont have much records but recently we started testing big files with over 1000 records and its taking a lot of time to process. It is also causing other messages which gets lined up in the same queue to wait in the queue for the amount of time it takes for the first message to process.
    This must be a very practical scenario where PI has to process large files specially files coming from banks. What is the best way to handle its processing? Apart from having a better system hardware (we are currently in the test environment. Production environment will definetely be better) is there any technique which might help us improve the processing of large files without data loss and without interrupting other message?
    Thanks,
    Yash

    Hi Yash,
    Check this blogs for the strcuture you are mentioning:
    /people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
    /people/shabarish.vijayakumar/blog/2005/08/17/nab-the-tab-file-adapter
    Regards,
    ---Satish

  • Suggestion needed for processing Big Files in Oracle B2B

    Hi,
    We are doing a feasibility study for Using Oracle AS Integration B2B over TIBCO. We are presently using TIBCO for our B2B transactions. Now since my client company planning to Implement Fusion Middleware (Oracle ESB and Oracle BPEL), we are also looking at Oracle AS Integration B2B for B2B transactions (On other words we are planning to replace TIBCO by Oracle Integration B2B if possible).
    I am really concern about one thing that is receiving and processing any "BIG FILE" (15 MB of size) from trading partner.
    Present Scenario: One of our trading partner is sending Invoice documents in a single file and that file size can grow upto 15 MB of size. In our existing scenario when we receive such big files from trading partner (through TIBCO Business Connect - BC), Tibco BC works fine for 1 or 2 files but it crashes once it received multiple files of such size. What exactly happening is Whatever Memory that TIBCO BC is consuming to receive one such big file, are not getting released after processing and as a result TIBCO BC throws "OUT OF MEMORY" error after processing some files.
    My questions:
         1. How robust the Oracle AS Integration B2B is, in terms of processing such big files?
         2. Is there any upper limit in terms of size that Oracle AS Integration B2B can handle for receiving and processing data?
         3. What is the average time required to receive and process such big file? (Lets say we are talking about 15MB of size).
         4. Is there any documentation availble that talks about any such big files through Oracle B2B?
    Please let me know if you need more information.
    Thanks in advance.
    Regards,
    --Kaushik                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       

    Hi Ramesh,
    Thanks for your comment. We will try to do POC ASAP. I will definitely keep in touch with you during this.
    Thanks bunch.
    Regards,
    --Kaushik                                                                                                                                                                                                                                                                                                                               

  • XI 3 File to IDoc scenario - Still referencing Old Logical system

    Hi
    Dont know if you can help. I have a file to idoc scenario  using XI 3 to R/3 4.6c system.
    I had the interface working from a third party system XMLHUB to SAP R/3. The Logical system name for the XMLHUB was XMLHUB01 in the SLD which I have set up as a partner profile in R/3. I have recently changed the logical system name to XMLHUBDEV01 in the SLD and created that logical system in R/3 and changed the partner profile to XMLHUBDEV01.
    Unfortunately in the sender information of the IDoc the partner number is still XMLHUB01 and not XMLHUBDEV01. I don't understand where this partner is sent from to get into the control record of the IDoc.
    I have cleared the SLD cache in both the Repository and the directory. Is there somewhere else I should be looking? Any help would be appreciated.
    Regards
    Daniel

    hi daniel...
    this thread wud answer ur query....
    Re: IDOC Payload
    regards..
    vishal

  • Not enough space on my new SSD drive to import my data from time machine backup, how can I import my latest backup minus some big files?

    I just got a new 256GB SSD drive for my mac, I want to import my data from time machine backup, but its larger than 256GB since it used to be on my old optical drive. How can I import my latest backup keeping out some big files on the external drive?

    Hello Salemr,
    When you restore from a Time Machine back up, you can tell it to not transfer folders like Desktop, Documents. Downloads, Movies, Music, Pictures and Public. Take a look at the article below for the steps to restore from your back up.  
    Move your data to a new Mac
    http://support.apple.com/en-us/ht5872
    Regards,
    -Norm G. 

  • Step by Step Guide Details for RFC to File and File to RFC scenario

    Hi Guru's
    Good day to you. I am tyring to develop some scenarios based on RFC adaptor. so i want to start up with basic scenarios like RFC to File  scenario(Here i just want to pull some data from SAP using RFC and put it in destination folder as an text file) and FILE to RFC scenario (Here i just want to take some data from the file and update into SAP).
    For doing these scenarios i would like to request you people to send me the step by step guide which explains me about the complete steps of configurations required to do the RFC to FILE scenario and FILE to RFC scenario.
    I found some scenarios and i am in confused state. so i request you to please put your experience to help me out.
    thanks in advance.
    Regards
    Raj

    Hi Aaron,
    I don't know your scenario and your ECC and PI versions but I learned how to use ABAP Proxy more than 1 year ago with the following tutorial:
    Edit--> The forum doesn't allow me to post external link, just search "ABAP Proxy Communication Scenario" in google and visit the 1st result
    The way to develop ABAP Proxys has changed a little if your PI is 7.1. In the ECC side, the transaction SPROXY looks much better too if you have a recent version of the ECC.
    Edited by: Marshal on Oct 8, 2009 5:08 PM
    I've found that SDN Document. Maybe the scenario is not the most simple to start with ABAP Proxy but is very well documented and is for PI 7.1. The document also handles the inbound and outbound proxys
    [http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/c00ca32e-f991-2b10-f5be-97114bd2b08f&overridelayout=true]
    Edited by: Marshal on Oct 8, 2009 5:22 PM

Maybe you are looking for