How to process huge files using File Adapter without ESR and no FCC?

Hi All,
I came to a scenario where i need to pick the file from R/3 sys which of around 500MB and need to transport it to the Third party sys using PI 7.1 . This is just simply a pass through data i.e.., no mapping is required (no ESR). and i don't to make use of FCC or BPM
My question is can the File Adapter can pick the file which is of 500MB size?
If not then what would be best solution to do it?
Do i need to divide the file into smaller sizes say around 100MB a file each in R/3 sys and then pick those files .
can i do without dividing the files in the R/3 sys?
Thanks in advance.
Sai

Hi Bhaskar,
If you zip probably the size would come less which may increase his performance a little. But I feel SAP also dont recommend this much load with PI.
If I am in his shoes then I will do a simple FTP without using PI itself. Else will look into other options. Thats my two cents.
Hope this alexs blog will give an idea to Sai:
/people/alessandro.guarneri/blog/2007/02/21/sap-xi-acting-as-a-huge-file-mover
Regards,
---Satish
Edited by: Satish Reddy on Jul 20, 2011 3:02 PM

Similar Messages

  • Sender file Adapter without Key field

    my File structure will be as follows
    <HEADER>
    <DATA1>
    <DATA2>
    <DATA3>
    <HEADER>
    <ITEM>
    <ITEM1>
    <ITEM2>
    <ITEM3>
    <ITEM>
    WHERE i do have flat file will be as follows
    10001,20081902,US
    10,soda,1
    30,soda,4
    40,soda,5
    10002,20081902,US
    10,steel,1
    30,steel,4
    40,steel,5
    how to pick this file using FCC from sendere flat file adapter without keyfields , and i can use fixed length also

    Hi,
    with multiple nodes structure( like header and item in your case) you need to have a key field to process this file to a desidered structure using FCC.
    Alternatively you can pick all these records as a single node type and classify it as header/items in your mapping by identifiing how each one differs frm other.
    ~SaNv...

  • Unable to process huge files in SFTP BASED PROXY SERVICE

    Hi,
    I credted osb project which will have sftp based proxy and sftp based business service.After completing the development i tested the fie transfer through WINSCP ,but my sftp based proxy was picking the files but i am unable to see the files in the output directory for huge files,for small file it is coming after aquite long time .please assist me .

    If you enable content streaming then you cant access the file/message content within the Proxy service and can not perform actions like Replace or perform transformations on the content. Use streaming for pass through scenarios only. If you want to read a large file and also perform transformations on content I would recommend using JCA Adapter for FTP and try reading records from file in batches, a few records at a time. Just so we know the requirement better, what is the file size and what is the format of the content?

  • How to activate the File Adapter

    Hi All,
       There is a strange problem that i am faceing now.
    I am using a file adapter to push and pull the file. The problem is just before two days the file adapter was working fine but as the location for the file pushing(file location) was not correct , so it went in the HOLD status. I just cancle the queue to make it clear and then re processed the file .
    The starange thing is that it is now not picking of the file , when checked the adapter monitoring, i found that the file adapter is in grey status saying "inactive Led : Component status is not defined "
      So also i dont found any item (communication channel) for file adapter.
    Any idea from your side will be a great help for me.
    Thanks in advance.
    JAY.

    Hi,
    When you activate or deactivate the adapter, then its corresponding services in the J2EE engine become active and inactive.
    If possible try to manually activate it. Or try to do some changes in your channel and activate it.
    If still this problem persist, do full adapter cache refresh.
    And finally restart J2EE engine if possible.
    Thanks
    Farooq
    Edited by: Farooq Farooqui on Aug 25, 2008 4:01 PM

  • How to process pdf file in clower ETL

    Hi,
    I want process pdf document in clower ETL dataintegartor. I have created sample project and created ETL garph universal data reader, data i have imported pdf file, while openning the metta data information it's show encoding data format and invalid delimiter and while running error in the console
    Please assist me how to process pdf file with unstructured data format.
    I am getting below the error,
    ERROR [WatchDog] - Graph execution finished with error
    ERROR [WatchDog] - Node DATA_READER0 finished with status: ERROR caused by: Parsing error: Unexpected record delimiter, probably record has too few fields. in field # 1 of record # 2, value: '<Raw record data is not available, please turn on verbose mode.>'
    ERROR [WatchDog] - Node DATA_READER0 error details:
    org.jetel.exception.BadDataFormatException: Parsing error: Unexpected record delimiter, probably record has too few fields. in field # 1 of record # 2, value: '<Raw record data is not available, please turn on verbose mode.>'
         at org.jetel.data.parser.DataParser.parsingErrorFound(DataParser.java:527)
         at org.jetel.data.parser.DataParser.parseNext(DataParser.java:437)
         at org.jetel.data.parser.DataParser.getNext(DataParser.java:168)
         at org.jetel.util.MultiFileReader.getNext(MultiFileReader.java:415)
         at org.jetel.component.DataReader.execute(DataReader.java:261)
         at org.jetel.graph.Node.run(Node.java:425)
         at java.lang.Thread.run(Thread.java:619)
    please can any one help me.
    Thanks
    Rajini C
    Edited by: 954486 on Sep 19, 2012 11:19 PM

    There is a separate forum for the BI/Information Discovery application of Endeca software: Endeca Information Discovery You should post your message there.
    Thanks.
    Sean

  • How to process a file with out any CSV, Delimitaor, fixed length or Copybok

    Hi Team,
    i need to process below file in OSB and need to send mails to the concerns ids...
    this file will have either 1 mail or multiple mails.
    sample.txt file with 1 mail content
    ======================================
    START
    [email protected]
    [email protected], [email protected],
    END
    Subject : CAL IND Renege #00424523 Hse580 CTH580
    BODY:
    User_ID: LARRY014
    XXX Hse/Customer # : 580/1196310
    X12 Order Number: 580094624
    Customer E-Mail: [email protected]
    Customer E-Mail 2: [email protected]
    Customer Phone : 909312345
    Dear Salesperson,
    mysupply.com Order # : 00424523
    mysupply.com User ID : LARRY014
    Customer CALIFORNIA STEEL IND has entered order 00424523
    through mysupply.com.
    THIS ORDER HAS RENEGED for the following reason(S):
    I. ORDER LEVEL
    NOTE SEGMENTS FOUND IN INPUT - SENTRY
    CDF REQUIRED CUSTOMER - ORDER RENEGED
    II. ITEM/LINE LEVEL
    LINE # ECOM LINE NAED QTY STATUS ALLOW SUBS
    Please resolve the renege and release the order in Sentry
    01 as soon as possible. Thank you.
    EMAIL-END
    ====================================
    Please help me ,how to process this file and send mail to the concern people, as its do not have neither CSV, nor Fixed lengthn or its not Cobol copybook nor its not DTD to convert it.
    Thanks
    Reddy
    Edited by: KiranReddy on Feb 3, 2012 9:52 PM

    you shouldn't need a csv if you want a fixed file you need some thing like
    read:
    <xsd:element name="C1" type="xsd:string" nxsd:style="fixedLength" nxsd:length="1" nxsd:paddedBy=" " nxsd:padStyle="tail" />
    <xsd:element name="C2" type="xsd:string" nxsd:style="fixedLength" nxsd:length="xx" nxsd:paddedBy=" " nxsd:padStyle="tail" />
    write:
    <xsd:element name="C1" type="xsd:string" nxsd:style="fixedLength" nxsd:length="1" nxsd:paddedBy=" " nxsd:padStyle="tail" />
    <xsd:element name="C2" type="xsd:string" nxsd:style="fixedLength" nxsd:length="xx" nxsd:paddedBy=" " nxsd:padStyle="tail" />
    <xsd:element name="C3" type="xsd:string" nxsd:style="fixedLength" nxsd:length="5" nxsd:paddedBy=" " nxsd:padStyle="tail" />xx stands for the length of your line
    hope this makes sense
    cheers
    James

  • Process Integration File adapter

    file adaptor in PI was able to accumulate several messages into one file?
    In other words, every 30 minutes or so, we will connect to any system to collect the documents. If I get there and find a list with 50 document, can I change the adaptor between ECC and PI to send the information as file instead of iDOC? Can this file have all 50 documents together instead of one file per PO, as the iDOC interface was going to do?

    Let me clarify the question first. Please, correct me if anything doesn't make sense.
    Every 30 minutes or so, our PI system will receive a burst of SOAP messages (xCBL format) from the provider transfering data to out ERP. The adapter between our PI and our ERP is an iDoc adapter. It  means that, if in the 30 minutes interval I have 50 individual messages to receive, ( not one message with 50 documents ), PI will then create 50 iDocs in ERP (calling the iDoc import 50 times). This would be very resource consuming in our system (of course I am not talking only 50 and not for only one type of document).
    The question is if we can change the iDoc adapter to ERP to a FILE adapter (custom format), and have this file adapter collect all messages into ONE unique file, describing 50 documents. This way, we can run a customized import program to process all 50 documens (or more) at once.
    So, I don't want to convert the iDocs but to exchange it to batch file.
    Clear as mud?

  • Huge file size for .ai and .eps

    Recently I upgraded fo Illustrator CS6 and found something that is going to screw up my working with clients. The problem is that the .ai and .eps files are having really huge size (67MB on an average). I have used about 6 images (jpeg at 1024x768, less than 1MB each) made them as pattern in the swatches panel and applied on various shapes. The .ai file size is 109MB :O :O :O . Another ridiculous thing is that an art that contains only 3 lines of text plus some circles and squares (3 circles, 2 squares) filled with solid color is around 68MB.
    This is really bad when I have to send the files to the clients. Please tell me how to reduce the file size without compromising on the pattern quality. Please, this is quite urgent.

    Dang! This is really weird. The files I was referring to were for iPad (artboard size 2048x1536). I opened a new doc @ 800x600 and copy pasted everything in the other file and saved it - 109MB file reduced to 402KB jaw dropper!!! I don't know the logic behind it, but I guess it has to be something related to artboard size ...
    Thanks guys.

  • HELP! Working on a huge file in Illustrator CC2014 and changes aren't saving.

    HELP! Working on a huge file in Illustrator CC2014 and saving as an editable PDF. I made revisions which appear fine when I view the PDF in Acrobat, but not when I re-open it to continue working in Illustrator?
    [Moved from the generic Cloud forum to the specific Program forum... Mod]

    Shanco,
    Are you saving with Create PDF Compatible File ticked, or are you using Save As and then PDF?
    I hope the former.

  • How to download a file from the net and save it into .txt format in a datab

    Can some one show me a tutorial on how to download a file from the net and save it into .txt format in a database?
    Thank you,

    http://java.sun.com/docs/books/tutorial/networking/urls/readingWriting.html

  • Hi, i purchased a 2 dvd digital set. i cant just download it straight to my ipad. they said i have to down load it to my i tunes, then can transfer to i pad. im not seeing how to click the files from my email, and get them into the i tunes acct... ugh.

    hi, i purchased a 2 dvd digital set. i cant just download it straight to my ipad. they said i have to down load it to my i tunes, then can transfer to i pad. im not seeing how to click the files from my email, and get them into the i tunes acct... ugh.
    i do not have a mac home pc. just a regular pc

    I had the same problem after I gave my old iPad to my parents and tried to install Netflix. This is what you have to do:  Open iTunes on your computer, the one you sync your iPad to. Then go to iTunes Store and search for and download Netflix app. After you download it, if your iPad is set to download new purchases it may start downloading on your iPad. If so, tap and hold to delete the app (because it is trying to install the new version on the iPad) Next step, go to the App Store on your iPad and find Netflix and it should say install since you already purchased it on the computer. Tap to install, and it will say the version is not compatible, tap to download a previous version. Click that and it will install the older version!    One more thing, if and when you sync to your computer again it will say something like " Unable to install Netflix on your iPad" Just click the box to never remind you again, because it's trying to sync the newer Netflix app to your iPad, but it doesn't work so it displays the message. The old app will remain on the ipad. Hope this helps, good luck

  • I have tried to update the operating system on my ipad several times without success.  Each time it reaches 353.2mb of 353.2mb and starts to process the file.  Nothing happens and then I get a message saying the network connection has timed out.

    I have tried to update the operating system on my ipad several times without success.  Each time it reaches 353.2mb of 353.3mb and starts to process the file.  Nothing happens and then I get a message saying the network connection has timed out.  The network is still connected.

    Have you tried temporarily turning off your firewall and antivirus software whilst the download is happening ? A number of people on here have had success downloading it after doing so.

  • Thanks.. can u please help me out in one more question. how can i transfer files like pdf, .docx and ppt from my laptop to iPhone 5 ? please its urgent.

    thanks.. can u please help me out in one more question. how can i transfer files like pdf, .docx and ppt from my laptop to iPhone 5 ? please its urgent.

    See your other post
    First, i want to know how can i pair my iPhone 5 with my lenovo laptop?

  • TS3694 uploading iOS 7 to iphone 5 and after it downloaded, it was at the end of processing the file when i received  and error (3004) .  what do i do

    was at the end of processing the file when i received  and error (3004) .  what do i do

    http://lmgtfy.com/?q=iPhone+error+code+3004

  • File to File scenario without ESR

    Hi PI Experts,
    I m doing a file to file scenario, which can be used for files with different structures. So I believe I should do this as just pass through without any ESR/mappings.But the doubt I have is how to configure receiver determination without a service interface.Can you please give me suggestions on how to proceed with this.
    Thank you so much in advance!
    Anjana.

    HI,
    follw steps:
    File to File Interface without ESR objects
    this is very simple , you need to create Configuration objs
    1. sender Communication channel and agrrenment
    2. receiver Communication channel and agrrenment
    3. u have to provide dummy service interface names and name space in interface determination,
    4.in receiver determination , we have to provide source and receiuvers bu.components and remaining dummy names.
    and provide
    dummy name means : any name like xyzzz
    dummyname sapce : http://xyzzz
    please refer this blog:
    Re: File to File Interface without ESR objects
    thanks,

Maybe you are looking for