Performanse problem: file adaptor

hi all,
i read data from 17 mb file with file adaptor after i insert that to database. there is a performance issue. my file's wsdl is below. Any Suggest?
<jca:operation
PhysicalDirectory="/home/oracle"
ActivationSpec="oracle.tip.adapter.file.inbound.FileActivationSpec"
PhysicalArchiveDirectory="/home/oracle/tmp"
DeleteFile="true"
IncludeFiles=".*a\.txt"
PublishSize="1000"
PollingFrequency="120"
MinimumAge="0"
OpaqueSchema="false" >
</jca:operation>

Hi...
File size a problem with File and Ftp adpater, to resovle this you can use file debatching in the in read adater (file/ftp).
Update the WSDl of adapter for doing the same .
In that case there will be more then one instace of BPEL ,as per the define size of debatching.
Thanks

Similar Messages

File adaptor Content conversion problem

Hi all,
I have a client proxy > pi> CSV file scenario which im working on currently - everything is fine apart from 1 really annoying thing.
The problem is this that when data is extracted from SAP it should put in 6 fields within the file produced e.g:
field1,field2,field3,field4,field5,field6
Which is fine however if one of the fields is blank there should still be the blank space which should appear instead of what it is curently doing which is ignoring the blank and shifting everything else left by 1 so:
if out of 6 fields only 5 come out currently its doing this:
field1,field2,field4,field5,field6      (Notice field3 is missing and there is no blank space in its place)
What it should be doing is this:
field1,field2,,field4,field5,field6       (Notice the blank space)
I have gone through all the content conversion parameters I know for receiver file adaptors none have worked so if you know any which will do this please let me know!!
Also if you know of other ways your ideas will be greatly appreciated.
Many thanks in advance
Edited by: Saqib Karim on Mar 5, 2009 5:45 PM

>
Saqib Karim wrote:
> Hi Chirag,
>
> Does this mean that there is nothing in the file adaptor to cater for this and the only way is through mapping?
>
> I was hoping for an easier more straight forward solution along the lines of content conversion since this means that it has to apply to ALL FIELDS in the mapping!!??
>
> Thanks
you solution is to alter the mapping in a simple way.
If you are using graphical mapping then use this logic;
Source field -> if EXISTS -> Target
                      else -> Pass an empty constant -> Target
This will make sure an empty tag is created a the target and FCC will work fine.

File Adaptor-picking after error

Hi,
I have a scenario where File adaptor has to pick files where file name is dynamic but the extension is constant e.g <dynamic name>.file
I have configured the file adaptor for picking up the files, as *.file but the problem comes when there is some error in the file and adaptor (field content conversion) fails to pick up the file.
And now on when ever file adaptor polls the directory it again tries to read the same file and fails , irrespective of other correct files(*.files).
Is there any way to remove/archive this error file so that file adaptor polls for the next correct files.
Regards,
Satish

hi satish,
Are u talking about additional files? If so you can use NameA.optional=yes and proceed.
Regards,
Divya

Inbound File Adaptor

Hi Guys,
I have a situation where I would like to receive an XML file into XI and map it to an IDOC and post a transaction in R/3.
I have been able to pick up the XML using the inbound file adaptor. The problem that I am experiencing is that the XML file is encoded using UTF-16. The XML file also has BOMs. I have tried creating a new data type from the XSD but get a parsing error. So I created a new data type manually using the values that are given to me in the XSD file. When I try and test the mapping I get an error. I keep getting a parsing error that indicates to me that it cannot map the XML file that it receives to the data type that I have created. It appears that XI is not able to read this UTF-16 file. Has anyone had this situation before? Can XI handle UTF-16 and BOM?
When creating the data type, do I have to include the BOM and BO elements?
Any help would be appreciated!
Thanks very much,
Miguel

Hi Rajan,
Yip, I have tried this already and it works fine. I have also tried uploading an IDoc and that too works fine. This leads me to think that my problem actually lies in the way that my data type is defined and not the actual file adaptor. I think that by finding out whether I should include the BOM and BO elements in my data type would probably help towards solving this problem, because I think that if XI is able to read UTF-16 fine, then it would automatically know that a BOM and BO element is going to be there and would ignore these elements in the XML file.
Here is the test XML file that I am trying to read into XI:-
<?xml version="1.0" encoding="UTF-16"?><BOM><BO><AdmInfo><Object>13</Object><Version>2</Version></AdmInfo><Documents><row><DocNum>127</DocNum><DocType>dDocument_Items</DocType><HandWritten>tNO</HandWritten><DocDate>20050908</DocDate><DocDueDate>20050908</DocDueDate><CardCode>0000000006</CardCode><CardName>Test 2</CardName><Address>3
1690 MBABANE
SWAZILAND</Address><DiscountPercent>0.000000</DiscountPercent><DocCurrency>GBP</DocCurrency><DocRate>0.000000</DocRate><DocTotal>58.750000</DocTotal><Reference1>127</Reference1><Comments/><JournalMemo>AR Invoice - 0000000006</JournalMemo><PaymentGroupCode>-1</PaymentGroupCode><DocTime>1410</DocTime><SalesPersonCode>-1</SalesPersonCode><TransportationCode>-1</TransportationCode><PartialSupply>tYES</PartialSupply><Confirmed>tYES</Confirmed><SummeryType>dNoSummary</SummeryType><WareHouseUpdateType>dwh_Stock</WareHouseUpdateType><ContactPersonCode>67</ContactPersonCode><ShowSCN>tNO</ShowSCN><Series>1000</Series><TaxDate>20050908</TaxDate><Address2>Street 1
Garankuwa
1560 SOUTH AFRICA</Address2><ShipToCode>Ship to</ShipToCode><Rounding>tNO</Rounding><RevisionPo>tNO</RevisionPo><BlockDunning>tNO</BlockDunning><PaymentBlock>tNO</PaymentBlock><MaximumCashDiscount>tNO</MaximumCashDiscount><DeferredTax>tNO</DeferredTax><NumberOfInstallments>1</NumberOfInstallments><ApplyTaxOnFirstInstallment>tYES</ApplyTaxOnFirstInstallment><UseShpdGoodsAct>tNO</UseShpdGoodsAct><DocumentSubType>bod_None</DocumentSubType></row></Documents><Document_Lines><row><BaseType>-1</BaseType><ItemCode>A1000</ItemCode><ItemDescription>Boxing Gloves</ItemDescription><Quantity>1.000000</Quantity><Price>50.000000</Price><Currency>GBP</Currency><DiscountPercent>0.000000</DiscountPercent><LineTotal>50.000000</LineTotal><VendorNum>Box 12321</VendorNum><WarehouseCode>01</WarehouseCode><SalesPersonCode>-1</SalesPersonCode><CommisionPercent>0.000000</CommisionPercent><AccountCode>410000</AccountCode><TaxLiable>tYES</TaxLiable><UseBaseUnits>tNO</UseBaseUnits><SupplierCatNum/><CostingCode/><ProjectCode/><BarCode/><TaxPercentagePerRow>17.500000</TaxPercentagePerRow><VatGroup>O1</VatGroup><PriceAfterVAT>58.750000</PriceAfterVAT><Height1>0.000000</Height1><Height2>0.000000</Height2><Width1>0.000000</Width1><Width2>0.000000</Width2><Lengh1>0.000000</Lengh1><Lengh2>0.000000</Lengh2><Volume>0.000000</Volume><VolumeUnit>4</VolumeUnit><Weight1>0.000000</Weight1><Weight2>0.000000</Weight2><Factor1>1.000000</Factor1><Factor2>1.000000</Factor2><Factor3>1.000000</Factor3><Factor4>1.000000</Factor4><SWW/><Address>Clockhouse Place
London
Middlesex TW14 8HD
UNITED KINGDOM</Address><ShippingMethod>2</ShippingMethod><DeferredTax>tNO</DeferredTax><CorrectionInvoiceItem>ciis_ShouldBe</CorrectionInvoiceItem><CorrInvAmountToStock>0.000000</CorrInvAmountToStock><CorrInvAmountToDiffAcct>0.000000</CorrInvAmountToDiffAcct><ExciseAmount>0.000000</ExciseAmount><ConsumerSalesForecast>tNO</ConsumerSalesForecast><U_Franch>HK</U_Franch></row></Document_Lines><SerialNumbers/><BatchNumbers/><Document_LinesAdditionalExpenses/><DocumentsAdditionalExpenses/><WithholdingTaxData/></BO></BOM>
Thanks for the help,
Miguel

Sychronous File Adaptor routing

Hi there,
I'm trying to implement a sychronous file adaptor in my ESB process. I am able to route to the adaptor using a Routing Service that routes to it. This Routing Service will be aclled by a bpel process to kick the File service off.
My problem is: There is no 'to' element of the synchronous adaptor, like a read file. How do i route the result of the adaptor in esb?
thanks,
Olly

Sorry,
I solved my own problem. And it's a serious one!!!!!
The answer is in the subject of this post. A Synchronous read is synchronous and therefore the data is replied back to the calling Routing Service.
All you have to to is on the 'calling' Routhing service, expand the 'Routing Rules', you should see the inital routing rule that calls the Sync Read to instigate it. Then expand the Rule, you will see there is an option to handle the reply.
Select the route you want the reply to go to and hey presto!
Good luck
O

Issue in File Adaptor

Hi,
I am using a file adaptor to poll file from a location and process the records and to call an java callout in the same proxy which will accept filename with file path as argument.But this java callout always reurns filenotfound error.I also tried to give stage directory value/archive directory along with file name.But getting the same error.Kindly help me to find the location of polled file(but proxy is still processing).
Thanks
Jayanthi

poll file from a location ... proxy which will accept filename with file path as argumentJava callout will run on the host OSB server is running... File must be in that same host... If it's not you will have to write the file before passing to the java callout... But probably passing the content as a byte array to the java callout would be a better option...
Cheers,
Vlad

File Adaptor....... system command after file processing

i am creating 2 files with file adaptors..
lest say a1.txt and a2.txt..
in the file adaptor i am specifying the path of a batch file which is located at the same location where these 2 files are created......this batch file should run after message processing
i am using this .bat file to create a file by combining these 2 files and delete these 2 files after that...
but nothing seems to be happening..after the 2 files are created.
seems like the command is not getting triggered which it is suppose to after message processing.
please help

Hi Tarun,
Check this blog, Might give u some idea as well...
<a href="/people/michal.krawczyk2/blog/2007/02/08/xipi-command-line-sample-functions: Command line sample functions</a> By Michal Krawczyk
<a href="/people/sameer.shadab/blog/2005/09/21/executing-unix-shell-script-using-operating-system-command-in-xi Command - Executing Unix SHELL scripting</a> By Sameer Shadab
Regards
San
Where there is a <a href="https://www.sdn.sap.comhttp://www.sdn.sap.comhttp://www.sdn.sap.com/irj/sdn/weblogs?blog=/weblogs/topic/16">blog</a> there is a Way.

Operating system command in file adaptor

Hi,
I am doing file to Idoc scenario, can i use the Operating system command in file adaptor to compress the file at FTP server and decompress the file at IE. I dont know is it possible and if yes then how or is there any other way to handle the big files as the network speed is very low.
Any clues!!!!!!!!!!!
Thanks in advance
Regards
Swatantra

Have a look into these threads - they seem to have the solution u need (i havnt tried it though)
Unzip file using operating system command in file/ftp receiver adapter
How to zip and unzip xml files dynamically by XI

How to increase the files picked up by File Adaptor per poll interval

Hi,
We have a scenario where in we post 80 files in the source directory and and the file adapter is configured for every 300 sec but i have noticed that the File adaptor is picking up one or two files per poll interval.Can some please suggest how to increase the number of files picked up by File adaptor
Thank You,
Nandini

Nandini:
Did you mention all the files names in the Adapter channel. One thing you can do is use wild cards and file adapter picks most of them
/people/mickael.huchet/blog/2006/09/18/xipi-how-to-exclude-files-in-a-sender-file-adapter
In case if your files are huge, then I guess file size may cause to process few files during each poll

File adaptor not working.

Hi ,
    I am trying some scenario using file adaptor but it is not working. I tried with Runtime Workbench but my adaptor entry is not there in Adaptor monitoring.
    Can anybody plz tell me how to check whether adaptor is working or not?
    I am new to XI detailed explanation will be helpful.
Thanks in advance.
Atul.

Hi Atul,
Just adding on to what Shabrish has suggested..
I Guess you should first see if the file is being picked... for that do the following.
While configuring your Sender File Adapter, let the mode be DELETE. This way, we will know if the file is being picked by the File adapter. The file will be deleted and you can be sure that it has been picked up.
In your runtime workbench home, there will be a tab, Component Monitoring, click on it. Select status as all, and click on display. The components will be displayed on ur screen. In that, under Integration Server, there will be a link for Adapter Engine. Click on it. Now, scroll down, and u will see a link to adapter monitoring, there under FILE ADAPTER see the log of the file adapter
and also, you can see the flow of your message in the integration engine in SXMB_MONI.
Do this and let us know what is happening...
Regards,
Abhy

Multiple files in different directory using single FILE adaptor

Hi Guys,
How can we handle multiple files having different format(PDF,TXT,EXCEL) and in different directory with the single FILE adaptor.
I know by using "." we ca get mutilple files, but here tthe files are of different format and in different directory.
Could you please explain as to how we can handle this scenarios?
Thanks
Sahil

Hi,
The short answer is - "No".
The Long Question - "Why do you want to use a SINGLE channel".
If your idea is to reuse the interface then dont worry... Except for the Senderchannel and Sender agreement all your other objects can be reused ...provided your sender apter converts the different files into the same XML format..
For TXT you can use the simple file adpater..
For excel see if you can use save the file as .CSV format...then you can use it directlky by the simple FIle adapter..
For PDF use conversion agent... Here a blog to get u started on that ->
/people/shabarish.vijayakumar/blog/2009/05/17/trouble-writing-out-a-pdf-in-xipi
regards
Arvind R

Splitting to multiple files in file adaptor when it's more than 100 records

Hi,
I have a scenario where I'm generating a xml file to the receiver using file adaptor I need to write 100 records per file, if it's more than 100 then I need to write into a different file, to say I need to have 100 records per file.
ABAP Proxy > PI- >File
Any help is really appreciated.
Thanks,
Joe.P

Hi Joe,
What is your source structure and what is your destination structure?
You can go the ABAP proxy route but then your control is not in the integration layer but in the business system. But if you prefer it, here's some code outlined:
data:
index type i,
lcl_proxy type ref to ZCL_Proxy.
i = 0.
try.
loop at lt_recordset into ls_record.
append ls_record to lt_output.
index = index+1.
if index = 100.
create object lcl_proxy.
lcl_proxy->execute_asynchronous(output = lt_output).
index = 0.
clear lt_output.
endif.
end loop.
if index>0.
create object lcl_proxy.
lcl_proxy->execute_asynchronous(output = lt_output).
endif.
catch CX_ROOT.
endtry.
commit-work.

File Adaptor throttle???

I have an application that will produce many files in a short time period for the File Adaptor to pickup and have processed.
I'm researching how to throttle the process that is using the File Adaptor. I'm dropping 1200 files at a time into the configured directory. The processing involves writing to a JMS queue and it's getting filled too quickly.
Since there is no way to limit the number of a particular running process, I have introduced a semaphore in some embedded java code. I had found another forum post recommending using locks through a database entry. The File Adpator config options for file age and polling time are not a help here since the files are coming in at the same time and if I wait longer to read, there will just be more files (and more processing threads).
I don't see how batching will help with this case either. I'm seeing that any large file drop is always creating 40 threads when the semaphore takes over and limits the execution to 1 at a time. My reasoning is that even with say 500 larger files, I'll still have 40 batch processors.
What is the signifigance of the 40 number?
Are there any other options to throttle either the file adaptor reader or the writing to the JMS queue?
I have a stock install of v10.1.2.0.2.
Thanks.

No clues on how to scale this?
The 40 is the setting for the number of threads in the pool, and I'm using them all up...

File adaptor Debugging?

HI @,
I am using a file adaptor which is reading the file and then archiving it after successfull reading .Now what happened that In my scenarion the file got picked up by adaptor and archived also but there is no trace available in the SXMB_MONI
I need help in debugging the same scenarion How to dedbugg and why this happened
Regards

Amit,
I would recommend looking in the Message Display Tool (http://<xiserver>:<xiport>/mdt) for errors.
Kind regards,
Koen

File Adaptor CC Error

Hello All,
I am getting following error in SAP PI File Adaptor Communication Channel error:
File processing failed with Error when getting an FTP connection from connection pool: com.sap.aii.af.lib.util.concurrent.ResourcePoolException: Unable to create new pooled resource: FTPEx: Not logged in.
Is this related to User authentication error or its internal SAP PI File Adaptor error?
THanks
Rajeev

Hi Rajeev,
Error when getting an FTP connection from connection pool - means XI server is not able to communicate with FTP server... just ask your FTP server network guys to open the firewall settings of FTP server for XI server..
Check my reply on this thread...
FTP Server Connection issue
Regds,
Pinangshuk.

Performanse problem: file adaptor

Similar Messages

Maybe you are looking for