File adapter and clustered application

Hi !
I have a question about how to use correctly file adpter at sca application in clustered server. My application very simple. Folder with xml files. Composite application - file adapter read folder with mask *.xml. Some times file adapter read one file twice. How I can set lock file when read one server from folder ?
Edited by: user5427713 on Nov 26, 2012 5:38 AM

You need to setup the File Adapter for high availability to ensure proper functioning in a clustered environment. Check out the details here in section 5.9.2.2
http://docs.oracle.com/cd/E12839_01/core.1111/e10106/ha_soa.htm#CHDJFDAI
In summary you will need following:
1. A shared filesystem for the managed servers
2. Same value for control directory in connection factories
3. Use eis/HAFileAdapter instead of eis/FileAdapter as connection factory in JCA file.

Similar Messages

Regarding issue sender file adapter in clustered environment(PI 7.0)

Hi Experts,
we are using sender file adapter in clustered environment(there are 6 J2EE cluster nodes in XI system) for an interface.the file sender communication channel for this interface is scheduled to run twice every day. recently the channel stopped polling (picking the files from the source directory) and i dont see any error.
when i open Communication Channel monitoring in RWB and select the file sender communication channel and run it manually, none of the cluster nodes are polling for the file.
i have tried editing the communication channel in Integration Directory and activating it. but it does not pick the file.
Can you let me know how the issue can be resolved.
Thanks
-Kaushik
Edited by: Kausik M on Dec 18, 2008 4:13 AM

Kausik,
A computer cluster is a group of linked computers, working together closely so that in many respects they form a single computer. The components of a cluster are commonly, but not always, connected to each other through fast local area networks. Clusters are usually deployed to improve performance and/or availability over that provided by a single computer, while typically being much more cost-effective than single computers of comparable speed or availability.
clearly your cluster nodes are out of sync...!!!!
It is possible that your ftp server went down for a while . And in the profile of FTP machine the entry of XI server is not made permanent .
1. Try to ping the FTP site from XI server.
BTW are u getting any error msg at RWB ?
Regards,

Sender File Adapter and NFS

I am having a sender file adapter and is using NFS as the Transport Protocol. This channel is throwing an error that " directory does not exist". What can be the possible solutions for this problem?
When I had previously checked this , it was working fine but now its throwing this errorr.

Hi Neelansha,
If you select the transport protocol for NFS, Mention the Directory name for where we can get data.
and check the communication channel monitor for file sender, it will shows the clear error.
Regards,
Sateesh

How to generate .pdx file using File Adapter and FTP Adapter

Hi,
is it possible to genearate .pdx file using oracle ESB Adapters(File Adapter and FTP adapter).
Can you anyone guide me.
Thanks,
Raj.

hi,
regarding report, there is a dedicated report forum. you should post there.
but answer for your question is form is nothing to do with the pdf generation. you can call the report from the as usual.
In the report you should set the properties like
destype to 'file'
desname to 'path with file name'
desformat to 'pdf'

Difference between File adapter and FTP adapter

hi,
I would like to know what is the difference between File adapter and FTP adapter
thanks
Yatan

Both file and ftp adapters are non-concurrent jca adaps, however we go for file adapters mostly when you have files on your local environment and do not need to wait for someone to FTP the files on a timely basis. In case of FTP Adapter, we would need an FTP Server, a remote location with access where in files pitch in for polling.
Also, File adapter is dependent on the local folder and OS, however FTP adapter is dependent on the local as well as the remote file system/OS/folder permissions/user access.

Performance problems with File Adapter and XI freeze

Hi NetWeaver XI geeks,
We are deploying a XI based product and encounter some huge performance problems. Here after the scenario and the issues:
- NetWeaver XI 2004
- SAP 4.6c
- Outbound Channel
- No mapping used and only the iDocs Adapter is involved in the pipeline processing
- File Adapter
- message file size < 2Ko
We have zeroed down the problem to Idoc adapters performance.
We are using a file channel and every 15 seconds a file in a valid Idoc format is placed in a folder, Idoc adapter picks up the file from this folder and sends it to the SAP R/3 instance.
For few minutes (approx 5 mins) it works (the CPU usage is less then 20% even if processing time seems huge : <b>5sec/msg</b>) but after this time the application gets blocked and the CPU gets overloaded at 100% (2 processes disp_worker.exe at 50% each).
If we inject several files in the source folder at the same time or if we decrease the time gap (from 15 seconds to 10 seconds) between creation of 2 Idoc files , the process blocks after posting 2-3 docs to SAP R/3.
Could you point us some reasons that could provoke that behavior?
Basically looking for some help in improving performance of the Idoc adapter.
Thanks in advance for your help and regards,
Adalbert

Hi Bhavesh,
Thanks for your suggestions. We will test...
We wonder if the hardware is not the problem of this extremely poor performance.
Our XI server is:
     Windows 2003 Server
     Processors: 2x3GHZ
     RAM: 4GB (the memory do not soak)
The messages are well formed iDocs = single line INVOICES.
Some posts are talking 2000 messages processed in some seconds... whereas we got 5 sec per message.
Tnanks for your help.
Adalbert

Sender File adapter and duplicate file processing

If I set the sender file adapter to delete or archive and when a file gets picked up and processed, this file will not get deleted/archived unless it was successfully processed. However, if it errors out during processing, the file remains but it's message will get persisted in the integration engine or adapter engine. Since there's automatic retry, we have the potential for duplicate processing as in addition to the retry, the file is still continously polling for this file. In other words, how do we stop this duplicate file processing?
Thanks.

Hi Bevan,
However, if it errors out during processing, the file remains but it's message will get persisted in the integration engine or adapter engine.
your file wont get deleted unless adapter engine sucesfull pickups. if does not picked up at adapter engine then is not stored in adapter engine . if it reached Intergation Server and failed their then file would be deleted.
please let me know if you haveany questions
please reward points
Regards
Sreeram.G.Reddy

File Adapter and Third party system

Hi,
I am new to XI and implementing a simple scenario.
In SLD- I have 3rd paty software component and product.
3rd party technical system: using my pc - For host name I am using my machine name.
Scenario: Using file adapter transform csv file to xml.
File resides on my machine. I have configured file adapter inbound and outbound. Integration Dir & Rep objects are all activated.
But nothing happens, cannot see any message in Messgae monitoring..
Any help would be great.. Is my technical system setup wrong?
thanks

chk whether the folder in your m/c where the CSV file resides is shared and has appropriate access. Also you need to specify your m/c IP with fwd slashes, e.g) //<Ipaddress>/foldername
configuring your m/c as a Third Party system in SLD is fine.
If you think ur SLD settings are not correct, you can define your file adapter commn. channel in a Business Service(which does not require an SLD entry) and check whether it works.
Thanks
Saravana

Testcase problem using two file adapter and a transformation

We've got an input which looks like this :
<?xml version="1.0" encoding="UTF-8"?>
<rows>
<row>
<id>10</id>
<naam>A</naam>
</row>
<row>
<id>20</id>
<naam>B</naam>
</row>
</rows>
I've created an XSD for this message which looks like this ( straightforward ) :
<?xml version="1.0" encoding="UTF-8"?>
<schema xmlns="http://www.w3.org/2001/XMLSchema" targetNamespace="http://www.test.nl/testschema" xmlns:test="http://www.test.nl/testschema" elementFormDefault="unqualified">
     <element name="row">
          <complexType>
               <sequence>
                    <element ref="test:id"/>
                    <element ref="test:naam"/>
               </sequence>
          </complexType>
     </element>
     <element name="rows">
          <complexType>
               <sequence>
                    <element ref="test:row" maxOccurs="unbounded"/>
               </sequence>
          </complexType>
     </element>
     <element name="naam">
          <simpleType>
               <restriction base="string">
               </restriction>
          </simpleType>
     </element>
     <element name="id">
          <simpleType>
               <restriction base="byte">
               </restriction>
          </simpleType>
     </element>
</schema>
I've imported this XSD in my ESB project and created a file adapter which reads this type op files.
I've created another file adapter to write the files 1:1 to an output dir.
In the routingservice I've created a very straightforward XSL mapping which maps everything 1:1.
Now the problem
When I use this input :
<?xml version="1.0" encoding="UTF-8"?>
<rows>
<row>
<id>10</id>
<naam>Martin</naam>
</row>
<row>
<id>20</id>
<naam>Edward</naam>
</row>
</rows>
my output result is:
<?xml version="1.0" ?><imp1:rows xmlns:imp1="http://www.test.nl/testschema"/>
I know this is a namespace issue. When I add the namespace
<?xml version="1.0" encoding="UTF-8"?>
<rows xmlns="http://www.test.nl/testschema">
<row>
<id>10</id>
<naam>Martin</naam>
</row>
<row>
<id>20</id>
<naam>Edward</naam>
</row>
</rows>
I get the correct ( and 1:1 output ).
The problem is. In the scenario I'm about to build the input xml messages do not have an namespace. How can I alter my xsd file or anything within my ESB project that all files will be picked up correctly and processed without having an default namespace?
Any help is appreciated!

True,
But its the other way around what is causing my problem.
Because the input xml files contain no namespace at all the xml messages are transformed but result in an almost empty xml message. ( e.g. the root element is there and thats it ).
This is because the XML transformation mapper in ESB ( as well as BPEL ) excplicitly needs a namespace.
I solved it by editing the XSL by hand, removing the :imp1 namespace prefixes in the select="" tags. e.g.
<xsl:for-each select="/imp1:rows/imp1:row"> is updated in
<xsl:for-each select="/rows/row">
As far as I know this is the only workaround at the moment that I could find.

Sender File Adapter and content conversion

Hi,
How can we remove the last line from the file using content conversion?
The last line should not be read from the input file.
Like for the first line we can use Document Offset .......similarly do we have any option for the last line?

>
neelansha singh wrote:
> date                       Empno         Empname
> 19.03.2009            12345            Neel
> 20.03.2009             34566           Neelkanth
> EmpDes                 Japan        100
>
>
> The file is like this first row i have removed using document offset.......from 2nd row till nth row the structure is as shown above and the last row has no. of fields 1 less than all other rows and also its root node is different like shown above its rootnode is EmpDes..........How to use File content conversion for this?
do you want to avoid the last line i.e
EmpDes                 Japan        100
in that case the 3 options are
1. use a adapter module and remove the last line - this is the ideal option
2. use a OS script - will work but only if you are using the NFS option in the file adapter instead of FTP
3. read that also using content conversion (treat it as a trailer) and ignore it during the mapping

File Adapter and "permanent" module exceptions

Hi folks,
We have written a custom module for the file adapter which works fine .. In case of issues it will throw the standard "ModuleException".
The file adapter is configured to move erroneous files to a specific directory .. The SAP help specifically mentions that this happens when a "permanent" exception occured ... I quote the guide: "A permanent error occurs either during the conversion of the file content, or in a module in the module processor"
So in case of an exception in the module processor this should work ... unfortunately it doesn't ...
Our module throws an exception but the file is not moved and the adapter keeps on retrying to process the faulty file ...
Anyone faced the same problem ? Anyone any suggestion on how it should work ?
Thanks,
Steven

Hi,
When an error occurs, a module must raise a module exception.
ModuleException can contain an exception that describes the cause of the error. To provide hints about resolving the error, the error cause is written to the trace.
To process the message again, you do not need to set a special exception.
In the case of receiver adapters, the messaging service for the adapter framework processes the message again. The conditions for this are set in the communication channel monitor.
In the case of sender adapters, you must decide in the adapter implementation whether processing the message again makes sense.
You can revert back for further queries.
Reward if satisfied.
Regards,
Sushama

File adapter and large file

hi experts, i have a problem:
i have configured sender file adapter to send 4mb file from FTP server, so when i upload file to FTP, file adapter don't upload it, file just stay in folder.
I have tried to upload small file, is about 16kb, so it works fine, without any errors
I checked communication channel log in RWB, there are not any errors, all leds are green.
So i don't know how to upload 4mb file, also i checked all rights and permissions for file and user, they all have admin rights - "777".
Can anybody give me some suggestion or solution?
Thanks all for reply.

Hi,
Try to increase your server parameters as below and try ....then you would be able to process large data
u2022     UME Parameters : May be we need to look into the pool size and poolmax wait parameters - UME recommended parameters (like: poolmaxsize=50, poolmaxwait=60000)
u2022     Tuning Parameters: May be we need to look/define the Message Size Limit u201Clike: EO_MSG_SIZE_LIMIT = 0000100u201D under tuning category
u2022     ICM Parameters: May be we need to consider ICM parameters (ex: icm/conn_timeout = 900000. icm/HTTP/max_request_size_KB = 2097152)
Regards,
Naveen

ESB or BPEL file adapter and special characters

Hi,
We have a scenario where we import rows from .csv file through an ESB project into a database. We use the file adapter for this. There appears to be a problem with special characters (like é). Both in the ESB control (with variable tracking) and in the database, they appear as upside down questionmarks (¿). I've tried doing the same with a BPEL project (file adapter as client PL) and in the BPEL console, I also see strange characters instead of the expected special characters (diamond shaped characters, like ♦ to be precise).
I can't find anything about character sets of character set conversions in the documentation. What am I missing?
Regards,
Arjan

see
http://download-west.oracle.com/docs/cd/B31017_01/inte
grate.1013/b28994/nfb.htm#CIAEFBHHI've looked into the properties mentioned. They are set when you go through the wizard. Everything is set to UTF-8, which should provide me with all special characters I need.
BPEL does the exact same thing, so I'm starting to believe that the problem really is with the file adapter.
Regards,
Arjan

File adapter and line feeds

Hi,
we need to produce a flat file using the content conversion of the file adapter without any line feed (the target structure is a complex one with several record types).
Example
What we get now:
*AAheaderA
*ABheaderB
*BAItem1
*CAsubitem1
*BAItem2
What we need:
AAheaderAABheaderBBAItem1CAsubitem1*BAItem2
It seems that with NameA.endSeparator parameter you can only add a new character, but I need to delete the line feed.
Is it possible with standard file adapter or do we need do create our own module with java?
Thank you.

Hi Stefano,
So you Basically want to do content conversion at the receiver end and that is basically to get the entire data in one line.For that please go through these links below.It clearly explains your requirement.
<a href="/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion Receiver with Content Conversion</a>
<a href="http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/frameset.htm">Converting File Content in the Receiver Adapter</a>
carefully make a note of the "The endSeparator parameter.
Regards,
abhy

File adapter and database adapter

hello everybody,
i am using 10.1.3.1.o 10g
i would like to access the data from .txt file and insert into oracle table.
i did the following:
1. i used file adapter(synchronous read) from local system.
2. i used invoke activity to invoke the data from file adapter.
3. i used asynchronous process.
then what are the next steps i have to do?
plse tell me what i have to do.

hello andy,
thanks for reply.
Please read the following:
i did the following:
i have taken asynchronous process.
selected fileadapter from partnerlink list, named as "fileadapter".
selected synchronous read
selected physical path,clicked browse and selected the folder where it is existed, checked delete files after retrieval
typed the file name i.e. test.txt
Define schema for native format selected.
selected delimited, location of the file(F:\test\test.txt)
selected file contains only one record
enter the name as "schema", nxt, next finish.
it created test_1.xsd(schema location). finish
then drag and droped Invoke1 to the swimlane.
in invoke1, selected partner link -fileadapter
operation-synchread
input variable- clicked createinputvariable(Gloabal variable)
output variable-clicked createinputvariable(Global variable)
created onemore partnerlink, selected database adapter
named as "databaseadapter"
selected connection "oracle"( i have already created database connection with oracle 10g)
selected perform an operation on table
selected "INSERT ONLY" option
clicked import tables
clicked query, selected "mindview" table, next, ticked both the columns(slno,name), finish
and the table"mindview" has 2 rows already.
i want to insert 3rd row.
in partnerlink Myrole-"databaseadapter_role" is selected
draged and droped invoke2 after invoke1 in the swimlane
selected partnerlink as "databaseadapter"
operation- insert
Input variable - clicked torch light at right, selected "Invoke_1_SynchRead_OutputVariable"(output variable of invoke1)
on invoke2 icon an error is showing i.e.
Variable Types: {http://xmlns.oracle.com/pcbpel/adapter/file/fileadapter/}schema_msgdoes not matchOperation Input Message: {http://xmlns.oracle.com/pcbpel/adapter/db/databaseadapter/}MindviewCollection_msg
**output variable is inactive mode. i cant select create output variable**
i cant understand whats the problem? everything is right.
This is asynchronous process.
Is there any problem in above mentioned procedure?
if i add transform activity after invoke2, how i can connect without outputvariable of invoke2?
please tell me whats the problem?
Regards
Prasad
Edited by: user12251899 on Dec 3, 2009 9:11 PM
Edited by: user12251899 on Dec 3, 2009 9:20 PM
Edited by: user12251899 on Dec 3, 2009 9:23 PM
Edited by: user12251899 on Dec 3, 2009 9:52 PM

File adapter and clustered application

Similar Messages

Maybe you are looking for