Error on polling 2.5 gb file using FTP adapter
HI All
We have FTP adapter which is polling 2.5 gb of file on single node instance in SOA 11.1.1.6.
It is working fine with single node instance but its failing on cluster 2 node instance.
We are polling zip file and all the FTP configuration are made as per the HAFTPAdapter settings and its using SOA dataSource .We have changed all the possible setting for JTA time out and also on data source XA transaction but still no luck.
Error
====
The action "update action" cannot be performed on the instance "2340091" because of its current state ("unknown").
The current instance state did not allow the requested action to be performed.
Consult the product documentation for a list of all the permissible actions that can be performed on an instance when it is in the "unknown" state.
ORABPEL-02041……..
[2013-11-28T05:57:00.324+00:00] [soa_server1] [ERROR] [] [oracle.soa.bpel.engine.dispatch] [tid: orabpel.invoke.pool-4.thread-14] [userId: <anonymous>] [ecid: fcc5d9e1c7acffe4:f35f602:14299c196ac:-8000-0000000000036f42,1:18707] [APP: soa-infra] [URI: /soa-infra/services/default/XMLValidation_FileNameBPEL/FileNameValidationBPEL_client_ep] failed to handle message[[
weblogic.transaction.internal.TimedOutException: Transaction timed out after 302 seconds
BEA1-25F2BD0F3E4FBDE133EB
at weblogic.transaction.internal.ServerTransactionImpl.wakeUp(ServerTransactionImpl.java:1788)
at weblogic.transaction.internal.ServerTransactionManagerImpl.processTimedOutTransactions(ServerTransactionManagerImpl.java:1676)
at weblogic.transaction.internal.TransactionManagerImpl.wakeUp(TransactionManagerImpl.java:1988)
at weblogic.transaction.internal.ServerTransactionManagerImpl.wakeUp(ServerTransactionManagerImpl.java:1586)
at weblogic.transaction.internal.WLSTimer.timerExpired(WLSTimer.java:35)
at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:273)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
=====
Is there anything we need to check or change in SOA server configuration .
Thanks
AK
Below are the settings which we tried out. The file where it's writing is shared network drive.
1) SOA datasource
<xa-transaction-timeout>1000</xa-transaction-timeout>
2)JTA
Parameter Name
Default Value
Tuned Value
Timeout Seconds
30
3600
Abandon Timeout Seconds
86400
3600
Maximum Duration of XA Calls
240000
24000
Thanks
AK
Similar Messages
-
Problem archiving file using FTP adapter
Hi,
I am polling some files from another server using FTP adapter in SOA 11g. Even though I have checked the option to archive the files, the files get archived successfully on the server where the SOA process is running, but I am unable to archive the files on the server from which I am reading the file
I am not sure whether this is the default behaviour or is there any way to archive files on the same server from which I pick or read the file.
Any help is appreciated.
Thanks,
NamrataHi Neeraj,
Thanks, the archiving in the remoteLocation worked by doing what you told me...
I tried archiving to the local machine which is not working for me ... i gave both the properties as below...
<property name="UseRemoteArchive" value="false"/>
<property name="PhysicalArchiveDirectory" value="C:\Users\naresh\Desktop\ftp"/>
Thanks,
Naresh -
File format conversion of Target file using FTP adapter
Hi All,
I am using FTP adapter to create the file on the Target side. But file needs to below format : How do i conver the XML File fomat( Default generate by XI ) to be generat to below file format;
000000000000154162,
CWC1A,,,,
CWC1B,,,,
CWC2A,,,,
CWC2B,,,,
Please provide your suggestion;
thanks;
MKHi Mohan,
I have a collection of Blogs (links) which Specify the File content conversion parameters.
File content conversion, I am Not sure as which Link will Match Your Requirement exactly...
/people/shabarish.vijayakumar/blog/2006/02/27/content-conversion-the-key-field-problem
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter
/people/arpit.seth/blog/2005/06/02/file-receiver-with-content-conversion
http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
Please see the below links for file content conversion..
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter - FCC
/people/michal.krawczyk2/blog/2004/12/15/how-to-send-a-flat-file-with-fixed-lengths-to-xi-30-using-a-central-file-adapter - FCC
File Content Conversion for Unequal Number of Columns
/people/jeyakumar.muthu2/blog/2005/11/29/file-content-conversion-for-unequal-number-of-columns - FCC
Content Conversion (Pattern/Random content in input file)
/people/anish.abraham2/blog/2005/06/08/content-conversion-patternrandom-content-in-input-file - FCC
Regards,
Sainath chutke -
Help on Trasnfering .wsdl/xml format files using FTP Adapter
Hi,
I am new to Oracle BPEL and JDeveloper....
I created some processes to transfer .txt files from one location to another location using FTP Adapter..
Know I have some files on .wsdl/xml format... using bpel process can we transfer these files from one location to another location using FTP Adapter (Is it possible for .wsdl/xml files)
can any one help me on this plz
Thanks
VenkatThanks Guys .. I am able to transfer .WSDL files also
Thanks
venkat -
FTP Adapter polling lowercase or uppercase files using single adapter
Hello All,
I was wondering if we can use a single FTP Adapter to poll Lowercase or Uppercase files. For example either abc*.txt or ABC*.txt.
Does the FTP adapter by default support this option, because its not working in my Case and if its supported does it depend on the FTP server settings/security.
Help is much appreciated.
Thanks
KrisHema wrote:
How does it decide which files to pickup ? It will pick up files with modification dates more recent than the last processed file.
sometimes it picks up all old files from FTP directoryIf it is picking up the same files, probably it is not being able to calculate the modification dates.
That can be a configuration problem, take a look at this:
http://docs.oracle.com/cd/E17904_01/integration.1111/e10231/adptr_file.htm#BABECEGD
Note: We are not deleting already read files from the folderProbably, not a good thing to do. May you can archive them instead.
Cheers,
Vlad
Give points - it is good etiquette to reward an answerer points (5 - helpful; 10 - correct) for their post if they answer your question. If you think this is helpful, please consider giving points -
Novice Question: XML File using FTP Adapter Help Requested
I need to create (publish) a message from an XML file that is written to a particular folder on a Win2000 machine (I intend running the adapter on the same machine). I think that the FTP adapter should be the easiest way to do this but I have only used this adapter to publish DL3-defined files, and only then on a unix platform.
Is the FTP adapter the correct approach or is there a better way, and if it is the correct approach, can anyone point me to a sample application or pass along a sample adapter.ini so I can figure out configuring the adapter.
Thanks
EricWe use the FTP adapter for both reading and writing XML files. And it works quite OK (there are a few gliteches but nothing you cannot work around). You need to first make (find) a DTD for your XML file and import that as the AV for the message in IS (IStudio). Then you just point the adapter to the correct directory and it should work from there.
As for better way Im not sure I'm no InterConnect expert but I dont know any other way to do it.
Might be worth to notice (if you didn't already know) that you dont actually need FTP if it is on the local filesystems you can in the FTP adapter read from the local FS something along the lines of file:///c:/foo/bar as oposed to ftp://...
As for adapter.ini you shouldn't need anything besids pointing the reciver to the correct directory the rest is done from IS.
Let me know if you want more details...
// MickeM -
RENAME/COPY/DELETE a file using FTP Adapter in 11g using dynamic values
Hi All
We have a requirement to do the above for a client. I was able to find a post\blog that tells you to add the below properties in FTP adapter JCA file and it works but,
<interaction-spec className="oracle.tip.adapter.ftp.outbound.FTPIoInteractionSpec">
<property name="SourcePhysicalDirectory" value="foo1"/>
<property name="SourceFileName" value="bar1"/>
<property name="TargetIsRemote" value="false"/>
<property name="TargetPhysicalDirectory" value="foo2"/>
<property name="TargetFileName" value="bar2"/>
<property name="Type" value="COPY"/>
</interaction-spec>
The problem is that how to assign these values dynamically (from xpath or bpel variables etc). Can somebody provide me with some pointers? Its very urgent!Use the below approach to set the directory and file names dynamically.
In BPEL source mode, specify the bpelx:inputProperty. Set the values for these variables in bpel. These can also be accessed as bpel preference values.
<invoke>
<bpelx:inputProperty name="jca.ftp.SourceFileName" variable="SourceFileNameVar"/>
<bpelx:inputProperty name="jca.ftp.TargetFileName" variable="TargetFileNameVar"/>
</invoke> -
How to read the whole text file lines using FTP adapter
Hi all,
How to read the whole text file lines when error occured middle of the text file reading.
after it is not reading the remaining lines . how to read the whole text file using FTP adapter
pls can you help meYes there is you need to use the uniqueMessageSeparator property. Have a look at the following link for its implementation.
http://download-west.oracle.com/docs/cd/B31017_01/integrate.1013/b28994/adptr_file.htm#CIACDAAC
cheers
James -
Processing files in Sequence using FTP Adapter
Hi Experts,
I have searched several forums but i am not clear on how to process the files using FTP Adapter based on Timestamp.
To process the files in sequence i.e, FIFO using FTP Adapter
i have the files with file name customer and timestamp : customer<yyyyMMddHHmmss>
there are around 50 files in the FTP server llike this.
I need to process these files acording to the timestamp and place the files in same processing sequence in the receiver end using the file adapter.
If i specify the parametes in sender FTP Adapter as
Qos= EOIO
Queue name = ACCOUNT
Whether these parameters would do the processing in sequence according to the Timestamp?
Suppose if the queue ID for Inbound(SMQ2) is XBTI0_ACCOUNT then whether it will be the same for Outbound(SMQ1)?
Kindly suggest me how to process the files in sequence according to the Timestamp using FTP Adapter
Please reply..
Thanks
SaiHi Shabarish,
But this would require one more additional channel to process
So i think it will take more time to process.
Let me clarify my question once again.
I need to Pick the files from FTP server based on their TimeStamp and in sequence.
the file names are like this Customer<YYYYMMDDHHmmSS>.
suppose i have 3 files as
Customer20050413044534
Customer20050414053430
Customer20050315034533
So i need to pick these files in this order and place the files in the same order to the receiver end(File Adapter)
Customer20050315034533
Customer20050413044534
Customer20050414053430.
As i am using FTP sender adapter i cannot use processing sequence "By Date".
please suggest me on this.
Thanks
Sai. -
Duplicate File issue using FTP adapter - BizTalk 2010
Hi We encountered an Issue of picking Duplicate files in BizTalk 2010 from the FTP Location. Need your assistance on this.
Mainframe sends multiple files a 0 KB file to FTP and BizTalk picks during a particular service window using FTP Adapter.
Receive Location has a pipeline component which decodes the MF file(EBCDICRow format).
Send Port transmits the file which is decoded in the Receive location. There is no mapping or orchestration involved.
When 2 files are placed in FTP Location. BizTalk Transmits the files successfully
No suspended messages in BizTalk but we see below error in event log. we tried reproduce the issue but no luck.
Host Instance running FTP Location is Clustered
There was a failure executing the receive pipeline: "XXXX.XX.Pipelines.Receive_XXX_TransactionsMC_passthru, XXX.XX.Pipelines, Version=1.0.0.0, Culture=neutral, PublicKeyToken=c2d1f476d5c2f97d"
Source: "EbcdicRowDeCode" Receive Port: "XXX.XX.MCSTransactionsMC" URI: "ftp://XXXXXXXX:21/'XXXX'/MCSDT.DEFKOP.R001.D*.T*" Reason: Unable to cast object of type 'Microsoft.BizTalk.Streaming.BasicStreamWrapper' to type 'XXX.BizTalk.Pipeline.Components.Streams.V3.VirtualStream
MF Puts below Files at FTP Location
PSNOX.MCSDT.DEFKOP.R001.D150406.T009000
PSNOX.MCSDT.DEFKOP.R001.D150406.T002100
BizTalk Picks ( at specified Service window) and Transmits as
PSNOX.MCSDT.DEFKOP.R001.D150406.T009000
PSNOX.MCSDT.DEFKOP.R001.D150406.T009000
PSNOX.MCSDT.DEFKOP.R001.D150406.T002100
Regards
-SriHi Sri,
There could be two reason for such a behavior:
1) Using Non-Clustered Hosts: It is always recommended to use the clustered host for FTP adapter. Because FTP don't allow
any locking mechanism on the files so in case of non-clustered with multiple host instances you might receive same file multiple times through different host instances.
2) If the original document is still being written to the FTP server by the host application, the FTP adapter cannot
delete the document and will retrieve another copy of the document at the next polling interval that is configured for the receive location. This behavior causes document duplication to occur.
Workaround could be:
Configure the host application to write to a temporary folder on the same hard disk as the public FTP folder and to periodically move the contents of the temporary folder
to the FTP folder. The temporary folder should be on the same hard disk as the public FTP folder to make sure that the move operation is atomic. An atomic operation is an operation that is functionally indivisible. If you write data to the public FTP folder
by using the BizTalk Server FTP adapter, you can do this by specifying a Temporary Folder property in the FTP Transport Properties dialog box when you configure a send port. If you specify a Temporary Folder property, make sure that this folder is on the same
physical disk as the public FTP folder.
Configure the FTP receive location to operate within a service window when the host application is not writing data to the FTP server. You can specify the service window
when you configure the receive location properties.
Refer: Known Issues with the FTP
Adapter
Rachit
Please mark as answer or vote as helpful if my reply does -
HOW to read file using ftp???
Hi to all,
I have problem with reading file using ftp connection, i want to read only 1024 bytes for one time, and i have
next code wich read this:
byte buffer[] = new byte[1024];
while( (readCount = input.read(buffer)) > 0) {
bos.write(buffer, 0, readCount);
but I dont know how to put all read data in one byte[] if i dont know length of file.
I can't do some like: byte file[] = new file[1000000];
Thanks for all sugestions!* Download a file from a FTP server. A FTP URL is generated with the following syntax:
* <code>ftp://user:password@host:port/filePath;type=i</code>.
* @param ftpServer FTP server address (incl. optional port ':portNumber').
* @param user Optional user name to login.
* @param pwd Optional password for <i>user</i>.
* @param fileName Name of file to download (with optional preceeding relative path, e.g. one/two/three.txt).
* @param destination Destination file to save.
* @throws MalformedURLException, IOException on error.
public void download(String ftpServer, String user, String pwd, String fileName, File destination) throws MalformedURLException, IOException {
if (ftpServer != null && fileName != null && destination != null) {
StringBuffer sb = new StringBuffer("ftp://");
if (user != null && pwd != null) { //need authentication?
sb.append(user);
sb.append(':');
sb.append(pwd);
sb.append('@');
}//else: anonymous access
sb.append(ftpServer);
sb.append('/');
sb.append(fileName);
sb.append(";type=i"); //a=ASCII mode, i=image (binary) mode, d= file directory listing
BufferedInputStream bis = null;
BufferedOutputStream bos = null;
try {
URL url = new URL(sb.toString());
URLConnection urlc = url.openConnection();
bis = new BufferedInputStream(urlc.getInputStream());
bos = new BufferedOutputStream(new FileOutputStream(destination.getName()));
int i;
while ((i = bis.read()) != -1) { //read next byte until end of stream
bos.write(i);
}//next byte
} finally {
if (bis != null) try { bis.close(); } catch (IOException ioe) { /* ignore*/ }
if (bos != null) try { bos.close(); } catch (IOException ioe) { /* ignore*/ }
}//else: input unavailable
}//download()If you don't want to strore the data into a file, use ByteArrayOutputStream instead of a FileOutputStream. -
Not able to send file Using FTP in SSIS 2005
I am using SSIS 2005
I am trying to send file to ftp server using FTP task in SSIS but i am getting following error.
Error Message-:An error occurred in the requested FTP operation.
Detailed Description-:550 /FileName.txt: Access is denied.
RemotefilePath is /
I need a advice.
Thanks in advance.I got this error recently from the FTP task in SSIS:
Unable to send files using "FTP".
I had everything correct, by the book. I was trying to send a file, but I got the same error when trying to receive a file.
I already verified that I could send the file via command line FTP, so the FTP was not "secure FTP" (which wouldda required FileZilla or WinSCP or something similar) and my credentials were fine.
But I still got the above error. Heck, I was beginning to thing that the FTP task in SQL Server 2008 was broken and just couldn't send files.
Well, this issue is now resolved. The problem was in the
destination folder. I was assuming that the root folder for my FTP account held the files.
So I entered the destination folder as this:
/data_in/
But... the FTP task sees the root folder as one up from that.
So I had to use my account name in the path... meaning I had to change the destination folder to this:
/myaccountname/data_in/
(where "myaccountname" was my login to the FTP site.)
I hope this post helps someone else.
Donna -
How to Create a Flat File using FTP/File Adapter
Can any body done workaround on creating the Flat file using FTP/File Adapter?.
I need to create a simple FlatFile either using of delimiter/Fixed length. using the above said adapters we can create XML file, i tried concatinating all the values into a single String and writing into a file, but it does not have proper structure
Can any body help me out on this..
Thanks
RamYou can create a text schema while creating a File Adapter. If schema is specified for File Adapter, it takes care of converting XML into fixed length or delimited format.
Thanks,
-Ng. -
Sending empty files using SFTP Adapter
I am trying to send empty files using SFTP adapter. The interface has to send the file whether its empty file or containing data using SFTP adapter. I am using BizTalk Server 2013 R2. Is it a bug or the hotfix is already there for this issue.
The issue here is not your SFTP not able to send 0KB files, but the file receive adapter that is receiving the file. The file adapter deletes 0 KB files and doest not transmit it further.
If u have a ftp receive for example you should be able to send 0KB files.
If u have a custom file receive adapter , is it handling 0KB files ?
Regards <br/> When you see answers and helpful posts,<br/> please click Vote As Helpful, Propose As Answer, and/or Mark As Answer -
How to download file using ftp in bash script
Hi! I'm runnig a bash script in solaris i want within the script to dowload file using ftp
How can i do it?
Tanks a lothello,evgchech
please try this way:
1. In the bash script, try following command:
ftp -n < ftpcmdfile2 in the ftpcmdfile (which is a file),coding the interactive commands of FTP such as:
user anonymous [email protected]
cd /var/sun/download
bi
mget *.*
bye
try it and good luck!
Wang Yu
Developer Technical Support
Sun Microsystems
http://sun.com/developers/support
Maybe you are looking for
-
.pdf with no security settings won't place in InDesign
A received .pdf file with no security settings will not place in InDesign. I receive a "This PDF document was saved with security settings which prevents its pages from being placed." Even when I save it as a new .pdf with no security settings, it
-
My Adobe Acrobat 10 Pro creates PDFs with a GRAPH background. How do I make the scanned documents have a normal white background?
-
Need help connecting guitar rig interface to play electric guitar
I am having trouble connecting a guitar rig session interface. Garageband is not recognizing the connection. i have made sure the usb and guitar cables work. i have changed the sound input settings on both the system and garage band. when i plug in m
-
Apple Applications Will Not Print
After installing new Epson 2.1 print driver in Snow Leopard all Apple Applications will not print now. (Text Edit, iPhoto, Safari -ect.) Yet all other Applications will print Adobe, Microsoft ect. ) Try downgrading print driver, but that did not work
-
[svn:fx-trunk] 11288: Drag and Drop - add checkintest
Revision: 11288 Author: [email protected] Date: 2009-10-29 17:53:37 -0700 (Thu, 29 Oct 2009) Log Message: Drag and Drop - add checkintest QE notes: None Doc notes: None Bugs: None Reviewer: Alex Tests run: checkintests Is noteworthy for integra