Picking up file sequentially using file Adapter

Hi Experts,
I am working on a scenario, where two type of files are coming to the source directory namely "Data File" and "Flag File".
First, all the data Files will be coming and after that one flag file will be coming containing names of all the data files.
I am using two seperate Communication channels using "File Adapter" to pick these files. One for all tha data Files and one for Flag File.
As per our requirement we need to pick all data files first and then the flag file and process then in the same sequence.
Is there any solution to do it without BPM.
Regrads
Pradeep

Hi Pradeep,
I don't think there is any mechanism where in you can direct the sequence of files to be picked ,more over you are using two communication channels .So both will act individually as per the poll interval.For your requirement. BPM Pattern Collect Message suits better as it always waits for Stop message to finish the integration process.In your case stop message can be your Log file.
Then all the data files will get processed at a time as soon PE receives the Stop msg (Log file).
Thanks,
Ram.

Similar Messages

Sender File Adapter - Dynamic Filename?

Dear All,
I have a simple requirement to retrieve a file named "XXX_ddmmyy" from an FTP site. The FTP site administrator will place a new file everyday. The date is part of the filename.
I can find a lot of information on how to set the Filename for a "Receiver File Adapter", but none about dynamically setting of the filename for a "Sender File Adapter".
Can you help please?
Kind Regards
Farshad

Hi,
You have mentioned over here that the requirement is to get the file "XXX_ddmmyy" from an FTP site.
Is that site strictly for keeping files related to your requirement only or lot of other files are also being placed???
If its strictly related to your requirement then you can use the filename "*.extension" and set the processing mode as "delete" so that once the File Adapter picks the file it will be automatically deleted.
But here disadvantage is that the file wont be no longer present in FTP site once it is picked by File adapter.
Thanks,
Lekshmi.

Sequential files proccessing using SFTP adapter in Biztalk

Hi All,
I want pick the file by sequential from receive location by using SFTP adapter.
Can anybody please tell me What is the process flow of sequential picking the file in biztalk??
Thanks In advnce
Prabhakar

You can check the following links
http://msdn.microsoft.com/en-us/library/aa561967.aspx
http://social.technet.microsoft.com/wiki/contents/articles/6378.biztalk-instance-subscription-and-convoys-details.aspx
http://geekswithblogs.net/michaelstephenson/archive/2009/01/01/128295.aspx
http://abdulrafaysbiztalk.wordpress.com/2009/10/20/enterpriseintegrationpattern_resequencer/
http://www.cloudcasts.net/ViewWebcast.aspx?webcastid=2521599811294205439
for picking up file from sftp you need to use either
builtin sftp adapter in for BizTalk 2013 or open source sftp adapter for earlier versions
I hope this will help you

Which user is used to pick-up and archive files using the file adapter?

Hi guys,
which one it is? is it XIPADM?
thank you,
Olian

Hi! Olian,
You can get archive the file from FTP Server also or else even you can kept the folderrs in your local machine also....its your choice..
Suppose if you want to Keep and archive directory or else a folder of another copy at which you are sending files from XI you can follow the below steps...
1. While configuring the Sender File Adapter you can select the option of ARchive directory ....there in File Adapter Parameters..
2. Select that radio button and then create first one seperate folder in FTP location and then you can enter that directory path name in the Archive directory 3. Also if you want to delete the files from where the XI is picking the files from the source directory means select option called Delete.......
3. Then automatically it will be deleted once the file is picked and also it can maintain another copy file in the archive folder or directory...
I hope it can be useful to you.and this is sufficent to you...
Regards:
Amar Srinivas Eli

Picking Multiple Files using File Adapter

Hi ,
I have two files in the Output folder with the names:
Invoicedata
InvoiceControl
and FTP it to the FTP server with the same file name .
if i use the source file name in the sender file adapter as invoice. .In the Receiver file adapter what i the file name that i need to specify inorder to have the same file names ie
Invoicedata
InvoiceControl
Iam using PI 7.0 .No Mapping is done.
Thanks & Regards,
Y.Raj

XI in the role of a FTP
read thru that blog.
if you are not using any mapping then, toward the end of the weblog there is a link to another weblog which will be of help.

File adapter to pick a single file

The scenario is PI File adapter would pick files from a 3rd party FTP location. The 3rd party is placing files with file names using date time stamp.
The requirement is to process one file at a a time - I have mentioned the Processing Sequence as 'By Date' which means the adpater would pick the files sequentially. But I want the adapter to pick only one file at a time rather than picking all the available files in the system.
Is that possible to do?
Thanks.
Anuradha.

Hi Anuradha,
Could you please kindly provide answers to the queries below so that forum members can have a clear picture of your requirement
1. What is the operating system of your PI server?
2. What is the version of PI you are working on?
3. What exactly do you mean by statement " I want the adapter to pick only one file at a time rather than picking all the available files in the system." since adapter will actually pick up files one by one only in each polling interval. This goes in PI pipeline
one after another in quick succession.
4. Do you mean that you want to insert delays between successive file pick up then Baskar has already answered your question.
5. Do you want the channel to pick up only one file in a day out of all possible file?
6. Could you please kindly provide any sample file name you are receiving in PI ?
regards
Anupam

Using wildcards (*) in sender file adapter - FTP type

Hi guys!
Dooes it work using wildcards in sender file adapter (FTP type(!) (filesystem obviously work))? I tried it and it failed. it works only for exact name..
I read some articles about FTP and the result is, that ftp work always only with 1 file, so I'm wondering, if this is possible.
Thanks for info!
Olian

Thanks for all replies..
I know of course, that * can be used, I use it in many scenarios too. But on a FileSystem. It is not working if the sender type is FTP.
*, ., *.dat, ... nothing like that works.. Just exact file name.
I am able to pick up file, if I specify it's exact name, so there should be no problem with permissions..
Please, I'd appreciate one reply with comfirmation: yes, we are using asterisk (*) , we access source files via FTP and they are processed.
Is there anybody with this experience, that it works?
Thank you!
Olian

Problem in Sender File Adapter using FCC with Variable structure

Hi Experts,
Hi Experts,
I have facing an issues while using FCC in Sender File adapter. Below are the configs for the same:-
Recordset structure required is ==HEADER,1,DATA,*,TRAILER,1
Recordset per message == *
Key Field Name == Key
(Sorry i dont know how to insert screen shot here..pls tell me how can i insert screen shots here on sdn)
HEADER.fieldSeparator           ,
HEADER.endSeparator           u2018nlu2019
HEADER.fieldNames               Key,x,y,zu2026
HEADER.keyFieldValue          1
HEADER.keyFieldInStructure      ignore
HEADER.fieldContentFormatting     trim
HEADER.additionalLastFields     ignore
HEADER.missingLastFields     ignore
DATA.fieldSeparator
DATA.endSeparator
DATA.fieldNames
DATA.keyFieldValue
DATA.keyFieldInStructure
DATA.fieldContentFormatting
DATA.additionalLastFields
DATA.missingLastFields
Using same variables for Trailer record as well.
Source CSV file which i am picking:-
ADSE ,RASD,replan Contact ,2 0080509 0 8:43:25   ,
EMPL ,0011111, S Top Up ,20080401 ,20080430 ,sdf ,                          00000000431250 ,2007                                    , , , , , ,20080414 18:07:35,
EMPL ,0222222, r Cash Award ,20070701 ,20070703 ,ded ,                          00000000023509 ,2007                                    , , , , , ,20080414 18:09:31,
EMPL ,0233333,   Cash Award ,20070801 ,20070831 ,df ,                          00000000044057 ,2007                                    , , , , , ,20080414 18:10:56,
EMPL ,0244444,   Cash Award ,20080101 ,20080111 ,sf ,                          00000000026717 ,2007                                    , , , , , ,20080414 18:08:29,
BTRL ,   5140,
When i tested the scenario and monitored it using MDT in CC monitoring tool its giving me below mentioned error.
The XML page cannot be displayed
Cannot view XML input using style sheet. Please correct the error and then click the Refresh button, or try again later.
XML document must have a top level element. Error processing resource 'http://myurlname/mdt/me...
However if i change the occurence of DATA as some specific value for eg 4 instead of * it works fine.
Kindly help me in solving this problem.
Thanks,
Aditya Verma

Hi Madan,
Thanks a lot for giving me the way to this. But when i tested this with the below file its giving me the same error. Please let me know if i need to do any changes to the parameters mentioned above:-
ADSE ,ASDA,Sha replan Fr ont Feed Contact ,2 0080509 0 8:43:25   ,
EMPL ,0011111,   Cash Top Up ,20080401 ,20080430 ,TPV ,                          00000000431250 ,2007                                    , , , , , ,20080414 18:07:35,
EMPL ,0222222,   r Cash Award ,20070701 ,20070703 ,TPV ,                          00000000023509 ,2007                                    , , , , , ,20080414 18:09:31,
EMPL ,0233333, r Cash Award ,20070801 ,20070831 ,TPV ,                          00000000044057 ,2007                                    , , , , , ,20080414 18:10:56,
EMPL ,0244444,   Cash Award ,20080101 ,20080111 ,TPV ,                          00000000026717 ,2007                                    , , , , , ,20080414 18:08:29,
EMPL ,0255555,   Cash Award ,20080301 ,20080320 ,TPV ,                          00000000027870 ,2007                                    , , , , , ,20080414 18:08:25,
EMPL ,0266666,   Cash Award ,20071001 ,20071020 ,TPV ,                          00000000020681 ,2007                                    , , , , , ,20080414 18:09:31,
EMPL ,0877777,   Cash Top Up ,20080401 ,20080430 ,TPV ,                          00000000036000 ,2007                                    , , , , , ,20080414 18:07:05,
EMPL ,0888888,   Leaver Cash Award ,20071201 ,20071231 ,TPV ,                          00000000157200 ,2007                                    , , , , , ,20080414 18:11:29,
EMPL ,0899999, S Leaver Cash Award ,20080301 ,20080331 ,TPV ,                          00000000153530 ,2007                                    , , , , , ,20080414 18:07:42,
EMPL ,0800000, S Leaver Cash Award ,20070701 ,20070731 ,TPV ,                          00000000012234 ,2007                                    , , , , , ,20080414 18:08:34,
BTRL ,   5140,
This the original csv file which i'll get in live. Kindly suggest as ur solution worked with other file but not working with this scv file.
Thanks a lot,
Aditya.

File(FTP) Adapter doesn't pick any file from FTP server

Hi All,
This is a strange problem. I am trying to pick all the file from a FTP server using File Name: . . But the file adapter doesn't pick any file from the directory. When I change it to a specific file name eg. ABC.txt then it picks up the file ABC.txt only.
My requirement is to pick up all files in the directory and I just do not seem to understand what is wrong. I have used this wildcard option several times earlier and it always worked fine. But in this case, this does not work.
I changed the FTP server to point to an internal FTP server and it works fine.
I have checked all my parameters and everything looks okay. Like I mentioned earlier, if you specify exact file name, it picks up the file.
Any guess as to what is going on here?

Transport Protocol: FTP
Message Protocol: File
source directory: /test or test ( either one works)
file name: * or . or *.txt nothing works
server: ftp server name
port: 21
data connection: passive
user: ******
pass: ******
connect mode: permanently
transfer mode: text
QOS: exactly once
poll: 10 secs
processing mode: archive ( changed to test and delete as well, but made no difference.)
archive dir: dir path
file type: text
adapter specific attributes:
checked: set adapter specific attributes
and file name.
status: active.

File adapter should pick a single file at a time

Hi,
I have File to RFC scenario.. in my source directory I'm getting bunch of files with the same name. at a time.. but i want to pick the one by one only. that means.. my file adapater poll interval is 30 seconds.. every 30 seconds it will pick the one file.. even though there are multiple files.. but my file adapter should pick a single file ata time..
but at present my file adapater was picking all the files ata time.. but i want to make my file adapter should pick single file ata time..
for this.. any special configuration we need to do.. or any ideas or suggestion .. will be.. appriciated..
regards
Babu

>>any special configuration we need to do..
there is no default configuration to achieve this functionality.
I speculate that any of this should work.
1. Post the files to a intermediate directory and use a SCRIPT/Batch program to move only one file at a time frame to the source directory.
2. Uncheck the option Process Read only files in the sender CC to prevent the file adapter to pick the read only files. Use a script that changes the permission of one file at a time so that the file adapter will pick that file alone.
In both the cases the script needs to be scheduled at the OS level to run every 30 seconds.
Thanks
SaNv....

Reading one file at a time using File Adapter

I am using a File Adapter which polls every minute to read files from a Folder. This process picks up all the files in that folder. What I want to achieve is that the File Adapter should read one file at a time. Is it possible to force it to wait for a few seconds before reading the Next file in the Folder. Or is there a solution to what I am trying to achieve? Any help would be appreciated.

public static char readChar() {
int ch;
char r = '\0';
boolean done = false;
while (!done) {
try {
ch = System.in.read();
r = (char) ch;
if (r == '\r') {
System.out.println("Not a character. Please try again!");
System.in.skip(1);
done = false;
} else {
System.in.skip(2);
done = true;
} catch (java.io.IOException e) {
done = true;
return r;
Try this as an method and then use it..
This code will read will be in response untill you hit the return key but will take only the first character....

Reciever File Adapter - Temp File Name Scheme using Variable Substitution

How can I create a temporary file that uses variable substitution?
We are having a problem with files merging when we write files using the "Use Temporary File" setting on the FIle Adapter. So two independent files are merging into a single file. We are not using the "Append" setting.
We would like to use a Temp File Name Scheme that would append the message id onto the temporary file name.
Using variable substitution we created a msgid variable. When added to the temporary file name using %msgid% the temporary file name is created with %msgid% in the name instead of the actual message id. We put the variable into the "File Name Scheme" as well and the end completed file used the message id in the name.
Any Ideas?
Thanks,
Matt

HI Matthew,
Why are you adding the message id into the temporary file??
I understand that you want the output of the filename to contain message id .. and hence you are using variable substitution for the same.
Temporary file name will anyways get overwritten by the actual file name (here the actual filename will be using variable substituion).
So i suggest to achieve your scenario you can add any name in the temporary file and maintain the desired filename you require as output in the variable subsititution.
Temporary File Name option actually acts as a lock - unlock mechanism from PI side while the file is getting written to the file server so that while PI is writting the file no third party application batch program picks it up.
I hope this helps.
Cheers
Dhwani

Sender File Adapter Not Picking Any File

Dear Expert,
I am newbie in PI. Just tried to create File Content Conversion Scenario. Details as follow :
1. Source Directory ..\file\log\test_q.txt
2. Target Directory ..\file\log\xml\test_q.xml
Transport Protocol : NFS
Message Protocol : File Content Conversion
Adapter Engine : Integration Engine
I have completed all the design and configuration in IR and ID. However, when I produce the log file in the directory, nothing happen.
Hacing checked in the RWB as well, I could not find any clue. simply nothing happen.
Would you please advise me on how to trigger the interface? As per my understanding, sender file adapter will be activated directly once the file is created.
Thank you very much in advance.
Best Regards,
Y

Hi Yonisiwa,
Things you should check here are:
1) If the sender file adapter is active or not.
2) If the source directory is correctly spelt or not. (Check if you are using the correct slash \ or /)
3) The file name/mask is correct or not.
4) The polling interval is too long.
Alternatively, you can check the message monitoring in RWB at the adapter level and go into the audit log if the message.
There you can see the reason for the file not being picked up.
Also check the Communication Channel status in the Component Monitoring link in RWB.
Regards,
Ravi Kanth Talagana

Sener file adapter has read/pick the files first in first out method.

HI
In my Interface I am Using Sender as File adapter. As per my requirement Sender file adapter has to read the file from file directory. This directory having 1000u2019s of files with some files are same name (time stamp is different) and some files are different name here file adapter has to pick the file with mentioned name in File sender adapter like ZMPSMSGSTATUSMST-.xml .
But source file name is like <TABLENAME>-<TIME_STAMP>.XML (ZMPSWRKFLOWHIST-20090527-150522-628) in file directory.
The file adapter in XI will poll to this directory and picks the file in first- in first-out by sorting according to timestamp.
To do this configuration what I have to do in sender file adapter please give me your valuable inputs.

HI Abhi,
Thank you for your spot replay.
I tested now but i am geting below error.
Putting message into send queue failed, due to: com.sap.aii.af.ra.ms.api.DuplicateMessageException: Message ID f4ca4f86-9c5d-4bdd-1fb1-a6bd7cda99a8(OUTBOUND) already exists in database: com.sap.sql.DuplicateKeyException: [NWMss][SQLServer JDBC Driver][SQLServer]Violation of PRIMARY KEY constraint 'PK__XI_AF_MSG__491A1D0B'. Cannot insert duplicate key in object 'dbo.XI_AF_MSG'..
Could not archive file 'E:\file\in\ZMPSMSGSTATUSMST-20090527-150522-628.xml' after processing
but i am able to see this file in Archive foleder. once file is archivied sucessfully the same file is delted from source directory?
I given processing parametes queue name is TEST.
Thanks
srinivas
Edited by: srinivasreddy p on May 28, 2009 8:43 AM
Edited by: srinivasreddy p on May 28, 2009 8:52 AM

Vaildating File name with the data in the file using sender file adapter

Hi,
Below is the scenario
1) Pick up files from a FTP server, the file name is dynamic, how do I put dynamic name in sender file adapter?
2) Determine if the user correctly named the file based on data in the file.
a. File naming structure that we will be concerned with is <company_code><accounting_time_period>.<extension>
b. The company code and the time period in the file name have to match the data in the file.
i. For example. If the file name is 1001_200712.csv and the data in the file is for company code 1005, time period 200712, the file is incorrectly named. Both values must be correct.
How do we do this?

Hi Sachin,
 As Rightly said by Krishna, You can not put Dynamic name in sender File Adapter .You have to provide the name of the file like "*.txt" in Sender Adapter and at runtime you can access this file name by using following UDF:
DynamicConfiguration conf = (DynamicConfiguration) container
.getTransformationParameters()
.get(StreamTransformationConstants.DYNAMIC_CONFIGURATION);
DynamicConfigurationKey key = DynamicConfigurationKey.create("http://sap.com/xi/XI/System/File","FileName");
String valueOld = conf.get(key);
return (valueOld);
As now you have picked up the file name at runtime.
Now concatenate source file fields Company_code and Accounting_timeperiod using "_" as delimiter in properties.Also concat the extension .Now you have required file name.
So using EQUALS standard function ,compare it with File Name fetched at runtime using above given UDF, and pass result as you desire to process further or not or to raise Alert to resend the file.
Thanks & Regards,
Anurag Garg
You can validate this file name in Mapping itself.

Picking up file sequentially using file Adapter

Similar Messages

Maybe you are looking for