Picking up files in a sequence order

Hi,
My requirement is to picking up the files in a sequence order,
The sequence no. (say for eg 1, 2, 3,etc)will be attached along with the files.
i.e file1.xml,file2.xml,file3.xml etc
suppose if my input folder contain file1.xml, file2.xml,file4.xml
PI has to pick up file1 and file2 and it has to wait for file3 to arrive.
ie. it shouldnt pickup file4.xml since there is no file3.xml.Sequence no3 is missing.
If i give processing sequence as name, it will pick file1 first and then file2 and file4.it will never check file3 is missing or not. how can i achieve this?
Is there any way to do this with out writting a shell script?

Hi,
I think in that case, just use the dynamic getFileName java UDF in your mapping and in that UDF you can define the thread.Sleep interval after checking with the conditions for the file sequence.
Although I have never tried but this might be a right approach to achieve this functionality.
Thanks!

Similar Messages

Re-arranging files to new sequence order by name to export

Hi,
Is it possible to re-arrange picture files within a LiteRoom Window?
How to organize a list of picture files merged from different Windows Folders into a user order?
This should be an obvious requirement of any SQL Database program.
How else can picture files from various locations be organized into a correctly formatted order?
I would hope a simple drag and move option would be available.
Once the correct order was arranged, a file renaming process would establish that correct order to be used in any application or browser.
For instance: to produce a list of files to be shown in the Sony Playstation to be displayed on a HDTV in a preferred order.
Fortunately, Sony did not use a Dos bassed Windows OS when they designed the Playstation 3.
Nevertheless, everyone else seems to have done so.
Thanks,
Howie

howie&lynn wrote:
Hi,
Is it possible to re-arrange picture files within a LiteRoom Window?
How to organize a list of picture files merged from different Windows Folders into a user order?
User Sort Order is what you're looking for. Whilst it's fairly easy to achieve there are a couple things you need to be aware of.
First, to change the sort order of files within a folder you simply click on the image part of the thumbnail in grid view then drag to where you want it to appear in the sequence.
Second, when you apply above procedure with files across multiple folders the photos will be moved from one folder to another - I doubt that's what you want, so don't do it.
The best way to reorder files that are located across multiple folders is to create a Collection that contains all of the files you want to include in the sequence. Next, click and drag the photos within the Collection to to where you want them to be.
File renaming and exporting should be fairly straight forward after that.

Need Shell Script for picking the files

Hi,
    I want to write a shell script for piking the files in a sequence order (according to filename with time stamp) from the sorce FTP server ..
                 Requirement is in the source directory I'm getting files (Jain_1.xml , Jjain_2.xml, Jain_3.xml .. ect..) at present my file adapter is picking all the files at a time but i want to pick one by one... that to first i want to Jain_1.xml after finish the processing of the file then only my file adapter should pick the next file ( Jain_2.xml ) .
              so.. all the forum mates suggest me to write a shell script.. but where i have to write the s hell script. and where i have to deploy this script.... my Xi is running on UNIX ... so please sugest me the procedure ...
Regards
Jain

Hi,
Why dont you use the option EOIO in which files will be picked up in order and will be proccessed in sequence....one after another....
Regards,
Sreeni.

Picking up the files in a particular order

In the sender communication channel i have mentioned the file name as plannedorder*.xml
And in the source directory i have 5 files , plannedorder1.xml,plannedorder2.xml,plannedorder3.xml etc
Now my requirement is xi has to pick the file in this order only.
I dont want plannedorder2.xml to be picked before plannedorder1.xml.
How can i achieve this.
Regards,
Divia

Hi
File Adapter allows you to configure the Processing Sequence of files for the Transport Protocol "File System (NFS)", which also determines the order for EOIO processing. Files can either be processed in ascending alphabetical order (Processing Sequence "By Name") or by their last modification time stamp (Processing Sequence "By Date"), where the oldest file is processed first. For the Transport Protocol "File Transfer Protocol (FTP)" files are always processed in ascending alphabetical order

How to configure Sender File Adapter to pick couples files in order !!

Hi Folks,
I am really looking for one requirement like, Sender file adapter has to pick multiple files by file name based with some time gap? Can we?
I have got one BPM in this, I have tried with Process mode : Name and Date, with wait step on BPM, but no use. The way how PI behaving, if 40 files in file directory, it is picking all files in one shot. Start processing but not in order.
The problem is on Receiver system side. The receiver system is SNC system, if old data receives later than earlier date data; we get data obsolete application error.
Ex: If I receive 25th and 26th files, first I need to process 25th first on PI sends to SNC, I need to give some time gap and pick another file or even PI picks and process 26th file, no problem but I need to give some time gap to send SNC to this 26th date file?
Please how guys, throw me your great ideas
Thanks in advance!!
Regards
San

@ Sandhya
If there are 40 files , can you please specify how many types of files are ther like say first A type shud be picked then B type then C type and so on so forth ?
LIke in my case I had only three types of files file1 and file 2 file 3
and in the directory also only three files will be placed at a time
you need to have some logic to separate the type of files in differnt folders and then process them
@ farooq yes . it will create problem if 40 files are kept at a time .
Regards
Ninad

Pick up Files based on Timestamp???.

HI All,
Is it possible to pick up the files in the order of which they are put in a shared folder ?.
Our client system will put the xml files in a shared folder with timestamps..PI will pick these files one by one..but if the PI server is down.. the files will keep coming in the shared folder from the client system..and when PI come back up they need to be picked in the order in which they have been put according to timestamp.
I'am using the NFS functionality.
I dont want to output files from PI based on timestamp added.. I want to pick files up based upon sender timestamp.
Is this funcationality supported in PI?.
Thanks.

HI
You can write script to do this. Script can copy files based on time stamp from the folder where client system is putting the file to the folder PI is poling based on timestamp.
With this as Ratan said. If the file creation date for file system is in date and time format(timestamp) File processing sequence by Date can help. It process file starting from oldest file.
Thanks
Gaurav

Want to pick old files first (First In First Out mode)

Hi,
My scenario is File to Idoc Scenario getting multiple files in batch mode into source FTP server. But i want to pick which file has first loaded into ftp server that particular file only i want to process first.
my source file name doesn't contain any Timestamp value . but by considering the FTP server timings we have to pick the file.
From the source I'm getting files like ( Jain_1.xml , Jain_2.xml ,Jain_3.xml.... ect...) so in my sender adapater i have mentioned that file name as Jain.xml*
For picking earliest file suggest me some solution.
for this how can achive this. and what are the things we have to do.
Regards
Jain

Hi Jain,
I havent exactly tried doing this one. I used file*.txt once but i didn't need it to pick in any order. My scenario had to pick all the files...
but i found this for you.....
File Adapter , Processing Sequence
EDIT :
picking files in Order?
Read the above link Jain. File adapter does not give a processing sequence for FTP protocol.
But it reads files in alphabetical order. So you have 2 choices.
1> Either use NFS to run your scenarios
2> Else rename your files to Jain_a.xml, Jain_b.xml, Jain_c.xml. This way they will be in alphabetical order and hence will be picked in the order you want.
If you want to rename your files dynamically at runtime. Look at the variable substitution concept.
That can be found here...
/people/jayakrishnan.nair/blog/2005/06/20/dynamic-file-name-using-xi-30-sp12-part--i
To learn more about it...just search with the string variable substitution in the forums and you will find answers.
Best Regards,
Kshitij
Edited by: Kshitij Sharma on Feb 3, 2009 9:12 AM

File Adapter , Processing Sequence

Hi All,
   Can you please help me to understand these?
1. When i configure a Sender File Adapter with file pattern *.txt, Does it handle the files one after another? Or does it span multiple threads and processes multiple files in parallel?
2. If i select processing sequence as DATE, does it consider the time stamp also?
3. If a 100 mb file with name BIG.txt created at 1.00 AM,
    and a 0.1 mb file with name small created at 1.10 on the sender system. If 100MB file needs 30 min to get processed,
Then can i assume the second file get processed only after big file completely processed and reached the destination?
Regards
Ganges Leaves

Ganges,
During any polling interval, XI will pick all files matching your Criteria and process them parallely.
Even if the big file is being processed, the next file will be picked up by the adapter if it is available during the next polling interval.
All interfaces are executed independent of the other.
All this is if u choose the mode as    <b>Best Effort</b>.
Regards,
bhavesh

File Adapter is not picking few files

Hi All,
I am facing some issue in file adapter. Below are the possible file format that we need to pick.
File format sample 1:
865|FieldOrder|AK|620005168|1|Reject|Line Qty can not be Canceled,xyz,abc|The line has been shipped,fgh,hjk
File format sample 2:
865|FieldOrder|AK|570000259|10|Accept|
- All the fields are separated by '|' & last filed is terminated by 'eol'.
- The last two fields (C7 & C8) also have sub fields separted by ',' as shown in sample 1.
- Fields C7 & C8 are optional. (Sample 2 is shown above)
- File contains only one record.
We are using below mentioned XSD which is working fine in case of sample 1 as shown above. When we have a file of format like sample 2 then file adapter is failing to pick the file. I also tried minoccur='0' attribute which also not worked. Please help me out to find the exact XSD which will pick both type of formats (sample 1& sample2).
<?xml version="1.0" encoding="UTF-8" ?>
<xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"
xmlns:nxsd="http://xmlns.oracle.com/pcbpel/nxsd"
targetNamespace="http://us.fujitsu.com/865_EDIFile"
xmlns:tns="http://us.fujitsu.com/865_EDIFile"
elementFormDefault="qualified" attributeFormDefault="unqualified"
nxsd:encoding="ASCII" nxsd:stream="chars" nxsd:version="NXSD">
<xsd:element name="Root-Element">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="Root" minOccurs="1" maxOccurs="unbounded">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="C1" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C2" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C3" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C4" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C5" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C6" type="xsd:string" nxsd:style="terminated"
nxsd:terminatedBy="|" nxsd:quotedBy='"'></xsd:element>
<xsd:element name="C7">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="C7_child" type="xsd:string"
nxsd:style="array" nxsd:cellSeparatedBy=","
nxsd:arrayTerminatedBy="|"
maxOccurs="unbounded"></xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
<xsd:element name="C8">
<xsd:complexType>
<xsd:sequence>
<xsd:element name="C8_child" type="xsd:string"
nxsd:style="array" nxsd:cellSeparatedBy=","
nxsd:arrayTerminatedBy="${eol}"
maxOccurs="unbounded"></xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:sequence>
</xsd:complexType>
</xsd:element>
</xsd:schema>



Hi,
>>2) Even for those few picked files, why are we seeing less no. of Idocs
than the file contents.
Check the mapping by using the payload from SXMB_MONI. I think the mapping is not correct.
>>3) Why is the adapter always picking files immediately even if a poll
interval is set.
Once the objects are activated in ID the channel picks the file immediately and then it waits for the polling interval and repeats the process.
Regards,
Jai Shankar

Picking up file sequentially using file Adapter

Hi Experts,
I am working on a scenario, where two type of files are coming to the source directory namely "Data File" and "Flag File".
First, all the data Files will be coming and after that one flag file will be coming containing names of all the data files.
I am using two seperate Communication channels using "File Adapter" to pick these files. One for all tha data Files and one for Flag File.
As per our requirement we need to pick all data files first and then the flag file and process then in the same sequence.
Is there any solution to do it without BPM.
Regrads
Pradeep

Hi Pradeep,
I don't think there is any mechanism where in you can direct the sequence of files to be picked ,more over you are using two communication channels .So both will act individually as per the poll interval.For your requirement. BPM Pattern Collect Message suits better as it always waits for Stop message to finish the integration process.In your case stop message can be your Log file.
Then all the data files will get processed at a time as soon PE receives the Stop msg (Log file).
Thanks,
Ram.

File to RFC synchronous scenario stopped Picking the files

Hi Experts,
We have a File to RFC synchronous scenario. Till yesterday night it is working fine.
But suddenly it is stooped working.In moni, i can see the failed messages with the Mapping error " Can not create target element, values missing in the queue context "
No Payload in moni / communication channel monitoring / Message monitoring. I've noticed that, wrong files placed in the To-be- processed files and the adapter picked those files and failed in mapping.
I tried by stop and start the communication channel / did some dummy changes in the communication channel and activated. cleared the cache.
But still the communication channel is not working.when i stop and start the communication channel it will try to process the wrong files and failed.
Give me your valuable inputs to resolve this issue.
Regards
Bhargava krishna

Hi Bharghav,
Please go through the below,
Symptom
FTP Adapter is being used in the business scenario for message processing.
During file processing it is noticed, that the FTP sender channel stops
polling. There is no error in the channel monitor or the trace/log files
and the polling jobs are correctly displayed in the AFW scheduler table.
The issue is observed after a network connection issue with the FTP server.
In order to remove the hanging locks from the FTP Adapter, the parameter
'ftp.timeout' setting is required to be set, which releases the lock once
the timeout value is expired. But in the above situation, the value for the
'ftp.timeout' is not taken properly while establishing the data connection
by File Adapter.
Other terms
FTP Adapter, sender, FTP, adapter, timeout, stalled, network, hang, polling
Reason and Prerequisites
Program error
Solution
The hanging situation has now been improved by code changes. Please see
section "SP Patch Level" of this note for a list of updated software
components.
To get this correction available in your Support Package you need to apply
the patch matching to your Support Package version as per the instructions
in the NetWeaver Support Package Stack guide which can be found on the SAP
Service Marketplace as described in SAP Note 952402.
Thanks & Regards
Uday.S

File naming with sequence

My editor requires that I name a file as in the following example:
FI_RX_London(sequence number)
if I try this while importing using file name with sequence, there will be a - sign in front of the number. My question, how do I remove the - sign

In the import dialog, pick Filename-Sequence from the drop down File Naming list. (you will have done this already). Now click the drop-down list again and choose Edit. You will now see the Filename Template Editor window; remove the hyphen from the text box that shows
{Filename>>}-{Sequence #(1)>>}. When you edit this, you will see the example just above it, reflect the change.

Guaranteeing sequence order when polling with DB adapter

We need to read rows from a source table using the DB adapter in polling mode, and deliver them to separate files in the same order they were read from the DB.
My understanding is that when polling, if we find 10 records to be processed, 10 separate BPEL processes will be created.
It's not clear how to then maintain the sequence order when creating the files, as each process may execute faster or slower than others.
Any advice appreciated
Toby

Marc/Sjoerd,
Firstly, thanks for your replies.
On Marc's suggestion, if say we read 100 records using the database adapter, we get 100 processes. How do we control which process will be the first one to be processed, and which of the remaining 99 processes will be subsequently processed once the first has been completed by the cruncher process?
Sjoerd's 1st and 2nd option are not acceptable to us - we have to ensure the same order the records are read. for example record 1 could be a creation and record 2 could be an update to the first so delivering the update to the destination system before the creation will result in an error.
I'm not clear about option 3 - this sounds similar to Marc's suggestion. I can't see how order is maintained between a group of processes created as a result of the database adapter polling, and them being serviced by a cruncher/singleton process. What is to stop the bp which contains the first record being processed first, then the bp which contains the fifth record being processed second, then the bp which contains the second record being processed third etc?
Thanks
Toby

How to show logic of picking multiple stores to fulfill an order line item

I'm still learning some basics with OPA.
How do I represent the logic of picking multiple stores to fulfill an order line item when no one store has the requested quantity? A concrete example would be greatly appreciated as I'm still thinking procedurally for solutions.

Hi!
I believe this is following on from the thread:
Calculating least cost of a product across stores using OPA
So I'm assuming we're using a similar data model.
If we want to involve quantity as well as cheapest price, then I'm assuming the requirement is:
Find the cheapest price for the product from all the stores which still have quantity left of that product.
This is where inferred relationships come in handy.
Here is an example of what you can do with them to help solve this requirement.
the store is a member of the product's stores if
.ExistsScope(the store's prices)
..the price's product name = the product name
the store is a member of the product's stores with remaining stock if
.the store is a member of the product's stores and
..ExistsScope(the store's quantities)
...the quantity's product name = the product name and
...the quantity's amount > 0
Then we basically want to pick the cheapest price for the product from the members of the relationship "the product's stores with remaining stock"
Note that "the product's stores with remaining stock" could obviously be many instances, all with different prices. But for an order, a product needs to come from only one place! The deciding factor to "pinpoint" one place from this potential list of many could be based on anything, such as location, sales ranking, etc. But in this case Im going to assume lowest price is the decider.
In the previous post we created a simple relationship between "the product" and "the prices" (which are contained by the store).
We can make a more powerful relationship now:
the price is a member of the product's available prices if
ForScope(the price's store, the main store)
.the main store is a member of the product's stores with remaining stock
(I'm using an alias here to be 100% sure of which store is in scope)
Now we can use the rules in the previous post, but change the relationship to the more advanced one we just created:
the product's cheapest available price = InstanceMin(the product's available prices, the price's amount)
Then
the product's cheapest available store name = InstanceValueIf(the product's available prices, the price's store name, the price's amount = the product's cheapest available price)
This is all psuedo code so many need some slight tweaks when you put it into OPM. Make sure you set up the relationships in a property file and declare all the attributes etc.
Inferred relationships are really useful as "filters" sometimes. Here we first filtered all the stores which have prices for the product (i.e. have it in their catalogue). Then we filtered to get a list of all the stores which have stock remaining for the product. From that, we could find the cheapest available price.
This is by no means the only way to do it! It's also by no means a simple problem but the great thing about OPA is that you can put all of the relationship config rules in the system rule folder / word doc, meaning that the source / business rules can still look relatively simple (in the end, it only took 2 lines of source rules to find the cheapest available price!). Once you've got the right set up and invested time in designing your data model, you will find it much easier to solve seemingly complex problems across entities.
One word of warning though: if you have thousands of instances of prices, stores, products etc. then there is a performance impact of using many inferred relationships and alternatives should also be considered.
Hope this helps!
Feel free to contact me for more help on this. If you are relatively new to OPA and trying to tackle this you should consider investing in some training.
Cheers,
Ben

Pick the file from FTP Server and place it on the App. Server of R/3

Hi Guys,
I had a requirement where i need to pick the file from the FTP Server and place it on the Application Server in R/3. If anybody has an Idea on acheiving this or if anybody has the piece of Code Snippet to acheive the same, Help me out.
Regards,
Kittu Chowdary.

hi kittu,
chk the demo programs RSFTP00* if they can help u

Picking up files in a sequence order

Similar Messages

Maybe you are looking for