XI file sender: filename validation to stop processing a file twice
Hello folks,
I have a file sender adapter for a text file with name convention that includes a date - e.g. orders_YYYYMMDD.txt. We have a business requirement to ensure that we don't post the same file more than once. The file can be huge, so it's not really an option to pick up the file contents in one message.
Options I have tried:
- I do not know of a setting in the file adapter to achieve this.
- write a perl script to read the filename and translate [hex-encode] this into a Message GUID, then post the file via HTTP adapter
- - if the file name is not too long (guid is 32 hex chars) this method works well for small files that are in XML format.
- - Text files need too much perl coding to translate to XML. Large files that need to be split will fail on the 2nd chunk.
Options I don't want to use:
- Use BPM to call an RFC/Proxy that validates the filename - this will cause me to read the whole file, or I have to implement a 'pipe' in BPM to ensure EOIO processing. (We have this elsewhere, but it's not good for performance)
- Actually, I don't want to manage this in ABAP/Ztables at all if possible.
I am about to start work on a Module Processor to mangle the GIUD in the file adapter, similar to the HTTP method above (don't have any idea of whether this will be possible yet)...
Can anyone recommend another method to achieve this?
Hi Derek,
Intially when the file is picked then archive it to another directory.
with this the same file will not be processed twice.
Rgds,
Kumar
Similar Messages
-
Inventory stops processing status files
We are having problems with files accumulating in our status folder on our ZCM server (SLES 10.2 64 bit). We are running ZCM 10.2.2 and for some reason, the status folder fills up with .zip files which means inventory has quit processing them. I usually stop all the services, delete the files, and then restart the server and as files are written into the folder they are now being processed. Unfortunately I am 2 days past the 2 weeks in which to reopen my previous service request. Does anyone have any suggestions or ideas as to what the problem might be? Or who to contact to reopen a call 2 days past the two weeks?
helgeson,
It appears that in the past few days you have not received a response to your
posting. That concerns us, and has triggered this automated reply.
Has your problem been resolved? If not, you might try one of the following options:
- Visit http://support.novell.com and search the knowledgebase and/or check all
the other self support options and support programs available.
- You could also try posting your message again. Make sure it is posted in the
correct newsgroup. (http://forums.novell.com)
Be sure to read the forum FAQ about what to expect in the way of responses:
http://forums.novell.com/faq.php
If this is a reply to a duplicate posting, please ignore and accept our apologies
and rest assured we will issue a stern reprimand to our posting bot.
Good luck!
Your Novell Product Support Forums Team
http://support.novell.com/forums/ -
File Sender Filename scheme problem
Hello,
we need to pick two types of files from the same folder on FTP server:
Examples of filenames are:
FILEINVRPT12_28102010.xml and FILESLSRPT12_28102010.xml
We tried to use Advanced selection of files for these two file types and the filename scheme used was
FILEINVRPT.xml in filename and FILESLSRPT.xml in Filename mask for Advanced selection
All files of type FILEINVRPT.xml have been picked up but FILESLSRPT.xml were not.
We tried to remove advanced selection and even used *.xml and . as filename scheme ,still these files aren't picked up.
Then we tried giving exact filename (hardcoded) for some of these files and they were picked up ,so there should be no problem with these files.
Can anyone please suggest what could be the reason for this strange behaviour?
Thanks a lot.
Best Regards,
ShwetaHi Shwetha,
As per my understanding, you need to pick two different files(not having same naming convension) from the same folder. I see that you are using Advanced selection for Source files.
This can be easily achieved, I have done it and providing you the steps to configure the adapter.
1. In the File Access parameters, provide the source directory and filename as FILE*.xml.
2. Now, check the option, advanced selection for source files.
provide the directory = 10.20.30.40
and the File Name Mask FILEINVRPT.xml, FILESLSRPT.xml
Ensure that the file placed in the FTP should have the same naming convension of the filename.
Thanks, -
File to RFC synchronous scenario stopped Picking the files
Hi Experts,
We have a File to RFC synchronous scenario. Till yesterday night it is working fine.
But suddenly it is stooped working.In moni, i can see the failed messages with the Mapping error " Can not create target element, values missing in the queue context "
No Payload in moni / communication channel monitoring / Message monitoring. I've noticed that, wrong files placed in the To-be- processed files and the adapter picked those files and failed in mapping.
I tried by stop and start the communication channel / did some dummy changes in the communication channel and activated. cleared the cache.
But still the communication channel is not working.when i stop and start the communication channel it will try to process the wrong files and failed.
Give me your valuable inputs to resolve this issue.
Regards
Bhargava krishnaHi Bharghav,
Please go through the below,
Symptom
FTP Adapter is being used in the business scenario for message processing.
During file processing it is noticed, that the FTP sender channel stops
polling. There is no error in the channel monitor or the trace/log files
and the polling jobs are correctly displayed in the AFW scheduler table.
The issue is observed after a network connection issue with the FTP server.
In order to remove the hanging locks from the FTP Adapter, the parameter
'ftp.timeout' setting is required to be set, which releases the lock once
the timeout value is expired. But in the above situation, the value for the
'ftp.timeout' is not taken properly while establishing the data connection
by File Adapter.
Other terms
FTP Adapter, sender, FTP, adapter, timeout, stalled, network, hang, polling
Reason and Prerequisites
Program error
Solution
The hanging situation has now been improved by code changes. Please see
section "SP Patch Level" of this note for a list of updated software
components.
To get this correction available in your Support Package you need to apply
the patch matching to your Support Package version as per the instructions
in the NetWeaver Support Package Stack guide which can be found on the SAP
Service Marketplace as described in SAP Note 952402.
Thanks & Regards
Uday.S -
Empty File has to write after Message Processing in File Adapter..!!
Hi,
File to File Scenario.
Once the file is processed and placed in the receiver folder, I need to generate one empty file with the original file name but with different extension (DON). This is used to indicate that the full file is written in the folder.
Example:
Original file has to write like "Output_Final.CSV"
Empty file has to be placed like "Output_Final.DON"
Is there any way I can achieve this requirement.?
Thanks
Deepthi.I have no clue of removing the same using Graphical mapping ..
I hope you have set the option of Write Empty File if not try this and still doesnot work
then need to look for java or ABAP mapping
chekc the below thread may help
Re: How to create empty Payload
Rajesh -
Sender File Adapter stop processing all files
Hello all,
the file adapter pick up all files in the directory by default.
if a large number of files are in the directory then this could slow down the pi processing.
is there any way to process only one file per polling??
regards>
Ralf Zimmerningkat wrote:
> Hello all,
> the file adapter pick up all files in the directory by default.
> if a large number of files are in the directory then this could slow down the pi processing.
> is there any way to process only one file per polling??
>
> regards
I do not have any proble if you have got the answer. BUT this blog says how to exclude the other files from the same folder.
Your Case: For example, Your Sender CC wants to pick up file ABC.txt from /xyz dir, now suppose there are 10 thousand files of same name in the dir and you want ABC.txt should be picked up one by one, So how this blog is going to help you. Can you Plz explain to me and others too?
@Sachin may be you can throw some light on this... may be I am missing something. -
How do I automatically insert a file's filename in a header in the file?
The newest version of NUMBERS seems to have lost the function for inserting a filename into the header of a printed document. Any suggestions?
I miss that feature too. A workaround would be to Command-Click the document name in the Print Preview window and select the second line in the file path that is displayed. That will cause a Finder Window to open, with the current Numbers file highlighted. Click once on the highlighted document name, Command-C to Copy, Click back on the Numbers window and click in the Header field and Command-V to Paste.
This avoids all typing into the header, but the result is just a piece of text, not an object that will automatically update. It seems that if we want all the functionality of iWork '09, we must choose to use iWork '09.
Jerry -
None of the file Sender Communication Channels are wotking in Prod-Urgent
facing a wierd situation, since yesterday all of my File Sender Comm Channels have stopped picking up files.This is in Production and was working fine day before.When I check in Comm channel monitoring the Channels are started and Functioning and also shows me that they are polling for the files.But no file is picked though files exist in the directory.These channels have been working fine since months and nothing had been changed since then.Suddenly all of them stopped picking up files.
I have about 10 Comm Channels that pick files, Is this related to Adapter Engine....any suggestions on this would be really apprecated.
Thank You.Hi!
Check access rights on your files. Try to set them to 777 (using chmod). Maybe this will help.
Problem is, when the XI does not have rights for picking up files, you see no errror message in CC monitoring and everything seems to be ok, but it is not..
We faced the same problem.. And we figured out, that our partner started to upload files with different access rights.
Peter -
Issue with archiving in file sender channel
Hi Experts,
We have configured a file to ABAP proxy scenario in our production PI 7.0 system. the file sender communication channel is configured to perform " file content conversion" and archive the source file after it is processed successfully.
Recently , the sender channel stopped archiving the files. but it is processing them.
we need the source files to be archived. i do not see any related error in XI logs and default trace files . also it is not a problem with disk space on file system either.
can you please let me know how the issue can be resolved.
Thanks.
-KaushikHi
Make sure that you have selected processing mode Archive
Try by Checking Add Time stamp check box.
Check the Archive File path in correct format
or put archive file in diffrent folder from which selecting file. -
Strange issue - XI somtimes process a file and sometimes its not detected
Dear friends,
We have a strange problem. Ill describe the situation:
We have a simple file to file scenario without any mapping or File Content Conversion. Daily a sender system puts a ZIP file on a server and XI processes this file.
The strange thing is that XI sometimes processes this file and sometimes its not detected at all. After our analysis we come to conclusion that its not random.
We have looked at almost everything. We have checked the:
File name;
Size of the messages.
Authorisation;
Users that are assigned to the processing job.
Has anyone experienced the same problem or does anyone has a suggestion?
Helpful points will be rewarded,
Kind regards,
KamranHi Mickael,
There are no stupid questions, there are only stupid answers. So I hope my answers are not stupid
1. what is your Polling Interval of your Sender Agreement ? Once a day ? every 60s ? etc...
because you say that your Legacy put the file Daily.
Answer: The polling Interval is 400 seconds and Modification Check is 400000 Msecs
2. Are you sure that your Legacy does not put the file after or during the XI adapter try to catch it?
Answer: No Because Modification Check works perfectly and we get alerts if the file is modify during the process.
3. Does your filename is always the same ?
4. or Have you a filename which can changed and which is case sensitve (lowercase and uppercase).
Answer: It has always the same name and It starts with O2C.zip
5. What are the size of your failed file?
Maybe it's too big and maybe you have a timeout somewhere (for instance into the adapter log)
Answer: It's not too big, it varies from 20 MB to 100 MB and we know that we can process files up to 700 MB
As I told before we have checked everything. Its very strange...
Do you have any other suggestion?
Regards,
Kamran -
Error Archiving File in File Sender Adapter using AF_Modules/PayloadZipBean
Hi everybody.
I have to pick a zip file up from ftp server, unzip an convert the file in xml.
Im using this modules in file sender adapter:
AF_Modules/PayloadZipBean --> To unzip de file
AF_Modules/MessageTransformBean --> file to xml
The problem is when I try to archive de file. Im getting this error and I dont know why (This path exists /out/ProcesadosSinError/)
Could not archive file 'test.zip' as '/out/ProcesadosSinError/20100518-091029-155_test.zip' after processing: java.io.FileNotFoundException: /out/ProcesadosSinError/20100518-091029-155_test.zip (A file or directory in the path name does not exist.)
Could it be that is not possible to archive with AF_Modules/PayloadZipBean?
Thank u so muchHi Stefan.
Absolutely. This path exists. It's an absolute path from root. I can´t understand the error!!!!
Thanks!!!
Edited by: Christian Abad Chico on May 18, 2010 9:35 AM -
File-Sender: Verification of file content during file content conversion
Hello,
I have a question regarding file verification when using the file-sender adapter.
I got a flat file (.csv) that I convert into XML with the file-sender adapter and file-content-conversion.
In the file there is a column RecTyp that is my KeyFieldValue. Possible values for RecTyp are B, D, U, T.
So far so good. All this works perfectly.
If (due to an error) there is another value in RecTyp than the 4 mentioned above (B;D;U;T) the file adapter ignores this row today. And here begins my issue:
I want to change this behavior. That means in detail, I want to check if there is another value in my KeyFieldValue RecTyp than specified. If this is the case an exception should be thrown. The whole message should not be delivered.
We had the idea to use the module-processor for this verification .
But may be there are other suggestions. Or may be some one can provide an appropriate module that is already written, etc .
Does anyone have an idea?
Kind regards,
TobiasHi,
It is better to pick the file in generic way i.e Row by Row and then go with the validation with the help of Adapter Modules or in the Mapping.
For more-
/people/sravya.talanki2/blog/2005/08/16/configuring-generic-sender-file-cc-adapter
Thanks,
Moorthy -
File Sender Adapter - File overwritting in the Archiving folder
Hello Experts,
I am doing File sender to proxy Receiver Async Scenario.
In File Sender adapter, i am using the Archiving option by spacifying the
Archiving path.
Files are picked up and archiving happen successfully.
Problem is: - once the File is picked up and archivied into the Archiving location
If end user again rectifies some data in the same file and place it in the source directory
then i am getting the following error in RWB Commu. channel monitoring.
Failed to archive file 'File1.TXT' as '/Input File location/File1.TXT' after processing. The FTP server returned the following error message: 'com.sap.aii.adapter.file.ftp.FTPEx: 550 File not renamed. File already exists. You may delete the existing file and then rename.u2019 For details, contact your FTP server vendor.
I know this is because of File sender adapter is trying to archive the file with the same name(File1.txt) in the archiving location.
My Question: - Is there any option to allow the File sender Adapter for overwritting the
File in the archiving location.
Thanks & Regards
Jageshcheck if there is proper rights to over write files in the archive folder.
The problem seems to be that the rights/authorization is not there. Else the adapter usually overwrites files in the archive folder unless you use the timestamp option.
Archive
Files that have been successfully processed are moved to an archive directory.
u25A0 To add a time stamp to a file name, select the Add Time Stamp indicator.
The time stamp has the format yyyMMdd-hhMMss-SSS. The time stamp ensures that the archived files are not overwritten and it enables you to sort them according to the time that they were received.
u25A0 Under Archive Directory, enter the name of the archive directory.
u25A0 If you want to archive the files on the FTP server, set the Archive Files on FTP Server indicator. If you do not set the indicator, the files are archived in the Adapter Engine file system. -
Fixed File- File Sender Adapter
I have a Fixed File.
Space is the Separator for each Field.
I am SENDING the file.
Issue : The File is not picking up and I am not seeing my job in the SXMB_MONI. (We are in sp14)
Please assist me.
Note : I have looked the Adapter Monitor and I see the Green Button for my Sender file and it says its processed.
<?xml version="1.0" encoding="UTF-8"?>
<ns0:Messages xmlns:ns0="http://sap.com/xi/XI/SplitAndMerge">
<ns0:Message1>
<ns1:MESSAGE_MT xmlns:ns1="urn:zz.com:HR:BENEFITS">
<VendorNo/>
<VendorName/>
</ns1:MESSAGE_MT>
</ns0:Message1>
</ns0:Messages>
VendorNo 5 Bytes
VendorName 10Bytes
Input File
V1234 Vendname1
V2345 Vendname2
Adapter Type : File Sender
Transport Protocol : FileSystem NFS
Message Protocol : File Content Conversion
Adapter Engine : Integration Server
File Access Parameter
Source Directory /File
File name vendor.txt
Content Conversion Parameters
Document Name Messages
Document Namespace http://sap.com/xi/XI/SplitAndMerge
Document Offset
Record Name Message1
Record Namespace urn:zz.com:HR:BENEFITS
Record Structure MESSAGE_MT,1
Recordset Sequence Ascending
Key field Name ( No Key fields)
Key Field type String(Case-Sensitive)
Additional parameters
MESSAGE_MT.fieldFixedLengths 5,10
MESSAGE_MT.fieldName VendorNo,VendorName
MESSAGE_MT.processFieldNames fromConfiguration
MESSAGE_MT.endseparator ' 'Hi ,
I guess your content conversion is wrong. And your input XML is also not very clear.
The strcuture should be:
MT_name (document : MESSAGE_MT)
|
Recorset (Recorset name Optional)
|
Recordset_str (VendorDetail)
|
Fields like vendorName
You have used messages as document. its wrong
your content conversion should be:
Document Name : MESSAGE_MT
Document Namespace space:urn:zz.com:HR:BENEFITS
Recordset Name: recordset (can take any dummy name if this is not described in ur XML structure)
Recordset Namespace :
<Recordset Structure: create on structure i.e parent node of VendorNo,VendorName e.g VendorDetail>
Recordset Structure: VendorDetail,1
Recordset Sequence: Ascending
Key field Name : you dont equire as there is only one recorset str
Key Field type: Not required
VendorDetail.fieldFixedLengths: 5,10
VendorDetail.fieldName: VendorNo,VendorName
VendorDetail.endseparator: ' ' or 'nl' for new line
ignoreRecordsetName: true.
Hope this works.
Regards,
satish -
Attachment of original message in file sender adapter content conversion
Hi,
does anybody know how I can configure a file sender communication channel (with content conversion) so that the original file is added to the XI SOAP message as attachment? Maybe this is just a parameter in "Advanced" tab. (The content conversion itself is not an issue.)
The result should be the "Main Document" (XML-message) and the "original document" as two attachments in the SOAP payload.
The reason for this is that the original file should be archived with the XML message as it was before the XML content conversion of the file sender adapter took place.
Thanks,
Philipporiginal file is added to the XI SOAP message as attachment?
The "Advanced" tab -> additional files added in file adapter should act as the attachment to soap receiver adapter if u select the "Keep Attachments" option in soap receiver communication channel.
What do u want to do in FCC is a bit unclear?
Regards,
Prateek
Maybe you are looking for
-
Key fields are not visible in output condition table
Hi, I have created few conndition tables using V/61. But i can not see Key field. It is not displaying. But when I check thru VK11 i can see that all fields are marked as key fields. example of table B018. My problem is that , i want to make few
-
I'm sure hoping someone out there has an answer...
I have put 4 video clips onto iphone...itunes holds more than 4 clips but it is 'filled up' with 4 and won't move onto loading number 5 video clip into iphone...????
-
Multiple NICs for one virtual network (need better then 1GB)
I just finished deploying a new two node cluster. The network part is as follows: New-NetLBFOTeam –Name ConvergedNetTeam –TeamMembers pNIC-300,pNIC-301,pNIC-400,pNIC-401,pNIC-901 –TeamingMode SwitchIndependent –LoadBalancingAlgorithm Dynamic -confirm
-
My photosmart is printing pink instead of red
When printing from photoshop my printer is printing in pink something that is clearly red. I have cleaned the printhead and there is no change
-
How to resolve A VMWare portgroup with VLAN ID 0 cannot be founf on virtual switch vSwitch0.
Hi All, I have deployed Microsoft private cloud using SCVMM, SCOM, SCCM, SCSM, SCO and SCSM Portal... Also, i am using cloud service process pack runbooks and offerings for my vm provisioning in VM Ware platform... After submitted the request vm got