File Processing Techniques in ABAP

Hi, Friends,
Can any one let me know the file processing techniques used in ABAP.
Open/Close , Read/Write . are these used for file processing, if so can you explain me this syntax and scenario.
please let me know.
Regards,
Roberts.K

Hi Roberts
For file operations at application server layer, we use mainly OPEN DATASET, TRANSFER, CLOSE DATASET and DELETE DATASET statements.
For more information follow <a href="http://help.sap.com/saphelp_47x200/helpdata/en/fc/eb3c8c358411d1829f0000e829fbfe/frameset.htm">this link</a> .
Regards
*--Serdar <a href="https://www.sdn.sap.com:443http://www.sdn.sap.comhttp://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/com.sap.sdn.businesscard.sdnbusinesscard?u=qbk%2bsag%2bjiw%3d">[ BC ]</a>

Similar Messages

File to File and then Call ABAP Program and pass file name and location

Hi
I am new to PI and am working on the following requirement and some guidance would help:
A file is picked up from a third party server using FTP and is put in an SAP server in a specific location. After I have put in the file successfully, I need to call an ABAP program and provide the name and location of the file for further processing by the ABAP program.
Although I am familiar with File to File, how can I add in the ABAP call with the filename and location? I do not want to pass any other information to the ABAP program.
Thanks for your help.
Manoj

I think I get what you're saying. This additional file would have the file and the path in it's content. I would then use this as a source (FCC?) for Mapping with the RFC. Right?
Exactly and yes, FCC would be helpful
Would you have a sample OS script to do the above?
Actually it depends on the operating system on which your PI system is standing. For instance for Windows, you might try with the following as a start point (but I was not able to test it, so I can't guarantee it will do the job):
cmd.exe /C "%f %F > C:\target_directory\%DATE%_%TIME%.txt"
In case you needed more, try googling on "windows batch script" or similar.
Hope this helps,
Greg

Huge size file processing in PI

Hi Experts,
1. I have seen blogs which explains processing huge files. for file and sftp
SFTP Adapter - Handling Large File
File/FTP Adapter - Large File Transfer (Chunk Mode)
Here also we have constrain that we can not do any mapping. it has to be EOIO Qos.
would it be possible, to process 1 GB size file and do mapping? which hardware factor will decide that sytem is capable of processing large size with mapping?
is it number of CPUs,Applications server(JAVA and ABAP),no of server nodes,java,heap size?
if my system if able to process 10 MB file with mapping there should be something which is determining the capability.
this kind of huge size file processing will fit into some scenarios. for example,Proxy to soap scenario with 1GB size message exchange does not make sense. no idea if there is any web service will handle such huge file.
2. consider pi is able to process 50 MB size message with mapping. in order to increase the performance what are the options we have in PI
i have come across these two point many times during design phase of my project. looking for your suggestion
Thanks.

Hi Ram,
You have not mentioned what sort of Integration it is.You just mentioned as FILE.I presume it is FILE To FILE scenario.In this case in PI 711 i am able to process 100MB(more than 1Million records ) file size with mapping(File is in the delta extract in SAP ECC AL11).In the sender file adapter i have chosen recordset per message and processed the messages in bit and pieces.Please note this is not the actual standard chunk mode.The initial run of the sender adapter will load the 100MB file size into the memory and after that messages will be sent to IE based on recordset per message.If it is more than 100MB PI Java starts bouncing because of memory issues.Later we have redesigned the interface from proxy to file asyn and proxy will send the messages to PI in chunks.In a single run it will sent 5000 messages.
For PI 711 i believe we have the memory limtation of the cluster node.Each cluster node can't be more than 5GB again processing depends on the number of Java app servers and i think this is no more the limitation from PI 730 version and we can use 16GB memory as the cluser node.
this kind of huge size file processing will fit into some scenarios. for example,Proxy to soap scenario with 1GB size message exchange does not make sense. no idea if there is any web service will handle such huge file.
If i understand this i think if it is asyn communication then definitely 1GB data can sent to webservice however messages from Proxy should sent to PI in batches.May be the same idea can work for Sync communication as well however timeouts in receiver channel will be the next issue.Increasing time outs globally is not best practice however if you are on 730 or later version you can increase timeouts specific to your scenario.
To handle 50 MB file size make sure you have the additional java app servers.I don't remember exactly how many app server we have in my case to handle 100 MB file size.
Thanks

Severe error(s) occurred in phase PREP_INSTALL/SHDINST_OS Last error code set: Process H:\SUM\abap\exe/sapstartsrv.exe exited with -1

Hi Experts ,
Currently performing EHP7 upgrade I have faced error during the configuration phase , below attached was the error screenshot .
error logs shows the below :
Executing module 'PREP_INSTALL'.
Execution of PREPARE module "Installation" begins at 20140302202456
# Starting phase execution with maxpar = 6, scheduled: 14x'-'
CURRENTPHASE PREP_INSTALL/SHDINST_OS
...started at 20140302202456
# Using phase log file 'SHDINST_OS.LOG'.
..finished at 20140302202457 with status ABORTED.
# Error message set: 'Process H:\SUM\abap\exe/sapstartsrv.exe exited with -1, see 'H:\SUM\abap\log\SAPup.ECO' for details'
.begin dialog at 20140302202459
SHDINST_OS log :
1 ETQ399 Possibly the password for user ISNET\SAPServiceDEC entered in phase
1 ETQ399 INITPUT was wrong. You can reset it by calling 'SAPup set stdpar'.
1 ETQ399 Try to execute SAPSTARTSRV.EXE manually using the following syntax:
1 ETQ399 H:\SUM\abap\exe\sapstartsrv.exe -r
1 ETQ399 -p H:\SUM\abap\DEC\SYS\profile\START_DVEBMGS01_SAPECCDV -s DEC -n 01
1 ETQ399 -U ISNET\SAPServiceDEC -P <PASSWORD> -e ISNET\decadm
1 ETQ399 and check if the service SAPDEC_01 can be stopped and restarted.
1EETQ399 Last error code set is: Process H:\SUM\abap\exe/sapstartsrv.exe exited with -1, see 'H:\SUM\abap\log\SAPup.ECO' for details
1EETQ204 Upgrade phase "SHDINST_OS" aborted with severe errors ("20140302202457")
Kindly advice to fix

Hi Mohan,
Solution of your issue is already present in SHDINST_OS.LOG
Possibly the password for user ISNET\SAPServiceDEC entered in phase
1 ETQ399 INITPUT was wrong. You can reset it by calling 'SAPup set stdpar'.
1 ETQ399 Try to execute SAPSTARTSRV.EXE manually using the following syntax:
1 ETQ399 H:\SUM\abap\exe\sapstartsrv.exe -r
1 ETQ399 -p H:\SUM\abap\DEC\SYS\profile\START_DVEBMGS01_SAPECCDV -s DEC -n 01
1 ETQ399 -U ISNET\SAPServiceDEC -P <PASSWORD> -e ISNET\decadm
1 ETQ399 and check if the service SAPDEC_01 can be stopped and restarted.
Read the log carefully.Have you performed the above mentioned steps from SHDINST_OS.LOG file at your end.
Also just give a full restart your server,up all the required services & confirm the execution of the phase.
Thanks,
Gaurav

Error message by periodic weekly: No output from the 1 file processed

Hi there,
since four weeks, I got a problem with the maintenance script periodic weekly. Up to December 22nd, the script did, what it should do: rebuilding the database of locate and whatis, rotating log-files. Since one week later, I got the error message: No output from the 1 file processed.
Normally, I use Anacron to do the job. When I noticed the problem, I tried to start the script with Tinker Tool System getting the same result. Another try using the Terminal (sudo periodic weekly) also failed. The commands locate and whatis are working, locate.updatedb and makewhatis also. I'm running 10.4.8; in the past, I did not have such problems. Anyone with an idea or solution?
Thanks
Klaus
MacBook Pro Mac OS X (10.4.8)

Hi Gary,
here is the output you were asking for:
Last login: Thu Jan 25 20:03:55 on console
Welcome to Darwin!
DeepThought:~ dirk$ sudo /private/etc/periodic/weekly/500.weekly; echo $?
Password:
Sorry, try again.
Password:
Rebuilding locate database:
Rebuilding whatis database:
find: /usr/local/man: No such file or directory
makewhatis: /usr/share/man/man1/fetchmailconf.1.gz: No such file or directory
Rotating log files: ftp.log lpr.log mail.log netinfo.log ipfw.log ppp.log secure.log
access_log error_log
Running weekly.local:
Rotating psync log files:/etc/weekly.local: line 17: syntax error near unexpected token `)'
/etc/weekly.local: line 17: `if [ -f /var/run/syslog.pid ]; then kill -HUP 0 80 79 81 0cat /var/run/syslog.pid | head -1); fi'
2
DeepThought:~ dirk$ ls -loe /private/etc/periodic/weekly/500.weekly
-r-xr-xr-x 1 root wheel - 2532 Jan 13 2006 /private/etc/periodic/weekly/500.weekly
DeepThought:~ dirk$
It seems, Rogers idea, PsynX respectively the deficient uninstalling by me is responsible for my problems, is correct. Should I remove the whole file weekly.local or should I only remove the content? I prefer removing the whole file, because it was created while installing PsyncX. The date of creation is the same as the date of installing the app (December 25).
Klaus
By the way: it seems to me, the solution of my problem is in sight. So I want to thank you all for the amazing aid I got from you!

How to Print a PDF file from within a ABAP ( from gui input)

Hi champions,
This is Client requirement:
"We need to print a PDF file from within a ABAP"
We first need to test whether it is even feasible, and then if it
is, then write a small test ABAP which can accept a PDF file
name as input (from GUI) and then print it to a SAP print
device (printer).
Please Can any body help me on this.......
It's urgent
Thanks
Basu

Check following blog for PDF output from SAP
/people/thomas.jung3/blog/2005/04/28/setting-up-an-adobe-writer-for-abap-output
anya

A DNG File Processed by an Earlier Version of ACR--How to Re-Process in ACR 8.4

I have thousands of DNG files processed by the ACR versions that came with CS4 and CS5. I was hoping to re-process some of them with the later ACR versions that came with CS6. But when I open a previously edited DNG file in ACR 8.4, it seems to revert to the earlier version in which the file was originally edited/processed. I made a duplicate of a file and reverted it to Default--sort of like restoring its virginity--but ACR 8.4 was not fooled; it still opened the earlier version. What to do???????

The earlier version of ACR was using a previous Process Version.
If you want the newer adjustment sliders, set your Process Version to 2012 on the Camera Calibration tab.

Sender File adapter and duplicate file processing

If I set the sender file adapter to delete or archive and when a file gets picked up and processed, this file will not get deleted/archived unless it was successfully processed. However, if it errors out during processing, the file remains but it's message will get persisted in the integration engine or adapter engine. Since there's automatic retry, we have the potential for duplicate processing as in addition to the retry, the file is still continously polling for this file. In other words, how do we stop this duplicate file processing?
Thanks.

Hi Bevan,
However, if it errors out during processing, the file remains but it's message will get persisted in the integration engine or adapter engine.
your file wont get deleted unless adapter engine sucesfull pickups. if does not picked up at adapter engine then is not stored in adapter engine . if it reached Intergation Server and failed their then file would be deleted.
please let me know if you haveany questions
please reward points
Regards
Sreeram.G.Reddy

FTP - Run OS Command before file processing

Hi,
I have a requirement wherein I need to FTP a file from XI to a folder in a FTP server . Now FTP Server is set up in such a way that I cannot put the file directly. Before transferring the file , I have to use CD ( change directory command ) to access a particular folder and then transfer the file. This means that I cannot give the folder information directly to TARGET DIRECTORY.
To address this, I decided to use the feature "Run OS Command BEFORE file processing " . And wrote a command 'cd <foldername> .It is not working. Then I tried using "Run OS Command AFTER file processing " and it also didnot work.
Does anyone have any clue how can I address this requirement using FILE Adapter.
thanks,
rakesh

HI,
OS commands will be executed in XI server not in the FTP server. So first you need to connect into FTP server and then you need execute CD command.
option 1) Get the absolute path ie direct path from FTP server so that you can directly connect to FTP server's specific directoty
22) In this case , write the file into your XI server itself by NFS File Transport protocol. Then ftp this file from your XI server into FTP server using Shell Script.
So write a shell script which will be executed in the XI server, inside this write a logic of tranfer of files with FTP protocol. This shell script is executed from the Reciever File adapter with the option OS command.
Hope this helps,
Regards,
Moorthy

Large file processing in XI 3.0

Hi,
We are trying to process a large file of ~280 MB file size and we are getting timeout errors. I followed all the required tunings for memory and heap sizes and still the problem exists. I want to know if installation of decentral adapter engine for just this file processing might solve the problem which I doubt.
Based on my personal experience there might be a limitation of file size processing in XI may upto 100 MB with minimul mapping and no BPM.
Any comments on this would be appreciated.
Thanks
Steve

Hi Debnilay,
We do have 64 bit architecture and still we have the file processing problem. Currently we are splitting the file into smaller chuncks and processsing. But we want to process as a whole file.
Thanks
Steve

Large file processing in file adapter

Hi,
We are trying to process a large file of ~280 MB file size and we are getting timeout errors. I followed all the required tunings for memory and heap sizes and still the problem exists. I want to know if installation of decentral adapter engine just for this large file processing might solve the problem which I doubt.
Based on my personal experience there might be a limitation of file size processing in XI may upto 100 MB with minimul mapping and no BPM.
Any comments on this would be appreciated.
Thanks
Steve

Dear Steve,
This might help you,
Topic #3.42
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/70ada5ef-0201-0010-1f8b-c935e444b0ad#search=%22XI%20sizing%20guide%22
/people/sap.user72/blog/2004/11/28/how-robust-is-sap-exchange-infrastructure-xi
This sizing guide & the memory calculations it will be usefull for you to deal further on this issue.
http://help.sap.com/bp_bpmv130/Documentation/Planning/XISizingGuide.pdf#search=%22Message%20size%20in%20SAP%20XI%22
File Adpater: Size of your processed messages
Regards
Agasthuri Doss

File Splitting for Large File processing in XI using EOIO QoS.

Hi
I am currently working on a scenario to split a large file (700MB) using sender file adapter "Recordset Structure" property (eg; Row, 5000). As the files are split and mapped, they are, appended to a destination file. In an example scenario a file of 700MB comes in (say with 20000 records) the destination file should have 20000 records.
To ensure no records are missed during the process through XI, EOIO, QoS is used. A trigger record is appended to the incoming file (trigger record structure is the same as the main payload recordset) using UNIX shellscript before it is read by the Sender file adapter.
XPATH conditions are evaluated in the receiver determination to eighther append the record to the main destination file or create a trigger file with only the trigger record in it.
Problem that we are faced is that the "Recordset Structure" (eg; Row, 5000) splits in the chunks of 5000 and when the remaining records of the main payload are less than 5000 (say 1300) those remaining 1300 lines get grouped up with the trigger record and written to the trigger file instead of the actual destination file.
For the sake of this forum I have a listed a sample scenario xml file representing the inbound file with the last record wih duns = "9999" as the trigger record that will be used to mark the end of the file after splitting and appending.
<?xml version="1.0" encoding="utf-8"?>
<ns:File xmlns:ns="somenamespace">
<Data>
 <Row>
 <Duns>"001001924"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"001001925"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"001001926"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"001001927"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"001001928"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"001001929"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
 <Row>
 <Duns>"9999"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Cage_Code>"3NQN1"</Cage_Code>
 <Extract_Code>"A"</Extract_Code>
 </Row>
</Data>
</ns:File>
In the sender file adapter I have for test purpose changed the "Recordset structure" set as "Row,5" for this sample xml inbound file above.
I have two XPATH expressions in the receiver determination to take the last record set with the Duns = "9999" and send it to the receiver (coominication channel) to create the trigger file.
In my test case the first 5 records get appended to the correct destination file. But the last two records (6th and 7th record get sent to the receiver channel that is only supposed to take the trigger record (last record with Duns = "9999").
Destination file: (This is were all the records with "Duns NE "9999") are supposed to get appended)
<?xml version="1.0" encoding="UTF-8"?>
<R3File>
 <R3Row>
 <Duns>"001001924"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Extract_Code>"A"</Extract_Code>
 </R3Row>
 <R3Row>
 <Duns>"001001925"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Extract_Code>"A"</Extract_Code>
 </R3Row>
 <R3Row>
 <Duns>"001001926"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Extract_Code>"A"</xtract_Code>
 </R3Row>
 <R3Row>
 <Duns>"001001927"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Extract_Code>"A"</Extract_Code>
 </R3Row>
 <R3Row>
 <Duns>"001001928"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Extract_Code>"A"</Extract_Code>
 </R3Row>
</R3File>
Trigger File:
<?xml version="1.0" encoding="UTF-8"?>
<R3File>
 <R3Row>
 <Duns>"001001929"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Ccr_Extract_Code>"A"</Ccr_Extract_Code>
 </R3Row>
 <R3Row>
 <Duns>"9999"</Duns>
 <Duns_Plus_4>""</Duns_Plus_4>
 <Ccr_Extract_Code>"A"</Ccr_Extract_Code>
 </R3Row>
</R3File>
I ve tested the XPATH condition in XML Spy and that works fine. My doubts are on the property "Recordset structure" set as "Row,5".
Any suggestions on this will be very helpful.
Thanks,
Mujtaba

Hi Debnilay,
We do have 64 bit architecture and still we have the file processing problem. Currently we are splitting the file into smaller chuncks and processsing. But we want to process as a whole file.
Thanks
Steve

Trigger process chain in ABAP program

Hi Experts,
We have a requirement to trigger the process chain from an ABAP program. I used the function module RSPC_API_CHAIN_START to trigger the process by passing the process chain name in 'I_CHAIN' and it worked. However, the client wants to trigger this using batch user name as few planners do not have authorization when they executed the custom transaction.
Based on the return code of the function module I am capturing the status for tracking.
Please suggest if there is any alternate solution to pass the user name while triggering a process chain in an abap program.
Thanks and Regards,
Pavithra

hi Chintai,
in bw side, you create a abap program to trigger an event in r/3,
and include this abap program in your process chain, the abap program like
CALL FUNCTION 'BP_EVENT_RAISE'
EXPORTING
eventid = 'ZRUNJOB_DEL'
and in r/3 schedule the program to delete previous data with 'after event',
the event name is same as raise by bw process chain, in this sample ZRUNJOB_DEL.
hope this helps.

Photoshop elements 8 not proceeding at multiple file processing

Hi everyone,
I've got the following problem with photoshop elements 8. I worked for a long time with it. Using the multiple file processing functionality a lot. I do quite a lot of big shoots and I only use the raw settings for processing. After that I let photoshop elements do the rest of the work, which is converting all my raw images into jpegs and resizing them to prepare them for uploading. These shoots often contain more then 200 photographs.
As of this last weekend when I start up the multiple file processing window it starts opening the first file but does not proceed. Which means that I have to edit all the images by myself and resize them to the proper size etc etc etc. I really don't want to do this. This funcionality is one of the main reasons why I use photoshop. Anyone got any idea why it suddenly stopped working? Anyone else experienced this and solved it?
Thanks a lot.
Ben

One thing to check is the bit depth that camera raw is set to.
Open a raw photo in the camera raw dialog and look down along
the bottom of the dialog where it says bit depth. If it says 16bit,
change to 8 bit and press done.
Photoshop elements sometimes won't process 16 bit files using process
multiple files.
MTSTUNER

Empty file processing

Hi All,
We are using PI 7.0 with SP 18. In one of our file to Idoc scenarios when posting empty files the file is picked up and archived but we are not getting any logs in moni. Further I couldnt find any option in the sender file adaper for empty file processing.
Can anyone please clarify on this?

hi,
>>>when posting empty files the file is picked up and archived but we are not getting any logs in moni.
this is good isn't it ?
>>>Further I couldnt find any option in the sender file adaper for empty file processing.
either you don't have correct SP level or you didn't import sap basis content approriate for your SP
Regards,
Michal Krawczyk

File Processing Techniques in ABAP

Similar Messages

Maybe you are looking for