Data Transfer methods

Hi all,
Can anyone please explain me what are synchronous and asychronous data transfer methods?
Where are the settings to be done in R/3 to get data to BI ?
Thanks in advance

Data Transfer
Definition
Synchronous Data Transfer
Data is transferred directly (simultaneously, synchronously) from program to program via CPI-C communication.
Both communications partners must be available at the same time. Because the central SAP system in a typical SAP installation does not run round the clock, but the linked systems are frequently in operation 24 hours a day, asynchronous data transfer is necessary.
Synchronous data transfer has the following disadvantages:
Transfer is not possible is the partner system or the line is not available.
A data backlog in the reciever system causes a data backlog in the sender system. Processing in the application is delayed.
If a connection is broken, it may be necessary to perform a recovery in both systems.
Asynchronous Data Transfer
With asynchronous, or buffered, data transfer, data is temporarily stored in a sequential queue.
Asynchronous transfer has the following advantages:
Wait times in the sender system are avoided.
A recovery is automatically performed in the sender system.
Transfer need not be performed during online time. This avoids placing unnecessary load on the system and thus helps to reduce costs.
The Queue Application Programming Interface (Q-API) is an SAP interface for asynchronous data transfer.
Data is buffered sequentially and processed immediately or later by an asynchronously running process.
One possible processing method is to send data to an external partner system via CPI-C. Data units that belong together can be stored in accordance with transaction and sent to a communications partner.
Data is buffered in queues before it is transferred to the target system.
In an R/3 System, the queues are stored in a relational database. All R/3 database systems are supported.

Similar Messages

ABAP Dataflow using FTP data transfer method

Hi,
I am facing this error while executing the ABAP dataflow, the datastore configuration has FTP as data transfer method.
I wanted to know if the ABAP program is generated succesfully and the error is while executing the ABAP program or there is an issue with the generation of ABAP program itself... Please help me understand the issue.
Since I am unable to attach the doc, please see the error message below.
Job name: Job_Module4_ECC_To_BW
(12.2) 02-28-11 11:14:45 (E) (16396:17152) R3C-150607: |Data flow DF_Module4_ECC_To_BW
Execute ABAP program <C:/TEMP/ZECC_To_BW> error < Open File Error --
madap8004\tmp/SAPECC_To_BW_ZCUST_NAME.txt>.
(12.2) 02-28-11 11:14:45 (E) (16772:15444) R3C-150607: |Data flow DF_Module4_ECC_To_BW
Execute ABAP program <C:/TEMP/ZECC_To_BW> error < Open File Error --
madap8004\tmp/SAPECC_To_BW_ZCUST_NAME.txt>.
Regards,
Sri
Edited by: srilakshmi.ponnada on Feb 28, 2011 11:58 AM

Hi,
I am really not clear with your question. This is the first time i am executing the ABAP interface with FTP data transfer method. The madap8004 is the FTP server name. and the path is where the file whould be generated I belive. Is it the problem with any read/write permissions on the server?
-Sri

Two Data transfer methods

Hi Gurus
Can any body tell if i will be asked like What are two data transfer methods? Which is the preferred method and why?
thanks in advance
murali

Hi,
The two data transfer methods are PSA and IDoc. In PSA, the number of fields is limited to a maximum of 255 when using TRFCs to transfer data. The length of the data record is limited to 1962 bytes when you use TRFCs.
refer this help link
http://help.sap.com/saphelp_nw04/helpdata/en/7d/724d3caa70ea6fe10000000a114084/frameset.htm
Regards,
R.Ravi

Data transfer method

Hai gurus,
I am new to Abap field.
Kindly confirm whether i had to use LSMW or BDC for the following data transfer.
Production and Planning:
1) Bill of material creation-
2) Recipe creation-
3) Resource creation-
Quality Control.
1) Quality plan
2) Quality sampling procedure.
3) Quality info record.
4) Master Inspection Characteristics.
5) List of material with inspection status
6) Inspection Method.
7) Sampling plan
waiting for the positive reply.
Regards,
sc

Hi Sekar,
If you have huge number of records & the process is onetime process, you can go for LSMW, no ABAP knowledge is required for this.
Hope this helps.
Rdgs,
Sripal

Hi Data transfer methods for ABAP Dataflow

HI
Good Day !!!!
Can any one Explain about What are Data tansfer mothods in ABAP Dataflow Explain Each one which is the best one can you explain with example .
Regards
Chandu

Data Transfer
Definition
Synchronous Data Transfer
Data is transferred directly (simultaneously, synchronously) from program to program via CPI-C communication.
Both communications partners must be available at the same time. Because the central SAP system in a typical SAP installation does not run round the clock, but the linked systems are frequently in operation 24 hours a day, asynchronous data transfer is necessary.
Synchronous data transfer has the following disadvantages:
Transfer is not possible is the partner system or the line is not available.
A data backlog in the reciever system causes a data backlog in the sender system. Processing in the application is delayed.
If a connection is broken, it may be necessary to perform a recovery in both systems.
Asynchronous Data Transfer
With asynchronous, or buffered, data transfer, data is temporarily stored in a sequential queue.
Asynchronous transfer has the following advantages:
Wait times in the sender system are avoided.
A recovery is automatically performed in the sender system.
Transfer need not be performed during online time. This avoids placing unnecessary load on the system and thus helps to reduce costs.
The Queue Application Programming Interface (Q-API) is an SAP interface for asynchronous data transfer.
Data is buffered sequentially and processed immediately or later by an asynchronously running process.
One possible processing method is to send data to an external partner system via CPI-C. Data units that belong together can be stored in accordance with transaction and sent to a communications partner.
Data is buffered in queues before it is transferred to the target system.
In an R/3 System, the queues are stored in a relational database. All R/3 database systems are supported.

Data Transfer methods between FPGA and RT

I have 10 values that I combined into a cluster that I want to send to the RT controller. The problem is if I just the read/write FPGA, I only get 1/10th of the data. I am assuming that it is the time taking to transfer from FPGA to RT. So I looked into DMA FIFO. When I use this, I do capture the data, but I notice jumps/shifts in the data. It's almost like the buffer fills up, and then dumps it at the last sec. To reduce this, I went from 10 values from the cluster to 2, and there were not shifts/jumps. The problem is I need all 10 values. So I'm wondering if I need to increase my DMA FIFO or if there is another meathod I need to use like Shared Varibles?
Thanks,
guilio

The one thing I still don't understand is what you mean by this "jump" in your data. Can you be a bit more specific about this? What I mean by jump. The elements coming from the FIFO in the RT controller will display on my array visual aid normally. Then you will see the data jump. Here is an example. I am bringing out 3 elements, X Y Z into an array. I'll read lets say 9 elements at a time. So my array, after I transform it into a 2D array for saving will look like this. [x y z;x y z;x y z]. At some points in time, the array will jump and look like this. [x y z;z x y ;z x y]. Then it will go back to how I expect it to look [z x y;x y z;x y z]. Right now, I am reading ~3000 elements. The elements remaining depends on what else is going on. If the visual aids are deleted, then elements remaining will never max out and thus, I won't get jumps. If I put visual aids in, then I get jumps because elements remaining maxes out. This leads me to believe that the FIFO is filling up and since it can't release all the information fast enough, then it just dumps it and fill it up again. The weird thing about it, It doesn't happen in a pattern (every 3000 elements). I tried putting them in seperate loops, it still slows things down. I tried queing/dequeing, still slows it down. I need to be able to read all elements fo all 3 DMA transfers at once. Maybe it will help us locate the problem. Otherwise, your DMA FIFO looks OK. Can you verify the number of times your data is written to the FIFO from the FPGA? When I put a clock in to measure loops speed, it was showing 8-9us. I can't have this no more than 10us or I will missed data. I would like to see a definite count of this. Then on the RT side, what does the "Elements Remaining" output look like? As before, elements remaining depends on what else is going on. If I just have the DMA FIFO's, then I can adjust the read elements number so all three don't max out, but as soon as I put something else in, it will max out. Since this is a FIFO we should be able to keep very close track of elements in and out.
Let me know if you need more info. I know about the FXP point transfer, unfotunately, not all my FXP elements are the same data type.
Thanks,
guilio

How to load hierarchie with IDOC as data transfer method

hi ,this is balaji, i have doubt.
can any one please explain, how to up load hierarchies using IDOCs. If any material provided could be helpful.And also give me what are the pros and cons.
regards
balaji.p

HI Balaji,
Check out the following link to load hierarchies:
http://help.sap.com/saphelp_bw33/helpdata/en/fa/e92637c2cbf357e10000009b38f936/content.htm
regards

Transfer Methods, data package

Hi,
I would like to know about
1) the differences between PSA and IDocs
2) the datapackage

Hi,
1.PSA and IDOC methods are two different data transfer methods in BW.
2. PSA will act as backup during dataload failure.
3. Data redundantly stored in the BW system for further usage but not in IDOC methods,
4. IDOC uses two types of IDOC in transferring the data - Information -IDOC and Data IDOC.
5. for dalta loading use PSA is the suggestion.
6. Updation in IDOCmethod is faster.
7. Error occurrence in IDOC is more.
Reg,
Vishwa

MyRIO memory, data transfer and clock rate

Hi
I am trying to do some computations on a previously obtained file sampled at 100Msps using myRIO module. I have some doubts regarding the same. There are mainly two doubts, one regarding data transfer and other regarding clock rate.
1. Currently, I access my file (size 50 MB) from my development computer hard drive in FPGA through DMA FIFO, taking one block consisting of around 5500 points at a time. I have been running the VI in emulation mode for the time being. I was able to transfer through DMA from host, but it is very slow (i can see each point being transferred!!). The timer connected in while loop in FPGA says 2 ticks for each loop, but the data transfer is taking long. There could be two reasons for this, one being that the serial cable used is the problem, the DMA happens fast but the update as seen to the user is slower, the second being that the timer is not recording the time for data trasfer. Which one could be the reason?
If I put the file in the myRIO module, I will have to compile it each and every time, but does it behave the same way as I did before with dev PC(will the DMA transfer be faster)? And here too, do I need to put the file in the USB stick? My MAX says that there is 293 MB of primary disk free space in the module. I am not able to see this space at all. If I put my file in this memory, will the data transfer be faster? That is, can I use any static memory in the board (>50MB) to put my file? or can I use any data transfer method other than FIFO? This forum (http://forums.ni.com/t5/Academic-Hardware-Products-ELVIS/myRIO-Compile-Error/td-p/2709721/highlight/... discusses this issue, but I would like to know the speed of the transfer too.
2. The data in the file is sampled at 100Msps. The filter blocks inside FPGA ask to specify the FPGA clock rate and sampling rate, i created a 200MHz derived clock and mentioned the same, gave sampling rate as 100Msps, but the filter is giving zero results. Do these blocks work with derived clock rates? or is it the property of SCTL alone?
Thanks a lot
Arya

Hi Sam
Thanks for the quick reply. I will keep the terminology in mind. I am trying analyse the data file (each of the 5500 samples corresponds to a single frame of data) by doing some intensive signal processing algorithms on each frame, then average the results and disply it.
I tried putting the file on the RT target, both using a USB stick and using the RT target internal memory. I thought I will write back the delay time for each loop after the transfer has occured completely, to a text tile in the system. I ran the code my making an exe for both the USB stick and RT target internal memory methods; and compiling using the FPGA emulater in the dev PC VI. (A screenshot of the last method is attached, the same is used for both the other methods with minor modifications. )To my surprise, all three of them gave 13 ms as the delay. I certainly expect the transfer from RT internal memory faster than USB and the one from the dev PC to be the slowest. I will work more on the same and try to figure out why this is happening so.
When I transferred the data file (50MB) into the RT flash memory, the MAX shows 50MB decrease in the free physical memory but only 20MB decrease in the primary disk free space. Why is this so? Could you please tell me the differences between them? I did not get any useful online resources when I searched.
Meanwhile, the other doubt still persists, is it possible to run filter blocks with the derived clock rates? Can we specify clock rates like 200MHz and sampling rates like 100Msps in the filter configuration window? I tried, but obtained zero results.
Thanks and regards
Arya
Attachments:
Dev PC VI.PNG ‏33 KB
FPGA VI.PNG ‏16 KB
Delay text file.PNG ‏4 KB

Faster ethernet data transfer time than 2ms

Dear all,
I'm using labview 7.1 based on a standard laptop communicating with a LabVIEW real time maching running the standard real time operating system. The two machines are connected through a dedication ethernet switch (rated to 1Gbs), and both have ethernet cards (rated at 100Mbs or greater).
The aim of my project is to have a fast distributed control scheme going. This basically means that small amounts of sensor data have to be transferred very quickly between the two machines. The aim is to then scale this to have more machines on the network.
I use a UDP data transfer method, using the standard labview UDP read and UDP write vis.
I would like to acheive a major frame rate of around 500Hz. The problem I have restricting me with this is the speed of the ethernet connection. It would appear that the vi wrtes to buffer instantaneously, but it is taking as much as 2-3ms for the data package to be sent and received by the other machine. This is a ridiculously long amount of time. I'm sending approximately 100bytes, so the time on the network should be 0.01ms. This would suggest the time delay is in the reading or writing of the data from the Ethernet card over the PCI bus to the program.
Does anyone know why its taking so long? Do the UDP read vis only check the ethernet hardware every ms? I've taken great care to ensure that this is not a synchronisation or timing problem and I am certain it is not that.
I could really do with making this data transfer quicker as it is clearly the slowest part of the control loop. If anyone has come across this before and found a solution I would be grateful to know about it. I'm really hoping that I won't have to write something low-level in C or anything like that and try and integrate it with the code I have.
Many thanks,
Pete

Finally found some hard numbers for data transfer rates. From this website. http://www.intellicom.se/ModbusTCP_overview.shtml
Performance from a MODBUS TCP/IP system
The performance basically depends on the network and the hardware. If you are running MODBUS® TCP/IP over the Internet, you won't get better than typical Internet response times. However, for communicating for debug and maintenance purposes, this may be perfectly adequate and save you from having to catch a plane or go to site on a Sunday morning!
For a high-performance Intranet with high-speed Ethernet switches to guarantee performance, the situation is completely different.
In theory MODBUS® TCP/IP carries data at up to 250/(250+70+70) or about 60% efficiency when transferring registers in bulk, and since 10 Base T Ethernet carries about 1.25 Mbytes/sec raw, the theoretical throughput is:
1.25M / 2 * 60% = 360000 registers per second and the 100 Base T speed is 10 x greater.
This assumes that you are using devices that can service Ethernet as fast as bandwidth is available.
Practical tests carried out by Schneider Automation using a MOMENTUMTM Ethernet PLC with Ethernet I/O demonstrated that up to 4000 I/O bases could be scanned per second, each I/O base having up to 16 12-bit analog I/O or 32 discrete I/O. Four bases could be updated in one millisecond. While this is below the theoretical limit calculated above, it must be remembered that the tested device was running with a lowly 80186 CPU running at 50Mhertz with an effective computing power of 3 MIPS (compared to the 700 MIPS of a 500MHz Pentium). Also, these results are nevertheless faster than the proprietary I/O scan methods used to date.
As low-end CPU's get cheaper, Momentum-type devices will chase the theoretical limit, although they'll never reach it because the limit will be continually pushed further away with 1 Gigabit Ethernet, 10 Gigabit Ethernet, etc. This is in contrast to other field-buses which are inherently stuck at one speed

ADO's Use with XML for Data Transfer

Does anyone know if ADO is supported as a data transfer method
between XML and Oracle8i and back (from Oracle8i and XML)? If
not, are any other Microsoft drivers supported for this type of
operation?
null

Hi there,
I have a similar question for you: I have an ASP page (coded in vbScript) that connects to an oracle 9i database via ODBC and accesses data using ADO.
Using this method I can read and write to the database successfully for all data types except that of XML Type.
It is my understanding that a column of XML Type is fundamentally treated as a CLOB column underneath the covers. Then why can I write data to a CLOB column and not to an XML column using ADO methods??
Here is the code I am using:
'put my dom object into a variable
Dim xmlDoc
xmlDoc = objDom.xml
' Connection string
Dim cnxn
Set cnxn = Server.CreateObject("ADODB.Connection")
cnxn.Open "dsn=sc3;uid=user;pwd=password;"
' Recordset object
Dim rs
Set rs = Server.CreateObject("ADODB.Recordset")
rs.Open "Select * FROM xmltabletest", cnxn, 2, 2
'write xml document to column of xml type
rs.AddNew
rs("xmlcol") = xmldoc
rs.Update
' clean up
rs.Close
cnxn.Close
Set rs = Nothing
Set cnxn = Nothing
Any help with this would be great. I'd also like to write the xml document to a table of xml type using the same/similar method.
Can anyone help me please?!?
Thanks in advance,
Ari

Transfer Method in transfer rules

Dear All,
If I make an infosource and assign data source go to " change transfer rules". I get 2 radiobutton options in "transfer method"....PSA or IDOC. What is this? How does it affect the flow of data? and how is it different from the options I get in infopackage?
Regards,
Ratish
[email protected]

Hi Ratish,
The two data transfer methods are PSA and IDoc. In PSA, the number of fields is limited to a maximum of 255 when using TRFCs to transfer data. The length of the data record is limited to 1962 bytes when you use TRFCs.
If u choose PSA as the transfer method, staging of data can be possible.It stores the exact replica of the data from the source system.In case if the load fails, you can retrive data from the psa through manual update or reconstruction.
And also editing can be done in psa.
where as in IDOC error handling is not possible. In requirements where security plays major role we use this type of transfer method, where no one can edit the information.But when the load fails we have to run the load again from the source system.
Refer help link
http://help.sap.com/saphelp_nw04/helpdata/en/7d/724d3caa70ea6fe10000000a114084/frameset.htm
TRANSFER METHOD IN THE INFOSOURCE? PSA/IDOC
regards
@jay

PSA Vs IDOC transfer method

Hello BW Experts,
Most of the time i have observed the PSA data transfer method being used.
1) if the use of psa transfer method is only for the purpose of having the temporary storate, then can we go for the IDOC method if we are not using the temporary storage.
2) What is the advantage of using IDOC method over PSA when the temporary storage for the load is not required.
Thanks,
BWer

Hi,
Persistent Staging Area is a transparent database table in which request data is stored in the form of transfer structure.A PSA is created per datasource and source system. It represents an initial store in BW in which the requested data is saved unchanged for source system.PSA
1) Checks whether extraction from source system is complete
2)ensures data quality,supports editing,reconstruction and deletion of data.
IDoc is an Intermediate Document container for exchanging data between R/3,R/2 and non-SAP systems.
It is a data transfer wherein the data is in the form of packets.
It is used in the case of flatfiles as debugging is easier.
IDoc method - The data is packed into IDocs by the source system and sent to BW.
PSA - In this method the data from the source system is stored in PSA tables before being updated in the Data Target/Info-object.
The PSA is generally the preferred method because of its various advantages like Reconstruction, Data editing, etc..
Idocs are generally preferred when the data comes from flatfile. However Idoc transfer method have a limitation - transfer structure must not have more than 1000 Bytes in the character format.
IDOC is only there because of compatibility reasons. It supports a smaller structure and has no other advantages. You should always use PSA.
1> DAta sources with the IDOC transfer methode are not supported with ODS object.
2> you can only create start routine for transfer methode PSA.
Helplink:
http://help.sap.com/saphelp_nw04/helpdata/en/35/2cd77bd7705394e10000009b387c12/frameset.htm
http://help.sap.com/saphelp_nw04/helpdata/en/72/31823cdcf5f354e10000000a11402f/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/de/113037530b7774e10000009b38f839/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/b0/ab8e3cb4340b14e10000000a114084/content.htm
-Shreya

For Enhancement t-code Which Data transfer is better

Hi..!!!
if any enhancement has to be done in any t-code then what data transfer method is best...

Hi,
If you have standard BAPI available for the transaction and it can handle the enhanced part as well then its better to use a BAPI, otherwise you need to go for a BDC no other option.
All standard BAPI's doesn't support to you to add data your custom fields in the transaction, in that case you need to use BDC.
Thanks,
Mahesh.

Different methods of data transfer in LSMW?v

Different methods of data transfer in LSMW?v
could u plz explain clearly

please visit the following link
https://wiki.sdn.sap.com/wiki/display/HOME/LSMW
http://www.scmexpertonline.com/downloads/SCM_LSMW_StepsOnWeb.doc
There are four method!
1-Direct Input Method
2-BDC
3-BAPI
4-IDOC
Please reward me point as way of thanks

Data Transfer methods

Similar Messages

Maybe you are looking for