Transfer bulk data using replication

Hi,
We are having transactional replication setup between two database where one is publisher and other is subscriber. We are using push subscription for this setup.
Problem comes when we have a bulk data updates on the publisher. On publisher size the update command gets completed in 4 mins while the same takes approx 30 mins to reach on the subscriber side. We have tried customizing the different properties in Agent
Profile like MaxBatchSize, SubsriptionStreams etc but none of this is of any help. I have tried breaking the command and lot of per & comb but no success.
The data that we are dealing with is around 10 millions and our production environment is not able to handle this.
Please help. Thanks in advance!
Samagra

How is the production
publisher server
and subscriber server
configuration ? both are same ? How about the network bandwidth ? have you tried the same task with during working
hours and off hours ? I am thinking problem may be with network as well as both the server configuration..
If you are doing huge operating with replication this is always expected, either you should have that much configuration or you have divided the workload on your publisher server to avoid all these issues. Why can you split the transactions ?
Raju Rasagounder Sr MSSQL DBA

Similar Messages

  • How to do Bulk data transfer  using Web Service

    In my application I have to write various web services but majority of the web service has to
    query database and return back bulk data(rows>10K) through web service.
    So I would like to ask what is the efficient way of transferring bulk data using web service as presently
    Iam returning the dataset as xml String (using StringBuilder) from web service and consuming the same at client end.
    Is there a better way to this in web service?
    My env:
    Front end can be in any other technology ,UI like C#
    Back end : Tomcat 6 on Java 6 with Axis2
    Thanks in advance

    Innova wrote:
    But then also I have to mention a return type although its xml that is getting transferred.
    Can you provide me a with a small sample code.Like if I have Emp obect with properties
    Empname,EmpID,DOJ,DOB,Dpt . In this case what will be the return type.
    My major concern is that my resultset is going to be huge in terms of >10,000 rows so
    that much time for formation of xml and then the transfer so how can I reduce the transfer
    time ,I meant a faster optimised approach for transferring large data as part of web service.
    Simply putting , how can I transfer bulk data in minimum time so that I can reduce the
    waiting time at client side for the response.
    Thanks in advanceI've done this with thousands before now, and not had a performance problem...at least nothing worth writing home about.
    Your return type will be an array of Emp objects. You can use a SOAP array for that (you'll need to look that up for the syntax, since I can't remember it off the top of my head), which gets restricted to being an array of Emp.
    Should the normal technique prove to be too slow then you should look at alternatives, but I would expect this to work well enough. And you have no faffing about with devising a new transfer system that then has to be explained to your client system...it'll all be standard.

  • Bulk data transfer

    Hi,
    I want to transfer bulk data from SAP R/3 to a third party systems.
    Is using SAP XI the correct solution?
    Will SAP XI be able to handle millions of data?
    Since the data is persisted in SAP XI will not that be a constraint?
    What will be the best solution to transfer bulk data from SAP R/3?
    Thanks & Regards
    Monzy

    Hi Monzy,
    we have also faced this situation where we have to think
    about using XI for mass data volume loading into and from
    R/3.
    First you have to know if your interface is a quasi permernant one or just one time interface. We do all one
    time interface with abap program, ALE, idoc or LSMW and
    not through XI.
    If your interface is permantly than the answer should be
    yes for XI. If your interface is is not permanantly but
    it would run once in a month or quarterly than the answer
    should be yes to XI also.
    If using XI with mass data you have to think aboud
    archirving or deleting XML-Message regurlarly from the
    XI-System (IS and AFW separately). We use now the deletion
    option in our productiv system. We delelete every day a
    little bit xml-message that lie back since 30 day.
    Synchronous message are not persisted, so no worry about
    it. Some errornous message have to be archive and can not
    be deleted from the system.
    Hope this will help you in your Decision.
    regards,
    Ly-Na Phu

  • How can I transfer binary data from a database to another database?

    Hi all.
    I want to transfer binary data from a MS SQL Server 2000 to anohter SQL Server 2000.
    I created JDBC(table) to JDBC(stored procedure) scenario,and
    I uploaded a JPG image file to the sender table using the java program I developed.
    The JPG data was transfered to receiver,but the transfered data was broken.
    I can't not open the file correctly.
    Can XI transfer binary data using JDBC adapter?
    The sender table structure is following.
    <b>column (data type)</b>
      id  (int 4)
      binary (binary 8000)
      flag (int 4)
    The receiver stored procedure parameter is following.
    <b>parameter (data type)</b>
       id  (smallint)
      binary (binary 8000)
      flag (smallint)
    Regards.
    Yuuki

    Hi,
    <i>Can XI transfer binary data using JDBC adapter?</i>
    Ans: Yes
    Supported JDBC Types
    http://help.sap.com/saphelp_nw04s/helpdata/en/16/9dc9ac8bc72a48b80e639abaa2e497/frameset.htm
    http://help.sap.com/saphelp_nw2004s/helpdata/en/2e/96fd3f2d14e869e10000000a155106/content.htm
    Mapping JDBC types to Java types
    http://help.sap.com/saphelp_nw04/helpdata/en/7d/79dfa72d1049bc963f4f272bb1638e/frameset.htm
    Regards,
    Prateek

  • Mass data+use bulk itu00B4s possible ?

    hi guys,
    I have in my backend system about 200.000 register.
    I use bulk (get_detail) to bring all data using a single get_detail , instead of use get_list and after get the keys headers execute details for each key (200000 times) .
    The approach is correct ? what the best solution ? can I use mass + use bulk ?
    I need help about huge data transfer to CDS. thanks

    You can use Mass GetList and Bulk Get Detail together.
    If you are working with SP04 of Gateway1.1 to SAP Netweaver Mobile 7.10. Then you can check the code in following data objcets.
    1. Goto SDOE_WB transaction
    2. Select MAS_SRVASG data object from SWCV :: MAS_SMARTPHONE_SERVICE , 1.4 of  SAP.
    3. Select the backend adapter "MAS_SRVASG_BA" and view the Get List & Get Details BAPI wrappers which uses both these functionalities.
    In Short:
    Get List with Mass Data: This should provide set of record keys. [Using Mass Get List|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/50fa3a06-8bcb-2c10-1daf-c604a4880361]
    Get Detail with Bulk: This should have root node details as TABLES parameter. DOE will invoke the BAPI wrapper by providing number of keys in this TABLES parameter. BAPI wrapper should return the values for all these keys by populating all other tables and the root node information also. Check question 8 from following link:
    [Question about Use Bulk Detail|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/10de86e2-41d0-2c10-7e96-e9337967f7fe]
    Regards,
    Siva.
    Edited by: Siva Satya Prasad Yerra on May 9, 2011 12:44 PM

  • How do I transfer my data to my new macbook pro using an external hard drive?

    I've already set up my new MacBook Pro is my issue. It asked me if I'd like to "Migrate" my stuff or use an external hard drive etc but at the time I didn't transfer my data from my old MacBook yet. I was going to manually do it later as I had to wait for my External hard drive to back my old Mac up. Now it's that time and I have no idea how to do it. I believe I've researched best of my ability.
    I feel like I'm asking a pretty dumb question. If I were to just drag all my programs out like my Adobe Suite on to my new macbook pro would that work? I feel like that's just too easy and incorrect. Please and thank you.

    The Adobe suite can be downloaded free, you dont have to copy it at all, under standard CS6 Adobe rules, if you own the suite, you get 2 computers "activated at any one time"  Make sure, if youre not using the older computer, you deactivate the software under the HELP menu in Adobe.
    format the new drive in disk utility ......APPLICATIONS.....UTILITIES.....DISK UTILITIES.......select the external drive and format (if its new and empty!!!) under the ERASE button with Mac OSX extended journaled
    copy all your important stuff from older computer , pics, files, documents, personal anything.
    most of you apps, i ASSUME you bought in the (other than Adobe software, or Office suite, etc etc,..... obviously) in the MAC APP store, so you can reload them on the new computer without copying them , makes things very easy......just open APP STORE, and download what you already bought.
    really the only important things , is copy all important work files, documents, pictures, personal ABC...XYZ......  obviously.
    the migration is about emails, contacts, etc etc etc, also data, just because you passed it by at the time doesnt mean you still cant do it,    go to the SEARCH at menu at top and type in MIGRATION ASSISTANT  to do it again , since you passed it by at first .
    the only thing you NEED / SHOULD copy is all your personal stuff........Applications need to be reinstall from either ONLINE download,.......or from the MAC APP STORE,........  you cant just copy the apps over (in most cases) and toss them onto the new computer
    Nahh, there are no dumb questions, just dumb mistakes because you DIDNT ask any questions, and we all make those here and there. 

  • Me and my partner are currently using the same apple id and have no space left on our devices. We are currently waiting on the iphone 6 plus to arrive and don't know how to transfer all data to the new phones.

    Me and my partner are currently using the same apple id and have no space left on our devices. We are currently waiting on the iphone 6 plus to arrive and don't know how to transfer all data to the new phones.?

    I don't know if I'm asking this all in a way that can be understood? Thanks ED3K, however that part I do understand (in the link you provided!)
    What I need to know is "how" I can separate or rather create another Apple ID for my son-who is currently using "my Apple ID?" If there is a way to let him keep "all" his info on his phone (eg-contacts, music, app's, etc.) without doing a "reset?') Somehow I need to go into his phone's setting-create a new Apple ID and possibly a new password so he can still use our combined iCloud & Itunes account?
    Also then letting me take back my Apple ID & password, but again allowing us (my son and I) to use the same iCloud & Itunes account? Does that make more sense??? I'm sincerely trying to get this cleared up once and for all----just need guidance from someone who has a true understanding of the whole Apple iCloud/Itunes system!
    Thanks again for "anyone" that can help me!!!

  • I want to transfer my data to new computer and use the new computer for iPhone 5. Have anyone can recommend the best way for me?

    I have some problem to transfer my data via home sharing. (Maybe my internet connection is poor)
    I tried to transfer all the apps and music via home sharing. When it's done, it showed the internet connection is time-out. (So sad )
    So I want some people to help me about the methods to transfer datas from old computer to the new one.
    Then I can use the new one with new iphone 5.
    PS. I use iPhone 3gs with iOS 4.3.5.
    Old computer uses Microsoft WIndows XP.
    New one uses Microsoft Windows 7.
    Thank you

    you can't recover iOS crypted backup password, for security purposes. your backup is useless. sorry.
    if you still have your old iPhone, make a new back-up

  • Upload data for Tcode LT06(Transfer order creation) using BDC -very urgent

    hi experts,
          I got stucked up in writing a BDC for the Tcode LT06(Transfer order creation using wearhouse number) in MM module,
    the problem is like this, when i go to the tcode LT06 , it will ask for material doucument,mat. docu. year and wearhouse number, iam entering the inputs and then press enter, as soon as i press enter it takes me to the second screen where i will be selecting the item and then click on the button called  'Generate TO item'
    here the problem arises, as soon as i click the button iam getting a standard SAP error message(No Destination Storage Bin found in storage type 'IMP'). Due to this errror iam not able populate the batch input data on the screen, suggest me a proper solution. rewards will given if solution found useful.
    Kishore K

    Hi ,
    I have done the same in Background with BDC and TR Number for Multiple Materials ,
    Can u please explain the scenario, so then I would be able to try for solution ?
    Warm Regards.

  • Used Migration Assistant to successfully transfer PC files to Mini. However file creation or modified date does not transfer. Date of creation is listed as day of transfer.  I would gratefully appreciate any help in solving this,

    Used Migration Assistant to successfully transfer PC files to Mini. However file creation or modified date does not transfer. Date of creation is listed as day of transfer.  I would gratefully appreciate any help in solving this?

    I have the same problem; used Migration Assistant to transfer all my pix from PC to MacbookPro, however dates of pix were not transferred. Date created as the date of transfer. Cannot sort my pix according to date.
    Anybody has an answer?

  • How  to transfer data using Lsmw with Recording...

    hi,
    Please let me know .How to use Lsmw to transfer data using recording.
    Thanks,
    Lawrence.

    Hi Lawrence,
    please go thru this link for LSMW data transfer techniques in PM, MM and SD modules.
    https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/90d90895-68dd-2a10-f096-bf8cf2e2f65b
    If u want to know in detail go thru this link
    http://help.sap.com/saphelp_nw04s/helpdata/en/87/f3ae74e68111d1b3ff006094b944c8/frameset.htm
    Hope this will be useful to u..
    Thanks
    Vijayasree

  • Easiest way to transfer contacts/data from old phone (5) to new (6 and 6 ). I did "back up to this computer" for both phones. After activation (verizon) do I just plug into iTunes? One phone is still using iOS7 (is that a problem?, other is iOS 8.1.

    What is the best/safest way to transfer contacts/data from old phones (5) to new (6 and 6 ). I did "back up to this computer" for both phones. After activation (verizon) do I just plug into iTunes? One of the old phones is still using iOS 7, will that be a problem?  (the other has iOS 8.1).

    The following has instructions on how to transfer to a new iPhone using either iCloud or iTunes: Transfer content from an iPhone, iPad, or iPod touch to a new device - Apple Support

  • To transfer the data Cross the systems why we are not using BAPI Method?

    Hello All,
    To transfer the data Cross the systems why we are not using BAPI Method? why we are using only ALE/IDoc's?

    Hi Naveen,
       Listing down those I know -
       1. Master data is expected to be changed/created less frequestly.
       2. Transactional data is expected to be chnaged/created more frequestly.
       3. Transactions to create/change/display master data do no have message control integration, since you are not supposed to print/fax/mail master data to your partners.
       4. Distribution of master data in generally supposed to happen within Enterprise boundry and typically you will have one central server maintaining master data which will be distributed to multiple downstream operation system (Some thing where MDM fits). So ideally when distributing master data using ALE you will be sending it to multiple systems.
       5. Distributing transactional data PO/SO etc is same as sending fax/print which fits with the requirement of message control.
    Hope this helps,
    Regards,
    Sanjeev

  • I have a new macbook air, and want to transfer all my data using time machine from my old macbook running leopard, is this possible and easy

    I have a new macbook air, and want to transfer all my data using time machine from my old macbook running leopard, is this possible and easy and will it transfer all my musc and photos?

    The Setup Assistant can restore your data from a Time Machine backup. You'll be asked if you want to do this the first time you turn the computer on.
    (60797)

  • HT4889 Is there a way to abort a transfer of data from an old MacBook Pro to a new one when you're using Wi-Fi?

    Is there a way to abort a transfer of data from an old MacBook to a new MacBook Pro when you're using Wi-Fi?

    If you are sure you want to to do it: command + option + esc, then and Force Quit.
    ethernet is much faster than wifi.

Maybe you are looking for