Best Way to port the data from one DB to another DB using Biztalk

Hi,
please suggest best way to move the data from one db to another DB using biztalk.
Currently I am doing like that, for each transaction(getting from different source tables) through receive port, and do some mapping (some custom logic for data mapping), then insert to target normalized tables(multiple tables) and back to update the status
of transaction in source table in sourceDB. It is processing one by one.
How/best we we can do it using  bulk transfer and update the status. Since it has more than 10000 transaction per call.
Thanks,
Vinoth

Hi Vinoth,
For SQL Bulk inserts you can always use SQL Bulk Load
adapter.
http://www.biztalkgurus.com/biztalk_server/biztalk_blogs/b/biztalksyn/archive/2005/10/23/processing-a-large-flat-file-message-with-biztalk-and-the-sqlbulkinsert-adapter.aspx
However, even though a SQL Bulk Load adapter can efficiently insert a large amount of data into SQL you are still stuck with the issues of transmitting the
MessageBox database and the memory issues of dealing with really large messages.
I would personally suggest you to use SSIS, as you have mentioned that records have to be processed in specific time of day as opposed to when the
records are available.
Please refer to this link to get more information about SSIS: http://msdn.microsoft.com/en-us/library/ms141026.aspx
If you have any more questions related to SSIS, please ask it in
SSIS 
forum and you will get specific support.
Rachit

Similar Messages

  • Copy the data from one column to another column using @

    I have two columns here - A and B.
    Column A has a complicated formula that will generate results. I wanted the results in Column A to be reflected in Column B without pasting the A's formula in B. This will save me the trouble of editing formulas in more than 1 column if there is a need.
    I saw somewhere that you can use "@" in column B but I have no idea how to use it.
    Assumingly column A is the first column. I tried to insert '@1' in B's formula and change B's column properties' Data Format as "Treat Text as HTML". It does not work.
    Please advise how I can do that.

    So is there any way to copy the data in Column A into Column B without putting the same formula? something like in Excel where we put "=C1". Its not possible in BI as it comes in excel.....The only way is to create a duplicate column in RPD or Answers screen and incorporate the formula and giving different name to it.
    whats the problem if you duplicate the column with same formula?....Ok still if you dont want to see identical just write some pseudo logic say
    Duplicated column f(x) case when 1=0 then column_name else formula end.....so it appears different to see but it outputs same.
    UPDATED POST
    Dont create in RPD,you can create a dummy column in that report request and change the f(x) to the above case i mentioned by taking the column from columns button in edit formula screen so when ever you edit the actual column formula that would reflect in the dummy column also as it is replicating from original one.Try and see
    hope helps you.
    Cheers,
    KK
    Edited by: Kranthi.K on Jun 2, 2011 1:26 AM

  • I am moving from PC to Mac.  My PC has two internal drives and I have a 3Tb external.  What is best way to move the data from the internal drives to Mac and the best way to make the external drive read write without losing data

    I am moving from PC to Mac.  My PC has two internal drives and I have a 3Tb external.  What is best way to move the data from the internal drives to Mac and the best way to make the external drive read write without losing data

    Paragon even has non-destriuctive conversion utility if you do want to change drive.
    Hard to imagine using 3TB that isn't NTFS. Mac uses GPT for default partition type as well as HFS+
    www.paragon-software.com
    Some general Apple Help www.apple.com/support/
    Also,
    Mac OS X Help
    http://www.apple.com/support/macbasics/
    Isolating Issues in Mac OS
    http://support.apple.com/kb/TS1388
    https://www.apple.com/support/osx/
    https://www.apple.com/support/quickassist/
    http://www.apple.com/support/mac101/help/
    http://www.apple.com/support/mac101/tour/
    Get Help with your Product
    http://docs.info.apple.com/article.html?artnum=304725
    Apple Mac App Store
    https://discussions.apple.com/community/mac_app_store/using_mac_apple_store
    How to Buy Mac OS X Mountain Lion/Lion
    http://www.apple.com/osx/how-to-upgrade/
    TimeMachine 101
    https://support.apple.com/kb/HT1427
    http://www.apple.com/support/timemachine
    Mac OS X Community
    https://discussions.apple.com/community/mac_os

  • What is the best way to transfer home videos from one mac to another?

    What is the best way to transfer home videos from one mac to another?

    hustonsmom wrote:
    the commercial is deceiving to me. i am not the most techy person and i thought that you could share full song playlist which to me meant the songs also. that is all, it wasnt anything you had said but i am really thankful you enlightened me because i would still be racking my brain trying to figure out how to do it.
    You can share songs, but if there is DRM protection on the song, it will not play on the other device unless you also transfer the rights to the other device. You are getting into the problem of music piracy.

  • What is the best way to move my itunes from one computer to another and retain all files?

    what is the best way to move my itunes from one comupter to another?

    I assume you mean the media and playlists, not the iTunes application.
    http://support.apple.com/kb/HT4527

  • How do I transfer the data from one iPad to another

    How do I transfer all of the data from one ipad to another one?

    The best way IMO is to sync each iPad with your computer. Having all your stuff backed up on a computer is a good idea anyway. Just read how many folks here are trying to recover lost stuff that could easily be copied back from either backup or iTunes on the computer.
    Sync both iPads to the computer. Transfer all photos to the same computer. Then sync again selecting which items you want on each iPad.

  • Porting varray data from one db to another remote db using queues and jms

    We are trying to port a varray from one db to another db using queues and java jms. The varray is embedded in an object type (necessary according to oracle docs). The varray, embed object, and the queues are identical between the 2 dbs. We have used the capabilities in jdeveloper to generate the necessary classes to access the embed object and its payload the varray.
    However, when we attempt this:
    public void publish( com.wgint.sql.EaiType payload )
    throws JMSException, SQLException
    Connection dbConnection = ((AQjmsSession)session).getDBConnection();
    AdtMessage message = ((AQjmsSession)session).createAdtMessage();
    message.setAdtPayload( payload );
    ( (AQjmsTopicPublisher) publisher ).publish( publisher.getTopic(),
    message,
    agents );
    we get a ora-00902 error, invalid datatype. I cannot find a single example on technet or the internet in which someone has done something similar. I do not know if it is feasible or not.
    Steve

    Do you really need JMS to do this? If not, just let the AQ layer propagate your messages from your local to your remote queue. See the online doc how to do this.

  • How to copy the data from one database to another database without DB link

    Good Day,
    I want to copy the data from one database to another database with out DB link but the structure is same in both.
    Thanks
    Nihar

    You could use SQL*Plus' COPY command
    http://technology.amis.nl/blog/432/little-gold-nugget-sqlplus-copy-command
    http://download.oracle.com/docs/cd/B19306_01/server.102/b14357/apb.htm#sthref3702
    Edited by: Alex Nuijten on Sep 16, 2009 8:13 AM

  • What is the best way to mimic the data from production to other server?

    Hi,
    here we user streams and advanced replication to send the data for 90% of tables from production to another production database server. if one goes down can use another one. is there any other best option rather using the streams and replication? we are having lot of problems with streams these days they keep break and get calls.
    I heard about data guard but dont know what is use of it? please advice the best way to replicate the data.
    Thanks a lot.....

    RAC, Data Guard. The first one is active-active, that is, you have two or more nodes accessing the same database on shared storage and you get both HA and load balancing. The second is active-passive (unless you're on 11.2 with Active Standby or Snapshot Standby), that is one database is primary and the other is standby, which you normally cannot query or modify, but to which you can quickly switch in case primary fails. There's also Logical Standby - it's based on Streams and generally looks like what you seem to be using now (sort of.) But it definitely has issues. You can also take a look at GoldenGate or SharePlex.

  • Transferring the data from one system to another system.

    Hi All,
       I need to transfer the material master data from one system(e.g - dev1)
    to another system (e.g - dev2).
      front end application is BSP.
      if the user enters the material number 1 to 20 and if he presses the submit
      button, the entire data should be transferred to another system.
      This transferring of data should be done in background.
      1. which method we should opt for this ? either ALE or any other method like XI.
      2. Is there any standard bapi function module to transfer the material master from one system to another system.
      3.  whether this above transferring can be done thru XI and which will be best approach for doing this?
    Points will be awarded.
    Regards,
    Vinoth.

    Hi amole,
       Thanks for the reply.
        How to use lsmw for transferring fo data from one system to another system.?
       whether to download the data from one system in excel or notepad and again to upload into other system?
       can u explain me.
    Regards,
    vinoth.

  • Best Way to Migrate an application from one server to another

    I couldn't seem to find the best way to this by Googling. If you have two instances of Sun Web Server 7, and you want to migrate a web application from one server to another, what is the best way to that?

    I am sorry. My question was poorly worded after some hours of frustration. What I am really trying to do is develop a base virtual machine snapshot with Sun Web Server Loaded and a base set of applications.
    When the need arises, I need to deploy another VM and start it up. There seems to be some issue with the host name of the VM and the administration server, or something. It is my impression that as longs as I have everything contained in one directory like /webserver, I should be able to copy everything to a new machine and start it up. I know I need the listeners listening on all ip addresses and the jdk being used would need to be in that directory as well. Is there anything I am missing here or that I need to watch out for?

  • How to view the datas from one schema  to another

    Hi,
    I am working in Oracle9i and solaris 5.8.
    I create a new schema but no datas.
    i need to read the datas from another schema having datas through the newly created schema.
    pls explain me with query

    OK use following procedure to grant select access on all tables of another schema.
    CREATE OR REPLACE PROCEDURE GRANT_SELECT AS
    CURSOR ut_cur IS
    SELECT table_name
    FROM user_tables;
    RetVal NUMBER;
    sCursor INT;
    sqlstr VARCHAR2(250);
    BEGIN
    FOR ut_rec IN user_tabs_cur;
    LOOP
    sqlstr := 'GRANT SELECT ON '|| ut_rec.table_name
    || ' TO jwc7675';
    sCursor := dbms_sql.open_cursor;
    dbms_sql.parse(sCursor,sqlstr, dbms_sql.native);
    RetVal := dbms_sql.execute(sCursor);
    dbms_sql.close_cursor(sCursor);
    END LOOP;
    END grant_select;
    Regards,
    Sandy

  • Inserting data from one table into another table using PL/SQL

    HI,
    I am trying to insert values from one table into another using PL procedure, the values I want to retrieve from the table riverside1 are charac_id and charac_type and insert these values into another table called riverside2 , the stored procedure zorgs_gorfs(x,y) accepts two parameters which are 2 charac_id's of d characters in riverside1 then using insert statements inserts these characters from riverside1 into riverside2.
    CREATE OR REPLACE PROCEDURE zorgs_gorfs(x IN NUMBER, y IN NUMBER) AS
         BEGIN
              INSERT INTO riverside2
                   (charac_id)
              VALUES
                   (x);
    INSERT INTO riverside2
                   (charac_id)
              VALUES
                   (y);
          END zorgs_gorfs;
    /This works but the problem im having is that when I also try to insert the charac_type as well as the charac_id it doesnt work below is the code:
    CREATE OR REPLACE PROCEDURE zorgs_gorfs(x IN NUMBER, y IN NUMBER) AS
         BEGIN
              INSERT INTO riverside2
                   (charac_id,charac_tye)
              VALUES
                   (Select
                        charac_id,
                        charc_type
                   FROM
                        riverside1
                   WHERE
                        charac_id = x);
          END zorgs_gorfs;
    /can someone kindly sort me out

    modify this sql
    INSERT INTO riverside2
                   (charac_id,charac_tye)
              VALUES
                   (Select
                        charac_id,
                        charc_type
                   FROM
                        riverside1
                   WHERE
                        charac_id = x);as
    INSERT INTO riverside2
                   (charac_id,charac_tye)
              VALUES
                   (Select
                        charac_id,
                        charc_type
                   FROM
                        riverside1
                   WHERE
                        charac_id in ( x,y));But my suggestion would be consider revising your approach. It does not look that good.
    Thanks,
    karthick.

  • What's the best way to move a project from one HD to another?

    I have a movie I've been working on for 2 years.  The entire project is on an external hard drive.  I recently got a new macbook pro and would like to take the project off of the external hard drive and move it to my macbook pro hard drive (my external is starting to act a little goofy and I want to rescue my project until I can get a new one). 
    There is tons of media for my project.  I've read that using media manager is an option.  I tried this but am having difficulty locating all of the media to reconnect once I do, but all the media should be in the same place, so I can't figure out why I can't find a lot of it to reconnect. 
    Anyone have any ideas or suggestions?  None of the media is offline when I open the project from my external HD.  If you know a better method than media manager, please share.  I've never had to execute this kind of proceedure before so it's new to me.  Thank you.

         The files will be eating up all your disc space and affecting performance. Setting the Scratch disc only comes into affect if you are capturing files from video sources via video cards or firewire/thunderbolt connections. The scratch disc records the video as data. The scratch disk needs to be robust enough to capture at a high data rate to capture uncompressed video in HighDef or Standard Def. This usually requires a RAID drive. If you never capture uncompressed video via a video card (AJA Kona/Blackmagic/Avid Mojo), you can set your root drive as the scratch disc. The problem there is it will hog up disc space. That is why most editors use an external drive to be the scratch disc.

  • What is the best way to transfer 1200 songs from one SGIII to another SGIII?

    I have over 1200 songs on my Samsung Galaxy III and want to transfer them all in one block to my husband's SG III.  I have Backup Assistant Plus with most of the music uploaded there.  I asked at our local Verizon store but no one there knew how to use this phone!  Can anyone help me?

    hustonsmom wrote:
    the commercial is deceiving to me. i am not the most techy person and i thought that you could share full song playlist which to me meant the songs also. that is all, it wasnt anything you had said but i am really thankful you enlightened me because i would still be racking my brain trying to figure out how to do it.
    You can share songs, but if there is DRM protection on the song, it will not play on the other device unless you also transfer the rights to the other device. You are getting into the problem of music piracy.

Maybe you are looking for

  • "This computer is not authorized to play" any DRM items from iTunes Store

    My iTunes 9.0.3 Library has DRM songs (purchased years ago up thru the end of iTunes DRM) plus TV shows (purchased from 2006 thru two days ago). I just discovered none of these restricted songs or TV shows can be played because ... *This computer is

  • IPad in China

    Hi there! Is there anyone on the forum using iPad in China? I am thinking of buying one (I live in Beijing), but I am afraid that it may be of no use if I cannot read books that I have already bought and downloaded on my MacBook... actually, this is

  • Deploying 10g 32bit forms on 64bit oracle application server

    Hi Can forms that are generated from forms developer on a 10g 32bit environment be deployed on a 64bit oracle application server? Anthony.

  • Really frustrated with bridge cc freezing continuously

    I have been through the forums and have done everything from uninstalling and reinstalling, purging cache, reseting preferences, updating graphics software and so on but I cannot get bridge to work without it continuously freezing.  I had no problems

  • How do I transfer my iTunes stuff to my new mac?

    just bought a new pro this week , how do i put all of my itunes stuff so that when i plug our iphones into this computer we won't have to completely start from scratch with the iphones. is this even possible?