Benefit of using BizTalk instead of SSIS/ETL

Hello!
I would like to know which tool is better to use, BizTalk ? or SSIS/ETL ?
What is the benefit of using BizTalk instead of SSIS/ETL ?

There is old blog of mine on this topic and following is extract from it. Also anothere thread in this BizTalk forum on this same topic shall also help you.
https://social.msdn.microsoft.com/Forums/en-US/a53f5d8c-d619-4ff6-ae54-2533bf7ad054/is-this-project-a-good-candidate-for-biztalk?forum=biztalkgeneral
https://social.msdn.microsoft.com/Forums/en-US/0abc5f59-cffa-4316-a5d3-7774c46b61d5/best-way-to-trigger-dtsx-package-from-biztalk?forum=biztalkgeneral
Extract from my old blog ....
BizTalk and SSIS are different tools and fit different scenarios.
SSIS is designed to move and manipulate very large amount of data over extremely high performance batch processing where BizTalk has been designed to move, process, validate, transform, and route low rate of
transactions consisting of tiny amounts of business data
Use SSIS for:
Large ETL processes like de-batching the large CSV file into SQL database, or cleansing the large record before inserting in to database.
Batch Oriented Scenarios i.e. when the files need to be processed in specific time of the day as opposed to file needs to be processed as and when the files are available.
Use BizTalk:
When you have to do the Business Process Management (BPM). i.e. some business processes.
Near real-time scenarios i.e. as and when the files are available and it has to be processed.
SSIS and BizTalk can work together:
Though SSIS and BizTalk are used in different place depends on the scenario, it’s important to note that we can use SSIS with BizTalk. They can work together. For Example we have a project that would receive
a batch of data once a day - containing 1000s of records. SSIS would receive the data, and then scrub the data (or validate the format). Once the data was acceptable, BizTalk would pick up each record and do the business processing.
BizTalk can do SQL-BULK insert but..
For bulk data processing we can use “SQL Bulk Load adapter ” available from
http://www.biztalkgurus.com/blogs/biztalksyn/archive/2005/10/23/Processing-a-Large-Flat-File-Message-with-BizTalk-and-the-SqlBulkInsert-Adapter.aspx
which can efficiently insert a large amount of data into SQL you are still stuck with the issues of transmitting the MessageBox database and the memory issues of dealing with really large messages.
http://indway-is.blogspot.co.uk/2010/09/which-to-use-biztalk-or-sql-integration.html
Regards,
M.R.Ashwin Prabhu
If this answers your question please mark it accordingly. If this post is helpful, please vote as helpful by clicking the upward arrow mark next to my reply.

Similar Messages

  • How can I use UC4 instead of SSIS Master Package deployed using project deployment model?

    Hi Folks,
    My team is planning to opt UC4 for scheduling the SQL Jobs and I have to come up with a plan to integrate it. 
    As of now, I do not have software licence in place to do some research. 
    If you have worked on it, can you tell me that how can I schedule SSIS packages using UC4. 
    Also, we are using SSIS project parameters (Project deployment Model). What kind of changes I have to make in SSIS packages to support UC4. Is it possible to pass parameters to SSIS package through UC4? If not, is there any alternativ?
    Appreciate your help!
    Gaurav Gupta

    If you have access to Automic Community, there are details there on how to execute SSIS 2012 packages deployed in SSISDB catalog (project deployment model). Here is the link:
    https://community.automic.com/discussion/4878/how-to-execute-sql-server-data-tools-ssdt-2012-package-synchronously-using-sql-job
    Leonard

  • What's the benefit of using Essbase?

    What's the benefit of using Essbase instead of the OLAP option built in Oracle? Performance reason?
    But Essbase is so huge and we just use a bit of its functionalities...

    I hope you're comparing Essbase & Oracle OLAP.
    Go through the Vlamis' presentation in 2008 at: http://www.vlamis.com/Papers/collab2008-presentation2.pdf
    Both were compared under various heads like- Logical Structure, Data Storage, Dimensional Model, Loading Data, Aggregation, Allocation, Calculations, Scalability, Writeback Handling, Security, Administration, Access to Data etc.,

  • Using SQL Server 2012 SSIS to Extract Data From SAP

    Hi
    What is the current best practice for using SQL Server 2012 SSIS to extract data from SAP R3? Please note we are looking for a solution that does not use SAP BW or SAP OHS.
    Ideally we would like to build our ETL SSIS process to make a .NET call to an SAP RFC procedure and avoid using web services.
    With SS2012 can we use any of these without using SAP BW:
    - SAP .NET Connector
    - MS ADO .NET
    - BizTalk .NET 3.0 Adapter
    Thanks and take care,
    Shayne

    Hi Shayne,
    You can use the .NET Framework Data Provider for mySAP Business Suite along with SQL Server Integration Service (SSIS) to import data from an SAP system into SQL Server database tables, flat files, or other compatible destination types. You can create an SSIS
    package that can be executed to import data from an SAP system.
    You must use the SQL Server Import and Export wizard to import data into the SQL Server database. You must provide a select query to specify data to be imported. The query must confirm to the semantics supported by the Data Provider for SAP. You can start the
    SQL Server Import Export Wizard either from the SQL Server Management Studio or from an Integration Service project in Visual Studio. Detail steps please see:
    Importing SAP Data Using SQL Server Management Studio:
    http://msdn.microsoft.com/en-us/library/cc185161(v=bts.10).aspx
    Importing SAP Data Using Visual Studio:
    http://msdn.microsoft.com/en-us/library/cc185254(v=bts.10).aspx
    Please feel free to ask if you have any question.
    Thanks,
    Eileen
    Please remember to mark the replies as answers if they help and unmark them if they provide no help. This can be beneficial to other community members reading the thread.

  • Can any one suggest me how can I use relative path inside SSIS pacakge to access config file ?

    Can any one suggest me how can I use relative path inside SSIS pacakge to access config file ? Please help me as its urgent.THanks for your help in advance.

    Hi Jay,
    SSIS can only recognize the absolute path of a XML Configuration file, the relative path is not supported. Furthermore, if the XML Configuration file is already generated, we can use the Environment variable package configuration type instead so that
    SSIS runtime automatically looks for the configuration file from the path defined in the environment variable. This is convenient when we need to deploy a package to different environment. We only need to define the environment variable for package configurations
    once on each server, and then the variable can be used by all the packages on this server.
    Regards,
    Mike Yin
    TechNet Community Support

  • What is the benefit of Using Data Adaptor

    Hello
    I wonder that What is the benefit of Using Data Adaptor ? I don't know TopLink Technology , inorder to using Data Adaptor I should know toplink but what is the advatages of using BPEL database adaptors in conditions thet I can make webservices by making plsql web services or exposing ADF application modules more easier?
    I think that if I use Data Adaptor (based of Toplink) I can use JTA feature for transaction managment , am I thinking Correct?
    for example I can invoke to webservice A and the B in BPEL process with two DB adaptores (by global transaction ) such that if A failes the process automatically roles back the B transaction without need that I manauly compensate the undo process
    please help me ?

    Thank you for your very useful comments about DB adapter
    I tried again and I have Successfully deploy and test my DB adapter with using # for parameter.
    But I have another question : We have ADF Application that using ADF bc for user data entry supporting in use case scenario , but we want to call web services (eg BPEL) in save operation instead of ADF application modules Normal commit !
    If we want using Data adapter for persist the Data that user entered by UI , we must write a lot of Insert or Update statements in DB adapter because of lot of database entities.
    How can we shorten this production scenario in our Project?

  • Best Way to port the data from one DB to another DB using Biztalk

    Hi,
    please suggest best way to move the data from one db to another DB using biztalk.
    Currently I am doing like that, for each transaction(getting from different source tables) through receive port, and do some mapping (some custom logic for data mapping), then insert to target normalized tables(multiple tables) and back to update the status
    of transaction in source table in sourceDB. It is processing one by one.
    How/best we we can do it using  bulk transfer and update the status. Since it has more than 10000 transaction per call.
    Thanks,
    Vinoth

    Hi Vinoth,
    For SQL Bulk inserts you can always use SQL Bulk Load
    adapter.
    http://www.biztalkgurus.com/biztalk_server/biztalk_blogs/b/biztalksyn/archive/2005/10/23/processing-a-large-flat-file-message-with-biztalk-and-the-sqlbulkinsert-adapter.aspx
    However, even though a SQL Bulk Load adapter can efficiently insert a large amount of data into SQL you are still stuck with the issues of transmitting the
    MessageBox database and the memory issues of dealing with really large messages.
    I would personally suggest you to use SSIS, as you have mentioned that records have to be processed in specific time of day as opposed to when the
    records are available.
    Please refer to this link to get more information about SSIS: http://msdn.microsoft.com/en-us/library/ms141026.aspx
    If you have any more questions related to SSIS, please ask it in
    SSIS 
    forum and you will get specific support.
    Rachit

  • Using biztalk as ESB

    Hi,
    I want to publish a PL/SQL package as a webservice. Due to architectural requirements I'm not allowed to use the Oracle ESB. Instead I have to use BizTalk. Is this at all possible? What do I need to do in order to deploy my service through BizTalk? Is a WSDL enough or do I need more?
    I'm scanning the internet for days now, but it seems like I'm the first one who wants to do this. ;-)
    Hope someone knows an answer.
    Thanks in advance,
    Bart

    The only problem you have is to expose the PL/SQL package as as Web Service. One option is to create Orchestration or ESB project. This proces then can be exposed as a Web Service through the WSDL. But this implies that this Web Service only can run when this SOA implementation is actually running on you infrastructure. And that is not the case as you stated (you have only BizTalk.) What you can do is install a lightweight (j2ee) web server and deploy s simple java servlet that invoke PL/SQL through some kind of interface. This can be a JDBC-connection or you can simply create a DB Adapter in your java application. That can be done not only in BPL or ESB projects but also in simple J2EE project. To do this, create New object in your project and select Business Tier, Web Services, DB Adapter. As a side effect you have to deploy the DB Adapter in you J2EE server.
    Good luck, Jos.

  • Exception access violation using jlong instead of jint

    Hi,
    I hope you can help me.
    I'm using Java5 under Windows XP and I'm developing under Eclipse.
    I try to use an "old" c-Application accesed via JNI.
    Status Quo is that, I have access to the c-side, over my JNI-conform DLL. My current task is to translate the c-side structs to java-objects. This also works, but only with limitation.
    Calling methods bidirectional is working, manipulation a java-object is like a walk on an warm and sunny Saturday afternoon.
    But I'm not able to use all possible parameters (for now I have tried to use jobject, jstring, jint, jboolean, jlong).
    The first problem I had, were using Strings as parameters, but this now I deal with the loopway over java/lang/object (using java/lang/String results in an access_violation).
    The next problem, and the harder one, is, that I cannot use the type long or jlong.
    int (jint) is no problem, with int all works fine, but if I change the environment, creating and using long, I allways get an the access_violation shown below.
    Is there anything, I need to know?
    working c-side-code:
    jobject someObject;
    jint anIntegerValue;
    anIntegerValue =5;               
    jmethodID mid3 = (*env)->GetMethodID(env, cl, "initReturnSomeObject", "(ILjava/lang/Object;)Ljava/lang/Object;");
                   if(mid3 == (jmethodID)0) printf("\ndooofes MethodName4!\n");
                             else {
                                  const char* myParams;
                                  myParams = "ooooohwow!!!";
                                  someObject = (*env)->CallObjectMethod(env, jobj, mid3,
                                             anIntegerValue, (*env)->NewStringUTF(env, myParams));
                             }wokring java-side-code
    public Object initReturnSomeObject(int i, Object obj) {
              String s = (String)obj;
              System.out.println("String: "+s+"\nInteger: "+i);
              some = new SomeObject(s,i);
              if(some==null) System.out.println("Some is not yet initialized, FEAR!!!!\n");
              else System.out.println("Yoh, I'm soooo many good!! \nSome:\nString: "+some.getS1()+"\nInt: "+some.getI1()+"\n");
              return (Object)some;
    so, und this code, doesn't work. you can see, the changes are dramatically!! ;)
    sorry for my sarcasm. I do not know, why it doesn't work.
    jlong aLongValue;
    aLongValue = 2;
    jmethodID mid3 = (*env)->GetMethodID(env, cl, "initReturnSomeObject", "(JLjava/lang/Object;)Ljava/lang/Object;");
                   if(mid3 == (jmethodID)0) printf("\ndooofes MethodName4!\n");
                             else {
                                  const char* myParams;
                                     myParams = "ooooohwow!!!";
                                  someObject = (*env)->CallObjectMethod(env, jobj, mid3,
                                            aLongValue, (*env)->NewStringUTF(env, myParams));
         public Object initReturnSomeObject(long i, Object obj) {
              String s = (String)obj;
              System.out.println("String: "+s+"\nInteger: "+i+"\nLong: ");
              some = new SomeObject(s,(int)i);
              if(some==null) System.out.println("Some is not yet initialized, FEAR!!!!\n");
              else System.out.println("Yoh, I'm soooo many good!! \nSome:\nString: "+some.getS1()+"\nInt: "+some.getI1()+"\n");
              return (Object)some;
    # An unexpected error has been detected by Java Runtime Environment:
    #  EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d942975, pid=1784, tid=1648
    # Java VM: Java HotSpot(TM) Client VM (1.6.0_03-b05 mixed mode, sharing)
    # Problematic frame:
    # V  [jvm.dll+0x182975]
    # An error report file with more information is saved as hs_err_pid1784.log
    # If you would like to submit a bug report, please visit:
    #   http://java.sun.com/webapps/bugreport/crash.jsp
    #do you need some other informations or details? something out of the log-file? ok, i have to take the bus, so sorry for uncomplete informations or sentences ;)
    till later.

    Hi,
    I'm quite sure, the signature is correct. For failure check, yesterday I ran javap to check the signature, but I do also mean, that I changed the signature afterwards for several time. And, it works ;) at least the way, using Integer.
    Trying to use java/lang/String everytime I got the Error, that the method could not be found - this is the part, I was wrong in my description. So the error-Message is a different one.
    Belonging to the question for assumptions I made... it's difficult. I'm quite new to JNI, so, I don't know, what I can assume to do. The Method call seems to be a kind of reflection-mechanism. So I assume that the behaviour is similar. But reflection I'm not very firm, either ^^.
    What I do assume is, that the parameter-value J fits to the java-type jlong. But a work around on this, I will try today. getting the jlong into an char* or using long instead of jlong or using Ljava/lang/Long; or a casted Long as Ljava/lang/Object; ...
    I'm anxious to the ideas, I will have, bypassing this point. if there is no way, I will write a file, send a email or something like this ;)
    Thx for thinking about my problem jschel!! It's great not to be alone.
    John

  • I just found my old ipod touch (i think 1st generation) and would like to let my toddler use it instead of my phone.  I am trying to download apps but it say I need to update to 4.3 but it won't let me update.  I have the most recent itunes. any idea why?

    I just found my old ipod touch (i think 1st generation) and would like to let my toddler use it instead of my phone.  I am trying to download apps but it say I need to update to 4.3 but it won't let me update.  I have the most recent itunes. any idea why? I saw a thread saying to purchase the newest software (that was posted a few years ago) I paid 4.95 for the software and it's still saying it can't be updated.  Am I just SOL??

    The 1G iPod can only go as high as 3.1.3. The 1G does not have an internal speaker or volume buttons on the upper left edge.
    Identifying iPod models
    To more easily find compatible apps:
    iOSSearch - search the iTunes store for compatible apps.
    Apple Club - filter apps by iOS version.

  • How to modify a lookup field-type to use checkbox instead of radiobutton?

    How to modify a lookup field-type to use checkbox instead of radiobutton?
    I would like to modify the behavior for the lookup field.
    Normally you get a screen where it is possible to search through a lookup. The items resulted from the search are listed as radiobutton items. Therefore you can select only one at the time to be added.
    Is it possible to have the items to be listed as checkbox instead? So that you can check multiple items and therefore be able to add multiple items at the time?
    For example:
    To add the user to 10 different groups on MS-AD.
    It is desired to have the ability to check multiple groups to be added instead only one at the time.
    My client would like to use this feature in many other situations.

    Displaying will not be a big deal but with that you have to customize the action class and its working as well.

  • Invalid security certificate for my website host-they say the problem is Apple Safari and use Firefox instead

    For the past few days, I keep getting an invalid security certificate in Safari whenever I select Edit My Site from my website homepage (http://annaporterartist.com), or whenever I select anything requiring a secure log in from my website host main page (FASO.com). I have contacted technical support at my website host (fineartstudioonline.com) and they say that this has been an intermittently recurring problem in Safari for years and they recommend that I use Firefox instead. As proof of this they emailed a link to an Apple Support discussion, but it was for Mac OS X Lion v 10.7.4 and Safari 5.1, even though I told them I am using Mac OS X Mountain Lion v 10.8.2 and Safari 6.0.2. I do not get this error message anywhere else on the web using Safari. I did try Firefox and it seems to work fine, but I prefer Safari and I want to know why Safari is not working as it should be. I am concerned that there is a real security problem with my website host and I need someone to explain why I am getting this error message, what it means, and if it is, in fact, a known problem with Safari or is my website host corrupted? Really tired of technical support playing pass the buck or pretending the problem does not exist.
    The specific error message is:
    Their response to my inquiry and my reply is shown below:

    Back up all data.
    Launch the Keychain Access application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Keychain Access in the icon grid.
    From the menu bar, select
    Keychain Access ▹ Preferences ▹ Certificates
    There are three menus in the window. What is selected in each of them?

  • I would like to read a text file in which the decimal numbers are using dots instead of commas. Is there a way of converting this in labVIEW, or how can I get the program to enterpret the figures in the correct way?

    The program doest enterpret my figures from the text file in the correct way since the numbers contain dots instead of commas. Is there a way to fix this in labVIEW, or do I have to change the files before reading them in the program? Thanks beforehend!

    You must go in the labview option menu, you can select 'use the local
    separator' in the front side submenu (LV6i).
    If you use the "From Exponential/Fract/Eng" vi, you are able to select this
    opton (with a boolean) without changing the labview parameters.
    (sorry for my english)
    Lange Jerome
    FRANCE
    "Nina" a ecrit dans le message news:
    [email protected]..
    > I would like to read a text file in which the decimal numbers are
    > using dots instead of commas. Is there a way of converting this in
    > labVIEW, or how can I get the program to enterpret the figures in the
    > correct way?
    >
    > The program doest enterpret my figures from the text file in the
    > correct way since the numbers contain dots instea
    d of commas. Is there
    > a way to fix this in labVIEW, or do I have to change the files before
    > reading them in the program? Thanks beforehend!

  • Using open instead of file open causes Acrobat X11 to barf and stop working

    I get a Critical Error when I use Open instead of File Open.
    Faulting Application Path: C:\Program Files (x86)\Adobe\Acrobat 11.0\Acrobat\Acrobat.exe
    Problem Event Name: APPCRASH
    Application Name: Acrobat.exe
    Application Version: 11.0.9.29
    Application Timestamp: 5412b52e
    Fault Module Name: StackHash_9cd1
    Fault Module Version: 0.0.0.0
    Fault Module Timestamp: 00000000
    Exception Code: c00001a5
    Exception Offset: PCH_9A_FROM_ntdll+0x0003AAAC
    OS Version: 6.3.9600.2.0.0.256.48
    Locale ID: 1033
    Additional Information 1: 9cd1
    Additional Information 2: 9cd11aece74acb27712497bb36a41cb9
    Additional Information 3: 907e
    Additional Information 4: 907e2580c2bb8a6c100db3c807719959
    Bucket ID: 14715054b1814cb4d80f9c990e44ea23 (73554368215)

    You can use the DocOpen event.

  • Firefox can't read any Bookmark that was imported from my PC with file extension .url. Safari reads them fine. Is there a fix, so I can use Firefox instead of Safari? Many thanks if so. I have the latest version of Firefox

    Firefox can't read any Bookmark on my Mac that was imported from my PC with file extension .url. Safari reads them all fine. Is there a fix, so I can use Firefox instead of Safari? Many thanks if so. I have the latest version of Firefox
    == URL of affected sites ==
    http://anysite.url
    == User Agent ==
    Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_5_8; en-us) AppleWebKit/531.22.7 (KHTML, like Gecko) Version/4.0.5 Safari/531.22.7

    Hello JF.
    I don't think that extension is supported. I believe Firefox can only read .json and .html.
    You may want to read this though:
    [http://support.mozilla.com/en-US/kb/Importing+bookmarks+and other data from Safari Importing bookmarks and other data from Safari]

Maybe you are looking for

  • Submit data from internal table to standered program RPTBPC10.

    Dear Friends, How to Pass parameter of personnel number to standard SAP program RPTBPC10 from a Customize  report . After program execution return the program control to Y program and capture the data from pa2001for infotype 2001 and infotype 2006. a

  • Using xerox documate 510 scanner with mac mini

    No drivers available on web for mac. I have searched in discussion board and seen posts for Vuescan. I have downloaded this software, but my mac mini doesn't recognize my scanner. Any help would be great. Thank you

  • Family guy season 6 completely destroyed itunes

    I purchased family guy season 6 at 11/24/2007 and was not able to play any of the episodes, for 2 of the episodes, amount of time for the episode did not display and whenever I tried to play them itunes would stop working immediately, and the compute

  • Very Disappointed with Lenovo Products & Support

    After spending times during the holidays researching the new laptop, I found out that T400 would be really powerful and slick and I was excited placing an order and could not wait to receive it.  Today, I received the product.  It was delivered coupl

  • Roaming between 1231A and 1142N

    Gday Everyone, Just would like to know your experience in roaming between LWAPP converted 1231A and 1142N APs?