How to load from multiple sources to multiple destination dynamically

I have more than hundred tables in a different server (lets say on a sql server 1). I have to perform load,by getting change records copy of those hundred tables with the some condition in to sql server 2 destination. I know how to perform data
flow task in SSIS to extract data from a source and load it in a destination. With more than hundred tables, I would need to create more than hundred data flow tasks which is very time consuming. So I have heard about from source to destination dynamically
by looping through and creating variables. Now, how do I do this? Remeber, those hundred tables do having similar column names in both soruce and destination server. How can I perform this initial load faster without using multiple data flow task in SSIS.
Please, help! Thank you!

Ok , if the schema of both the source and destination is same , you can just perform an import and export tool and then it can be saved as an SSIS package. If this needs to be separately developed in an SSIS package, the logic can be :
1 - Get the list of tables using sysobjects or metadata table where all the table list is maintained.
2 - Loop through those tables using for each loop.
3 - Inside the for each loop , use a script to access the source connection ( OLEDB source table name) and the destination connection (OLEDB destination table name).
4 - Assign the source table connectoin dynamically to the variable fecthed from for each loop above.
5 - You can also use expressions for the OLEDB source table name and OLEDB destination name inside the data flow task.
6 - At the end the data flow task which is explained above will be used.
Script task and the data flow task will be used inside the for each loop , above which all the objects list will be fetched using execute sql task using a SELECT and assigned to Object variable.
Simplest will be Import and Export.
Happy to help! Thanks. Regards and good Wishes, Deepak. http://deepaksqlmsbusinessintelligence.blogspot.com/

Similar Messages

How to select from multiple addresses of account in IC Web Client

Hi all,
We are implementing a B2C scenario for IC Web Client. We have customers with multiple addresses. However, when we search the acount, only standard address comes to screen. We want to be able select the related address, and then confirm the acount with that address.
Is there any way to customize the Web Client in order to be able to select from multiple addresses of the acount?
Thanks in advance.
Edited by: Danisman Danisman on Aug 31, 2010 2:52 PM

Thanks for the answer. Yes, we are using 7.0 but in the account identification screen, there is no personalize button ( I assume you are suggesting adding an addres block by using that button, right?).
We checked the necessary customizing : there is an entry for fucntional profile PERSONALIZATION : ALL_ENABLED.
Should we do something else to show the button?
Thanks again.

Cache/copy Bitmaps loaded from external source?

I'm working on a chat application that retreives user profile icons from remote sources (e.g. Blogger, Yahoo, Gravatar, etc). Easy to get the images in a Loader and display them.
The problem is that a single thread could have hundreds of records, but probably only 10-20 active commenters. In a standard browser, each <img...> link after the first one is cached, so you only hit the source site once. Is there any way to cache/store/copy those images within Flash to avoid requesting the same image over and over?
I can do it in the Local sandbox by accessing the BitmapData of the loader content and cloning a new bitmap for subsequent instances of the same request URL, but of course once the application moves to the Internet the security system requires a Policy file allowing bitmap access. I doubt that I can get Yahoo to add one for me. I don't need to manipulate the bitmap at all, just copy it. Or reference it as content from multiple Sprites, or something along that line. Once I've downloaded the image once, I don't see why the security system would prevent me from displaying it unchanged as many times on the page as needed.
If this can't be done in AS3, perhaps it would be a good feature to add in the next release? Remote image caching is pretty well accepted in other platforms.

I put trace on the image URLs, and they always showed HTTP Status = 200 - they were loading every time. In any case, I came up with an easy workaround. I out a php script on my hosting server that fetches the image, then use that as the URL for the loader object. Voila, no security violation because the php is in the same domain as the swf. Cut down load time by at least a factor of 5.
Only problem is, the loader always gets a 200 status on the php script, eve though I'm setting an Http header to send a 404 (the same URL from a browser gets the 404 response.) That generates an Unkown File Type error in my SWF so I have to trap that rather than the http status. It works, except I can't differentiate b/t a non-existant image and a server or connecion error. Or at least, I can't do it without a lot more code

Master data load from 2 source system

Hi all,
I am working on a project which has 2 source systems.
Now I have to load master data from 2 source systems without making 0LOGSYS as compunding
attribute. Because all the objects which i want to use compunding attribute are reference
objects for lot of other info objects. So, i dont want to change the business content
objects structure. Please guide me
Thanks

Hi,
I cube there is nothing to do with compounding attribute, it will be handled in MD IO level. As your requirement to separate the transaction happen in different source system then make add another info object as Zsource and make it as nav. attribute then design your report based on nav. attribute.
Note that this separation is only possible in Material Related transaction not for others.
Thanks
BVR

How to load from one BW System to another BW System

Hi Guys,
I want to load the BW data from PAX(BW-Production System) to PRX (BW-DCC-System) .Is there any steps to load it from One BW System to another BW System.
Any doc available to do the loading from One BW System to another BW System.
Pl mail to [email protected]
Send me the steps .
Points will be assigned.
Thanks,
Chinna

Hi Chinna,
Loading from one BW system 2 another primarily involves loading data from one infocube to another in other BW system.
U can create export data sources from infocubes ( rt. clk on infocube n then select ) and then use these datasources to load data into the infocubes of othar system in usual way.
Try this out.
Hope it helps,
Manish

How to load from a data model located in SharePointOnline/PowerBI?

PowerPivot has the option to load 'From Analysis Services Or PowerPivot'.
The Table Import Wizard usually expects the full path of the workbook (including the data model) in SharePoint.
However, 'http://myname.sharepoint.com/shared documents/myfile.xlsx' doesn't work.
How can I access my online data model from PowerPivot ?

SharePoint needs to have Power Pivot Enabled. Speak to your SharePoint Admin if you have any questions about that. Once enabled, you would be able to create a Power Pivot Gallery - where you can upload your Power Pivot Models. Once uploaded the easiest way
is to go to the Gallery and click on the "Excel" button next to the model. This would provide you a connection to the file on SharePoint.
See screenshot below OR watch this video for a demo: Power Pivot to SharePoint: Create thin reports connected to SharePoint Model
Related Blog Article: Power Pivot to SSAS Tabular in less than 30 minutes (speaks about separating Model from Reports using SSAS or SharePoint)
Regards, Avi
www.powerpivotpro.com
Wiki:How to ask a Power Pivot Question to get a prompt, accurate and helpful response

How to select from multiple output tables in the SAP Data Source

Hi,
We're using the SAP Data Source to display SAP data in our portal from the Bapi: BAPI_INFORECORD_GETLIST. When defining the Bapi Meta Data we can select data from one of the two output tables (INFORECORD_GENERAL and INFORECORD_PURCHORG). But we want to select data from both tables (some columns we want to show are in INFORECORD_GENERAL and some are in INFORECORD_PURCHORG) .
How can we do this ?
With regards,
Ramon van der Weiden

You can query multiple TimesTen databases, but your original question was about joining tables from two databases, which is not supported.
Using Cache Connect to Oracle to query an Oracle database is not distributed. It's still one single Oracle database you are querying. You cannot join a table in the TimesTen database with a table in the Oracle database, this is not allowed.
If you are willing to share your business requiremens, we can take a look and see what solution might work for you. Would you like to discuss this offline?
Susan

ODS data Load from multiple sources.... Help

Hello every one,
I have a situation:
I have a ODS where out of 150 fields 100 are coming from flat files, 30 from other ODSs and 20 are from Master Data Tables (some are attributes of Master Data InfoObjects).
I am thinking i can do the following. Please advise if this is fine or if there is any other way of doing it for better performance e.t.c
1 Load the Flat File Fields based on Flat File DataSource/InfoSource/UpdateRules.
2. Load the other ODS fields/data in the Start Routine of the above Update Rules ???
3. Load the Master Data objects through Master Data InfoSources
Please confirm if i can do this. Also is there any order that i have to maintain for the same..... and finally
When i declare the Masterdata Object (say 0MATERIAL) as one of my data object in the ODS and some the fields as the attributes of this 0MATERIAL, if some one is already loading data into the 0MATERIAL, should i load again or not, because i remember Master Data stores data in separate tables.. ... Please remove my confusion )
All useful answers will be given full points.
Thanks a lot ...

Hi:
1 Load the Flat File Fields based on Flat File DataSource/InfoSource/UpdateRules.
2. Load the other ODS fields/data in the Start Routine of the above Update Rules ???
3. Load the Master Data objects through Master Data InfoSources
THe third one is only possible if those InfoObjects are InfoProviders. This is becasue if the I-Objects are direct update, you cannot use those infosources for any other laods but InfoObjects.
Please confirm if i can do this. Also is there any order that i have to maintain for the same.....
Order is needed only if th ekey figures are Overwrite and Business Requests the order.
and finally
When i declare the Masterdata Object (say 0MATERIAL) as one of my data object in the ODS and some the fields as the attributes of this 0MATERIAL, if some one is already loading data into the 0MATERIAL, should i load again or not, because i remember Master Data stores data in separate tables.. ... Please remove my confusion )
Didn't understand this part clearly.
DO you have the Attributes of 0material in ODS and populating thme in ODS?
Ram C.

How to Read from multiple channels

Dear Sir
I am acquiring data using FP-RTD-122 using OPC Client software. I ahve made one socket for that and i am using command
CWDataSocket1.AccessMode = cwdsReadAutoUpdate
CWDataSocket1.URL = "opc://localhost/National Instruments.OPCFieldPoint/FP Res\FP-RTD-122 @1\Channel 0"
CWDataSocket1.Connect
v = CWDataSocket1.Data.Value
where v is a variant type.But this is 8-channel RTD so how can i read values from all channels using single socket connection Because at presnt i have to use 8 sockets for all eight channels.

At least as of FieldPoint 4.0 and earlier (I do not know about 4.0.1 or later), the OPC Server did not support multiple channel analog items. Thus to read all eight channels of a FP-RTD-122 module, you would need 8 separate socket connections. For discrete modules (boolean), the "All" tag, is treated as a single 8 or 16 bit number.
Regards,
Aaron

How to go from multiple chapters ONE timeline to the menu

Recently had to convert a VHS to a DVD, where the file given to me was 1 Mpeg of the entire VHS capture. Not only that, but there were many interstitial segments which they didn`t want shown on the dvd. Last but not least, the order of sections on the VHS was random, whereas the DVD menu was alphabetical.
No matter what I did to the timeline/segments/chapter markers/menu directions, you`d select an item from the menu, it would play the right item from the [start] chapter marker, but then would totally ignore the [end] chapter marker (and it`s [end action] on the timeline and menu), and carry on playing whatever was left on the timeline (including all the stuff I didn`t want to be seen by the viewer).
Yes, I know the best way is to have been given multiple clips, edited the way they wanted them... but we don`t always get what we want, so have to work with what we`re given.
BUT, it IS possible to have people see only the bits you want them to see (selected from the menu) and then send them back to the menu (highlighted on the next item in the menu), from the one timline:
- Import your mpeg as a timeline.
- Add all your chapter markers (one at the start of the section and one at the end). It`s a good idea to name them, so you know where to drag links to later.
- At the [start] chapter marker of a segment in the timeline, select the [end action] and point it to the menu. This is optional, as apparently it ignores this anyway, but I like to make doubly sure of things with Encore :)
- On the menu item for that segment, point the [link] to the [start] chapter marker on the timeline.
All pretty normal so far, but here`s the trick to get it to go where you want it to go, without playing the whole timeline after it`s supposed to have gone back to the menu.
- Still working from the menu, point the [override] for that segment, to the next item on the menu.
- select the imported movie timeline in the 'project' window, and then press the [Set.....] button in the properties window, and change the remote control button`s to 'Custom' and make sure next/previous chapter, and fast-forward/rewind are de-selected. If they`re left selected then no matter what you do, the viewer can ff or next chapter, and they`ll see all the things you don`t want them to see. Leave pause/play and Title/Menu selected.
Hope this is helpful to some of you....
Storm

>Well, it was ignoring the chapter end-actions
Absent overrides or user-induced navigational errors (like setting the end action for chapter 3 when you want the program to return to the menu after chapter 2 plays), I don't see how this is possible.
A chapter end action, properly set, will execute during timeline playback when the chapter
finishes playing. I know this sounds obvious and elementary, but it is a very easy concept to overlook. I am not assuming incompetence, just unfamiliarity. :)
>If you could direct me to some tutorials on how to use Chapter End Playlists and Chapter Playlists to do this I`d appreciate it. I went through the manual and tried it but it didn`t work for me, and could only find people saying 'do things with chapter playlists' without going into detail on how to do it, when I searched the forums
If you can squeeze $17 - $25 into your budget, my book (The Focal Easy Guide to Adobe Encore DVD 2.0) has step-by-step instructions and colorful illustrations on how to set up a Chapter Playlist and how to properly set up Chapter End Actions.
To show my objectivity (and not get booted out of the forum for self-advertising), Adobe has published one of their Classroom in a Book series that covers Encore 2.0. Either way, you should have a reference handy when using complex programs like the ones that are part of the Adobe Production Studio.
-Jeff

Loading from multiple flat files to same table using SQL Loader

Hi Gurus,
Can anyone please brief me the pros and cons of kicking of multiple sql loader sessions that reads multiple flat files but inserting it into just one table.
The table is not partitioned. Avg record counts for each flat file is about 5-6 million.
Oracle 11g,
OS: Linux
Regards
Cherrish Vaidiyan

Vaidiyan wrote:
Hi Gurus,
Can anyone please brief me the pros and cons of kicking of multiple sql loader sessions that reads multiple flat files but inserting it into just one table.Cherrish,
Pros -> Faster loading of more data
Cons -> Potential performance degradation
Test to see how much resource consuming this task would be and do a priority comparison of that multi-multi load task with other stuff that will be happening in the database in the multi-multi load time so you could decide how to share resources in that time.

JAX-WS: How to choose from multiple client certificates on the fly?

I have a webapp that is calling a web service supplied by a vendor. The vendor requires the use of client certificates for authentication, and I have successfully called their service using the PKCS#12 keystore they gave us with JAX-WS 2.2 using code like this:
 System.setProperty("javax.net.ssl.keyStore", "myKeyStore.p12"); 
 System.setProperty("javax.net.ssl.keyStoreType", "pkcs12"); 
 System.setProperty("javax.net.ssl.keyStorePassword", "password");The problem is, my webapp will be supporting multiple business units, and the vendor differentiates between our business units by issuing separate certificates for each. So I'm in a quandary: I have four PKCS#12 files, one per business unit, and my webapp will need to decide which one to use at runtime. Moreover, this webapp could be heavily used by many simultaneous users, and thus more than one of the certs may need to be used at the same time. Hence whatever the solution is, it will need to be thread safe.
I was able to combine all four certificates into a single JKS keystore using the JDK 1.6 "keytool -importkeystore" operation with each of my four PKCS#12 certs, so I now have all four in a single JKS keystore. The above code then becomes this:
 System.setProperty("javax.net.ssl.keyStore", "myKeyStore.jks"); 
 System.setProperty("javax.net.ssl.keyStoreType", "jks"); 
 System.setProperty("javax.net.ssl.keyStorePassword", "password");So my challenge now is to programatically select between the four possible certs when calling the vendor's web service. How do I do that with JAX-WS RI 2.2?
Thanks,
Bill

Just to close the loop on this (and for the next person trying to figure out how to do it), I was able to [extend X509KeyManager as described in Alexandre Saudate's blog|http://alesaudate.com/2010/08/09/how-to-dynamically-select-a-certificate-alias-when-invoking-web-services/] . I was then able to set the com.sun.xml.ws.developer.JAXWSProperties.SSL_SOCKET_FACTORY on my JAX-WS request context to use my custom SSLSocketFactory, and it works like a charm!
Thanks,
Bill

How to select from multiple tables which reside on different data stores ?

Suppose I have two data stores in one TimesTen instance:
1) Datastore A:
table1
2) Datastore B:
table2
I want to make a query like this:
select ... from table1, table2 where table1.colA = table2.colB
Can I ? If not, is there a workaround ?
BTW, because of business, we have to use two or more different datastores, so we can not put table1/table2 in the same datastore.
Thanks very much.

You can query multiple TimesTen databases, but your original question was about joining tables from two databases, which is not supported.
Using Cache Connect to Oracle to query an Oracle database is not distributed. It's still one single Oracle database you are querying. You cannot join a table in the TimesTen database with a table in the Oracle database, this is not allowed.
If you are willing to share your business requiremens, we can take a look and see what solution might work for you. Would you like to discuss this offline?
Susan

How to import from multiple Cards simultaneously

I would like to know how to ingest multiple cards simultaneously using lightroom. Thank you!

Here is a trick to do it: http://www.petapixel.com/2012/06/09/importing-multiple-memory-cards-into-lightroom-at-the- same-time/
Pretty cool and easy to do.

How to load the JSP Source Code from Browser

I have made a program using JSP ( one file ) and Java Beans ( 2 files ).
The processed in those JavaBeans files and for output to Browser using JSP File.
And I'm using JBuilder7 Software for building my applicaton.
I already tested my source through JBuilder ( Applet Viewer ) and my source is running well but I got problem when to load that JSP file through Browser ( IE 6 ) with URL.
Can anybody help me with this ?
Best Regards,
Yeppy S.

I have made a program using JSP ( one file ) and Java Beans ( 2 files ).
The processed in those JavaBeans files and for output to Browser using JSP File.
And I'm using JBuilder7 Software for building my applicaton.
I already tested my source through JBuilder ( Applet Viewer with TOMCAT Virtual Machine ) and my source is running well but I got problem when to load that JSP file through Browser ( IE 6 ) with URL.
I put my source at F:\Source\Kiosk9 and my JSP file at F:\Source\KiosK9\defaultroot.
And the JavaBeans Files at F:\Source\KiosK9\src\kiosk9.
And the name of the package is kiosk9.
My structure directory :
F:\Source\KiosK9
F:\Source\KiosK9\bak
F:\Source\KiosK9\classess
F:\Source\KiosK9\defaultroot
F:\Source\KiosK9\src
F:\Source\KiosK9\tomcat
This directory structure was made automatically by JBuilder7 ( F:\JBuilder7 ).
URL : http:\\localhost:8080\defaultroot\KiosK9Jsp.jsp
And the error is :
"Socket Error
Connection refused by Remote Host"
Can anybody help me with this ?
Best Regards,
Yeppy S.

How to load from multiple sources to multiple destination dynamically

Similar Messages

Maybe you are looking for