SSIS - Make a "dynamic" database connection tutorial (step-by-step) ?

I want to make one connection ONLY to loop over a list of servers. This connection should be able to connect to databases located on different servers ie different IP addresses. After connecting to a database, it should run some SQL code. The result set
of this code should be transferred to a central database. After that, it should do the same for another server.
Can someone give me a step by step tutorial to do this ? I want hand holding/spoon feeding tutorial because no tutorial on the net worked for me so far.
Tutorials i tried , but did not work -
http://www.rafael-salas.com/2010/01/ssis-loop-through-multiple-database.html
http://www.codeproject.com/Articles/14341/Using-the-Foreach-ADO-Enumerator-in-SSIS
and many others which i cannot even remember. NONE of them are step by step. I have also not found a SINGLE book which covers this. All books only loop through files, but not through remote databases.
I need your help.
Thanks

Please see if these help -
http://www.sanssql.com/2011/08/looping-through-sql-servers-using-ssis.html
https://www.simple-talk.com/sql/ssis/consolidating-sql-server-error-logs-from-multiple-instances-using-ssis/
http://sql-ution.com/dba-repository-create-the-server-list/
- Aalam | (Blog)
1st one not good. Many steps are missing. Cannot understand than one. Will try the others also.

Similar Messages

Dynamic database connection using JNDI

How to pass the userid and password in get the database connection in weblogic 8.1 app server?
The following method throws exception while getting the database connection from oracle.
DataSource.getConnection(String username,String password)
Please advise if I need to use any other weblogic's method to get the dynamic connection. Every user of this application uses their own useid and password to connect to the database.
Any help is appreciated.

ANITA BERDIN wrote:
Hi,
I upgraded from WL8.1sp2 to sp4 and basically had to redo everything.
But since my understanding is that all patches and fixes are already
incorporated in this version, so I did not apply any patches. Now my
application which was previously working is getting an error with my
stateless session bean that I have not had before. This is the error
I get: I wonder why I would get oracle.jdbc.driver.Accessor.isNull
error now. Am I missing something in my install? Thanks for any help.
at oracle.jdbc.driver.Accessor.isNull(I)ZAccessor.java:1682)
     at oracle.jdbc.driver.OracleStatement.wasNullValue()Z(OracleStatement.java:3026)
     at oracle.jdbc.driver.OracleResultSetImpl.wasNull()Z(OracleResultSetImpl.java:111)Hi. You should not have had to redo everything.... Yes, sp4 should contain
most all of the patches you may have been running for sp2, except for any
that you may have gotten fairly recently (found recently in sp2, but not
fixed in time for sp4)...
The exception above is an internal Oracle thin driver bug (it seems), so
the difference between sp2 and sp4 may have to do with the version of Oracle's
thin driver installed. If you want, you can try swapping out the sp4 version of
the thin driver, and trying the one from sp2, or the latest from oracle etc.
What is the full stacktrace of the exception? Is that it? No message?
Joe
     at weblogic.jdbc.wrapper.ResultSet_oracle_jdbc_driver_OracleResultSetImpl.wasNull()Z(Unknown Source)
     at com.merial.wwppsv1.client.ejb.UserDetailListBean.getItems()Ljava.util.List;(UserDetailListBean.java:222)
     at com.merial.wwppsv1.client.ejb.UserDetailListBean_i8as44_ELOImpl.getItems()Ljava.util.List;(UserDetailListBean_i8as44_ELOImpl.java:99)
     at com.merial.wwppsv1.client.action.SearchMenu.execute(Lorg.apache.struts.action.ActionMapping;Lorg.apache.struts.action.ActionForm;Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;)Lorg.apache.struts.action.ActionForward;(SearchMenu.java:76)
     at org.apache.struts.action.RequestProcessor.processActionPerform(Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;Lorg.apache.struts.action.Action;Lorg.apache.struts.action.ActionForm;Lorg.apache.struts.action.ActionMapping;)Lorg.apache.struts.action.ActionForward;(RequestProcessor.java:484)
     at org.apache.struts.action.RequestProcessor.process(Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;)V(RequestProcessor.java:274)
     at org.apache.struts.action.ActionServlet.process(Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;)V(ActionServlet.java:1482)
     at org.apache.struts.action.ActionServlet.doGet(Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;)V(ActionServlet.java:507)
     at javax.servlet.http.HttpServlet.service(Ljavax.servlet.http.HttpServletRequest;Ljavax.servlet.http.HttpServletResponse;)V(HttpServlet.java:740)
     at javax.servlet.http.HttpServlet.service(Ljavax.servlet.ServletRequest;Ljavax.servlet.ServletResponse;)V(HttpServlet.java:853)
     at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run()Ljava.lang.Object;(ServletStubImpl.java:1006)
     at weblogic.servlet.internal.ServletStubImpl.invokeServlet(Ljavax.servlet.ServletRequest;Ljavax.servlet..ServletResponse;Lweblogic.servlet.internal.FilterChainImpl;)V(ServletStubImpl.java:419)
     at weblogic.servlet.internal.ServletStubImpl.invokeServlet(Ljavax.servlet.ServletRequest;Ljavax.servlet.ServletResponse;)V(ServletStubImpl.java:315)
     at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run()Ljava.lang.Object;(WebAppServletContext.java:6718)
     at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Lweblogic.security.subject.AbstractSubject;Ljava.security.PrivilegedAction;)Ljava.lang.Object;(Optimized Method)
     at weblogic.security.service.SecurityManager.runAs(Lweblogic.security.acl.internal.AuthenticatedSubject;Lweblogic.security.acl.internal.AuthenticatedSubject;Ljava.security.PrivilegedAction;)Ljava.lang.Object;(Optimized Method)
     at weblogic.servlet.internal.WebAppServletContext.invokeServlet(Lweblogic.servlet.internal.ServletRequestImpl;Lweblogic.servlet.internal.ServletResponseImpl;)V(WebAppServletContext.java:3764)
     at weblogic.servlet.internal.ServletRequestImpl.execute(Lweblogic.kernel.ExecuteThread;)V(ServletRequestImpl.java:2644)
     at weblogic.kernel.ExecuteThread.execute(Lweblogic.kernel.ExecuteRequest;)V(Optimized Method)
     at weblogic.kernel.ExecuteThread.run()V(ExecuteThread.java:178)
     at java.lang.Thread.startThreadFromVM(Ljava.lang.Thread;)V(Unknown Source)

JPA using dynamic database connection

Hello everybody.
My current project requires JPA to use dynamic datasource connection. And I need to register the database connection implementation in JNDI. For the dynamic part, the idea is that if user A logs in, JPA should use A's id and pw to create a datasource connection. When user B logs in, JPA should use B's credentials to create a datasource connection instead. I poked around a bit in the forum and found out that DataNucleus supports Dynamic datasource for JPA.
But, could any one tell me if JPA supports dynamic datasource connection out of the box? If it does, could you point me to some samples.
Thanks!

Hello,
I am using an implementation of OpenJPA.
I can now overwrite the database user id/password defined in a data source with Persistence.createEntityManagerFactory(name, props). However, the props (java.util.Map) needs openjpa.ConnectionUserName and openjpa.ConnectionPassword key/value pairs.
My issue now is that the user authentication will be through LDAP, so I won't be able to know the password of any user ( therefore no value for openjpa.ConnectionPassword). I am wondering if there is any way that JPA can use LDAP for the data source authentication. I guess Datanucleus framework could probably do that, but is there any way other than using Datanucleus?
Thank you.

Creating dynamic database connection (SQL server 2008) from Adf application

Hello,
I am creating an ADF Fusion Application. I use Jdev. 11.1.2.3.0 , WebLogic 10.3 and MS SQL server 2008 database. My question is that how can I create a database connection configuration file, now I connect to the database through hard coding, there should be a way to do this with sql server I think.
my database name is : testDatabase
my database username is : testUser
my database password is : testPassword
Anybody can help me please.
Thanks,
Shahe

Hello Frank,
The database schema is the same for all the users, but the location of the database differs, for example: I have set the hostname of the database to localhost because the database is installed on the local pc, but to other clients the database is installed on a managed server so in the hostname I should put the server's ip address or name. So I need an external file where I can set these options.
Thanks,
Shahe

Dynamic database connections at Runtime dbAdapter

Hi
I need to connect to a database defined a runtime in a BPEL process using the dbadapter. All the configuration parameters for making the connection are provided at runtime (connectionURL, User, Password) and i need a way to configure them in the dbAdapter make the connection and execute some SQLStatements.
Until now we were testing with some bpelx Properties changing dynamically the name of the jndi (jca.jndi) that works fine, but we cant define a datasource for every database. We also tried with another set of properties for setting the connection at runtime (jca.mcf.ConnectionString, jca.mcf.Password,jca.mcf.UserName) unsuccessfully.
Do you know a way to define connections parameters at runtime in dbAdapter? Is that possible with SOA version 11.1.1.6 ?
If this is not possible what alternative do you suggest for making dynamic connections to a database.?
Regards
Sergio

You can try using the function query-database and formulate the 4th parameter which is JDBC connect string at runtime.
oraext:query-database()
Returns a node-set by executing the sql-query against the specified database. The second parameter rowset indicates if the rows should be enclosed in a element. The third parameter row indicates if each row should be enclosed in a element. The fourth parameter datasource is either a JDBC connect string (jdbc:oracle:thin:USER-NAME/PASSWORD@HOST:PORT:SID) or a JNDI name for the database. Only Oracle Thin Driver is supported if JDBC connect string is used. Usage: oraext:query-database(sqlquery as string, rowset as boolean, row as boolean, datasource as string). Example: oraext:query-database('select last_name from employee where id=1234',false(),false(),'jdbc:oracle:thin:scott/tiger@localhost:1521:ORCL'.
This does not require a database adapter .

Can I ? - XSQL dynamic database connection

[raised this a couple of days ago on the 9iJDeveloper forum - but that's vanished]
How do you write XSQL without knowledge of username and passwords.
The physical user will be supplying their DbUser and DbPassword in a
web login
page and these are to be used throughout the web application.
XSQL requires a connection alias. i.e. "demo"
<page xmlns:xsql="urn:oracle-xsql" connection="demo" >
<xsql:query max-rows="-1" null-indicator="no" row-element="USER"
rowset-element="" tag-case="upper">
select user from sys.dual
</xsql:query>
</page>
But I need to set the username and password for "demo" in runtime.
(Reason: Each database user has specific roles and limits on viewable
information)
Chris Wilson

Not with the default implementation of oracle.xml.xsql.XSQLConnectionManager and oracle.xml.xsql.XSQLConnectionManagerFactory, however I've worked with customers who have written a custom XSQL Connection Manager to handle connections in any way that's appropriate for your application. Some have used Oracle8i OCI8 JDBC's proxy connection feature, others have implemented a custom strategy.
The online documentation for XSQL (part of the doc for the XDK for Java on OTN that ships with the database documentation set) talks about the two interfaces above that your implementation must implement.

How to make a SQL database connection with a java code in netbeans?

can somebody helpthrough an example

raghu0007 wrote:
can somebody helpthrough an exampleNetbeans is just an IDE.
Anyway the JDBC tutorial may be found here http://java.sun.com/docs/books/tutorial/jdbc/index.html
If you have a specific question please ask it.

How to make common database connection using bean, etc.

anyone know how to make a coomon database connection because on my web pages each of them need to connect on the database for their specific objectives... please help
regards
blingbling
Edited by: BlingBling15 on Oct 22, 2007 1:16 PM

Making a 'common' connection and passing it around is a bad idea. And making a new connection on every page, as you seem to have already guessed, also involves an overhead that you can do without.
Like drvijayj2k2 has mentioned, you should use connection pooling.
Take a look at the Apache Commons DBCP [1] and it's examples [2].
[1] http://commons.apache.org/dbcp/
[2] http://wiki.apache.org/jakarta-commons/DBCP
People on the forum help others voluntarily, it's not their job.
Help them help you.
Learn how to ask questions first: http://faq.javaranch.com/java/HowToAskQuestionsOnJavaRanch
----------------------------------------------------------------

Dynamic databse connection for Elixir report

anyone pls me teach me how to create dynamic database connection...
thanks
ramkumar

anyone pls me teach me how to create dynamic database connection...
thanks
ramkumar

Set SSIS variable = database connection manager name

Is it possible to set a SSIS string to only the name of a database connection manager or even the connection string it uses ? I don't see an option for that in Evaluate as expression property of ssis variable.
This is what I mean -
SSIS Connection manager name = SQL_DBASE
SSIS String str_managerName = SSIS Connection manager name: Can you do this dynamically in SSIS ?

I'm guessing what they really want to do is evaluate some indicator (some input from a user or an infrastructure setting) and then dynamically connect to any one of 10 (arbitrary example) database servers based on what they get as input. They
don't care about the connection manager per se. What seems reasonable is the that the Connection Manager might take a server variable but if they wanted to do things like that they would have bought Datastage.
You might try attacking this problem at the Control Level and then connect to the database you want based on a variable you set. I'm seeing that a Sequence Container can branch on the contents of a variable.
Or if the dba is your friend you might get the dba to add all your servers as linked servers to a central connection machine and then you might be able to do this by putting the ssis variable in a "Sql Command from a Variable" variable.
It might look something like this:
Server is designated in ssis var @[User::Machine]
then executing from a variable
"select top 100 * from " + @[User::Machine] + ".mydb.dbo.mytable"
Be careful as hades about levels of indirection and what quotes you want at what level. Evaluate Expression in ssis helps with this. The syntax I show works only with an ms sql connection server to a remote ms sql server. This is what a
dynamic connection to a linked server connection to Oracle would look like:
"select * from
openquery("+ @[User::Machine] + ",'select * from oradb.oratable where rownum < 100')"
When ever a thousand of your best friends are helping you connect to your database (using tools like linked servers as opposed to direct connections) it's probably best to use with only small specific updates or queries, large queries or large
updates would probably take a long time and or might not finish. But try it before you give up. We are actually doing fairly large Oracle queries (5-10 million rows) through ms sql linked server.

Application cannot proceed. Internal error occured. Contact your administrator. Error msg: Unable to connect to the database. Please make sure the database information specified in admin/includes/config.php are correct.

After clicking in email link, I get the following message on Firefox page : " The application cannot proceed!
An internal error occured. Please contact your administrator and describe the steps you took before you encounter this error message.Error msg: Unable to connect to the database. Please make sure the database information specified in admin/includes/config.php are correct."
The email asked to install the latest Adobe Flashplayer version to have it working. I installed it, also updated my plug-ins and checked in safe mode that the extensions were not the problem. I also deleted the cookies an cache. Nothing seems to be working so far. I have the lastest version of Firefox 8.0.1 as well as Roboform 7. I noticed that the latest Firefox version has (x86) tagged to it. Does it refers to an 86 bits because my computer uses 32 or 64 bits only. I tried also different browsers and the message kept appearing. How do I resolve this problem?

Clear the cache and the cookies from sites that cause problems.
"Clear the Cache":
* Tools > Options > Advanced > Network > Offline Storage (Cache): "Clear Now"
"Remove Cookies" from sites causing problems:
* Tools > Options > Privacy > Cookies: "Show Cookies"

Make use of established database connection

From within an application in the Application Navigation, I have successfully established a connection to a database which is on another host machine. The steps are:
right-click on the name of the application > select New > Database Tier > Database Connection > Connection Name ....
After the connection is done, I am able to see the tables, etc. in the Connection Navigation, i.e., the connection was successful.
Under the same application, I created a web project and in the project I am writing a servlet. I figure I can make use of the established connection as described above, to create sql statement object? But I do not know how. For example, I named that connection SbConnection, and tried the statements:
Statment stmt = null;
stmt = SbConnection.createStatement();
But it does not work out. I am trying this because the classical way of
Class.forname(....).newInstance();
Connection conn = DriverManager.getConnection(......);
does not work no matter how I tried.
I am just starting in doing web application, servlet and JSP etc. and would appreciate a lot for any help.

Fantastic, dvohra! It works out! Thanks a lot for the know-how!
Next I am going to dig out something to read about JNDI and DataSource type of connection. But the part of editing the web.xml is magic and myth to me. Any suggested books or web sites for reading? (After know-how is know-why and know what I am doing.) Many thanks!

JSF - CREATING A DYNAMIC MENU - STEP BY STEP TUTORIAL

Hi,
Is there a step by step tutorial in Jdeveloper(10.1.3) that will help me with the creation of a Dynamic Menu. I have read the write up on "How to Create Dynamic Menus" and I understand that this tells you what is needed. What I am looking for is a Tutorial that will direct me to the different Palette/facets in Jdeveloper that will enable me to build a Dynamic menu.
Regards
Kes

HI!
Have you read the ADF Developer Guide yet? It has a chapter which explains how to work with menus. Also, you can take a look at SRDemo application (used in the book) and you will see how to implement a dynamic menu.
I'm working on a large application which relies on that menu model and it works fine. We just made some mods in order to pick menu items and their corresponding navigation links from the database.
You can find the book at http://www.oracle.com/technology/products/adf/learnadf.html#book
For the SRDemo source code, just fire "Check for updates" from inside JDeveloper.
Hope this helps.
Regards,
Gustavo

OBIEE 11g install fails on step 7 (database connect string)

I've currently spent 2 days trying to install OBIEE 11g on two machines (independently). This first is a Windows XP SP3 test PC running 4GB RAM, whilst the second is a Windows 2003 virtual server with 3GB RAM. The Database is Oracle 10g (10.2.0.4.0) on AIX 5.3.
The DBA has successfully run the RCU on the Database and the schemas needed for OBIEE have been created. The BIPLATFORM schema has also been granted DBA privileges.
Now I've tried to run both the simple and the Enterprise install for OBIEE 11g, but it always fails at the same step (step 7 of 13: Database details). I have selected the following:
Database Type: Oracle Database
Connect String: hostname:port:instance, where hostname is the full server path eg xxxxx.uk.com and instance name is FFADEV01
BIPLATFORM Schema Username: As per username defined in RCU
BIPLATFORM Schema Password: As per password entered in RCU
If i change the connection string to FFADEV01.WORLD i get a 08031 error, whereas I am normally getting an 08035 error. The annoying thing is that I can connect to the schema using RapidSQL and the usernames and passwords as created in the RCU.
Any help greatly appreciated. Thanks

How was he able to install the BIPlATFORM schema using RCU on AIX? I thought RCU was only on Linux and Window platforms? I am about to install OBIEE 11.1.1.5 on AIX with a Oracle 10g DB but from what I read I wont be able to create the needed OBIEE schemas for the install because I won't be able to use the RCU on AIX. Any help would be appreciated.
Thanks.
Ryan

Dynamic Parameter Prompting for Database Connection Password

Post Author: rsharp
CA Forum: Publishing
Hi
I've been finding recently that reports using dynamic parameters and published into Crystal Server prompt for the database connection password when the dynamic parameter is accessed. Thing is, this only started happening recently for new and already existing reports with dynamic parameters and I don't know why. In Crystal Reports the dynamic parameter can be accessed without a database connection prompt being displayed but not after publishing. (Maybe there's a problem with the Publishing Wizard?) Static parameters work just fine just as they always have, but I'm a bit mystified by the fact that dynamic parameters used to work (without prompting) but now they don't. Any advice or opinion would be much appreciated.

Post Author: amr_foci
CA Forum: Publishing
from the CMC you have to set the default connection or wat connection should this report use,
go to this report in CMC, click process tab, and check the connection

SSIS - Make a "dynamic" database connection tutorial (step-by-step) ?

Similar Messages

Maybe you are looking for