Efficient way to collect datasources connected to Infosources

Hai i need to <b>collect all the datasources</b> for a list of <b>info sources</b>. Is there any easy way to collect them ? Is there any efficient way to collect them from any tables or metadata? iam not looking for collecting them manually.
I appreciate any help on this and would like to give as many points as possible.

Hi,
you can get such a list from table rsisosmap.
kind regards
Siggi

Similar Messages

Most efficient way to get a connection from a defined connection -pool [whole message]

Having recently load-tested the application we are developing I noticed that
one of the most expensive (time-wise) calls was my fetch of a db-connection
from the defined db-pool. At present I fetch my connections using :
private Connection getConnection() throws SQLException {
try {
Context jndiCntx = new InitialContext();
DataSource ds =
(DataSource)
jndiCntx.lookup("java:comp/env/jdbc/txDatasource");
return ds.getConnection();
} catch (NamingException ne) {
myLog.error(this.makeSQLInsertable("getConnection - could not
find connection"));
throw new EJBException(ne);
In other parts of the code, not developed by the same team, I've seen the
same task accomplished by :
private Connection getConnection() throws SQLException {
return DriverManager.getConnection("jdbc:weblogic:jts:FTPool");
From the performance-measurements I made the latter seems to be much more
efficient (time-wise). To give you some metrics:
The first version took a total of 75724ms for a total of 7224 calls which
gives ~ 11ms/call
The second version took a total of 8127ms for 11662 calls which gives
~0,7ms/call
I'm no JDBC guru som i'm probably missing something vital here. One
suspicion I have is that the second call first find the jdbc-pool and after
that makes the very same (DataSource)
jndiCntx.lookup("java:comp/env/jdbc/txDatasource") in order to fetch the
actual connection anyway. If that is true then my comparison is plain wrong
since one call is part of the second. If not, then the second version sure
seems a lot faster.
Apart from the obvious performance-differences in the two above approaches,
is there any other difference one should be aware of (transaction-context
for instance) between the two ? Basically I'm working in an EJB-environment
on weblogic 7.0 and looking for the most efficient way to get hold of a
db-connection in code. Comments anyone ?
//Linus Nikander - [email protected]

Linus Nikander wrote:
Thank you for both your replies. As per your suggestions I've improved my
connectionhandling (I ended up implementing the Service Locator pattern as a
matter of fact).
One thing still puzzles me though. Which (and why) is the "proper" way to
fetch the actual dataSource. As I stated before in the code I've seen two
approaches within the code I've got.
1. myDs = myServiceLocator.getDataSource("jdbc:weblogic:jts:FTPool");
2. myDs = myServiceLocator.getDataSource("java:comp/env/jdbc/tgsDB");
where getDataSource does a dataSource = (DataSource)
initialContext.lookup(dataSourceName); dataSourceName being the input-string
obviously.
tgsDB is defined as
<reference-descriptor>
<resource-description>
<res-ref-name>jdbc/tgsDB</res-ref-name>
<jndi-name>tgs-dataSource</jndi-name>
</resource-description>
</reference-descriptor>
in weblogic-ejb-jar.xml
From what I can understand by your answer, you don't recommend using the
JNDI-lookup way of getting the connection at all ?Correct.
The service locator that
I implemented will still perform a JNDI lookup, but only once. Will the fact
that I'm talking to an RMI-object anyway significantly impact performance
(when compared to you non-jndi-method) ?In some cases, for earlier 7.0s, maybe yes. For the very latest, it shouldn't
hurt.
>
>
In my two examples above. If i use version 1. How will the server know
whether to give me a TX-bound connection and when not to ? In version 1
FTPool maps to a pool with both TX and non-TX datasources. In version 2.
tgsDB maps directly to a TX-dataSource.
I might be asking a lot of strange questions, probably because I'm just
getting the hang of all the resource-reference issues that EJBs are
associated with.Bear with me ;)
//Linus
"Joseph Weinstein" <[email protected]> wrote in message
news:[email protected]...
Hi. As Jon said, the lookups are redundant. Because you showed that otherway,
I will infer that this code is always being run in serverside code. Good.I will give you
a third way which is much better than either of the ones you showed. Thefirst method
you showed has a problem for all but the latest sps, your jdbc objectswill all be
going through an unnecessary level of indirection because you are gettingan rmi jdbc
object which talks to the jts driver object.
The second, faster method you showed also has a serious problem! Oneshould
never call DriverManager methods in multithreaded JDBC programs becauseall
DriverManager calls are class-synchronized, including some small internalones like
DriverManager.println(), which all JDBC drivers and even the constructorfor
SQLException call, so one slow getConnection() call can inadvertantly haltall other
JDBC being done in the whole JVM! Also, for JVMs that have lots of jdbcdrivers
registered, DriverManager is inefficient because it simply sends your URLand
properties to every driver it has registered until it finds one thatdoesn't throw an
exception and returns a connection.
Here's the fastest way:
// do once and reuse driver object everywhere. Can be used by multiplethreads
Driver d =(Driver)Class.forName("weblogic.jdbc.jts.Driver").newInstance();
Then, whenever you want a connection:
public myJDBCMethod()
Connection c = null; // always a method level object
try {
c = d.connect("jdbc:weblogic:jts:FTPool", null);
... do all the jdbc for the method...
c.close();
c = null;
catch (Exception e) {
... do whatever, if needed...
finally {
// close connection regardless of failure or exit path
if (c != null) try {c.close();}catch (Exception ignore){}
Joe
Linus Nikander wrote:
Having recently load-tested the application we are developing I noticed
that
one of the most expensive (time-wise) calls was my fetch of adb-connection
from the defined db-pool. At present I fetch my connections using :
private Connection getConnection() throws SQLException {
try {
Context jndiCntx = new InitialContext();
DataSource ds =
(DataSource)
jndiCntx.lookup("java:comp/env/jdbc/txDatasource");
return ds.getConnection();
} catch (NamingException ne) {
myLog.error(this.makeSQLInsertable("getConnection - couldnot
find connection"));
throw new EJBException(ne);
In other parts of the code, not developed by the same team, I've seenthe
same task accomplished by :
private Connection getConnection() throws SQLException {
return DriverManager.getConnection("jdbc:weblogic:jts:FTPool");
From the performance-measurements I made the latter seems to be muchmore
efficient (time-wise). To give you some metrics:
The first version took a total of 75724ms for a total of 7224 callswhich
gives ~ 11ms/call
The second version took a total of 8127ms for 11662 calls which gives
~0,7ms/call
I'm no JDBC guru som i'm probably missing something vital here. One
suspicion I have is that the second call first find the jdbc-pool andafter
that makes the very same (DataSource)
jndiCntx.lookup("java:comp/env/jdbc/txDatasource") in order to fetch the
actual connection anyway. If that is true then my comparison is plainwrong
since one call is part of the second. If not, then the second versionsure
seems a lot faster.
Apart from the obvious performance-differences in the two aboveapproaches,
is there any other difference one should be aware of(transaction-context
for instance) between the two ? Basically I'm working in anEJB-environment
on weblogic 7.0 and looking for the most efficient way to get hold of a
db-connection in code. Comments anyone ?
//Linus Nikander - [email protected]

What's the best way to collect internal table?

Hi,
I have an internal table, the fields are:
Key1, key2, key3, qty1, qty2, qty3
I want to collect the field "qty3" based on the key fields: "key1 + key2 + key3".
What's the most efficient way to collect the internal table?
Thanks.

Hi Ren,
You can code something like this with COLLECT statement.
DATA: BEGIN OF ITAB OCCURS 0,
        KEY1 TYPE TABLE1-FIELD1,
        KEY2 TYPE TABLE1-FIELD2,
        KEY3 TYPE TABLE1-FIELD3,
        QTY1 TYPE TABLE2-QTY1,
        QTY2 TYPE TABLE2-QTY2,
        QTY3 TYPE TABLE2-QTY3.
DATA: END OF ITAB.
DATA: BEGIN OF ITAB2 OCCURS 0,
        KEY1 TYPE TABLE1-FIELD1,
        KEY2 TYPE TABLE1-FIELD2,
        KEY3 TYPE TABLE1-FIELD3,
        QTY3 TYPE TABLE2-QTY3.
DATA: END OF ITAB2.
SORT ITAB.
LOOP AT ITAB.
MOVE-CORRESPONDING ITAB TO ITAB2.
COLLECT ITAB2.
ENDLOOP.
LOOP AT ITAB2.
WRITE: /01 ITAB2-KEY1, ITAB2-KEY2, ITAB2-KEY3,
             ITAB3-QTY3.
ENDLOOP.
Hope this will help and give an idea.
Regards,
Ferry Lianto
Please reward points if helpful.

Infosource and datasource connection

Hi Experts,
In the BI 3.5 business content, what is the best way to decide which datasource connects to which infosource? For example if i were to install BI content for SD i have about 8 datasources and 20 infosources and 6 cubes only.
How can i setup a dataflow based on Bi content only?
Should i make a decision based on the fields i am interested in? Please educate me on this.
Thanks
K

Hi Krishna,
Go to RSA1--->, right mouse show data flow you can double click the elements.
On the Source systems you can see the relation between DS and IS.
Also try table RSOLTPSOURCE - field OLTPSOURCE for datasource,field BASOSOURCE for infosource.using 'show data flow' as mentioned, click 'technical name on/off' to have the technical name displayed.
hope this helps.
Regards
CSM Reddy

DataMarts, Generated Export DataSources, Connecting DS to Infosources

I try to build a Data Mart Architecture and thereby an ODS with their Export DataSource gets connected with a InfoSource of an reporting cube. After generating the export DataSource, I replicated it. After this I tried to connect the InfoSource with the DataSource, but the system didnt display any custom generated DataSources (starting with 8*****) when I pressed the button select DS in InfoSource.
I checked the DataSource with RSA6 and it exist on BW myself system. I also tried insert lost nodes in Infosource and display generated objects in RSA1.
Has someone an idea what other problem it could be?
Thanks for your answer.
Cheers

hello heiko,
There is a setting that enables you to view generated objects. Go to RSA1->Settings Menu->Display generated objects->Show generated objects.

Efficient Way of Inserting records into multiple tables

Hello everyone,
Im creating an employee application using struts framework. One of the functions of the application is to create new employees. This will involve using one web form. Upon submitting this form, a record will be inserted into two separate tables. Im using a JavaBean (Not given here) between the JSP page and the Java file (Which is partly given below). Now this Java file does work (i.e. it does insert a record into two seperate tables).
My question is, is there a more efficient way of doing the insert into multiple tables (in terms of performance) rather than the way I've done it as shown below? Please note, I am using database pooling and MySQL db. I thought about Batch processing but was having problems writing the code for it below.
Any help would be appreciated.
Assad
package com.erp.ems.db;
import com.erp.ems.entity.Employee;
import java.sql.Connection;
import java.sql.PreparedStatement;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.util.Collection;
import java.util.ArrayList;
public class EmployeeDAO {
     private Connection con;
     public EmployeeDAO(Connection con) {
          this.con = con;
     // METHOD FOR CREATING (INSERTING) A NEW EMPLOYEE
     public void create(Employee employee) throws CreateException {
          PreparedStatement psemployee = null;
          PreparedStatement psscheduleresource = null;
          String sqlemployee = "INSERT INTO employee (FIRSTNAME,SURNAME,GENDER) VALUES (?,?,?)";
          String sqlscheduleresource = "INSERT INTO scheduleresource (ITBCRATE,SKILLS) VALUES (?,?)";
          try {
               if (con.isClosed()) {
                    throw new IllegalStateException("error.unexpected");
                        // Insert into employee table
               psemployee = con.prepareStatement(sqlemployee);
               psemployee.setString(1,employee.getFirstName());
               psemployee.setString(2,employee.getSurname());
               psemployee.setString(3,employee.getGender());
                        // Insert into scheduleresource table
               psscheduleresource = con.prepareStatement(sqlscheduleresource);
               psscheduleresource.setDouble(1,employee.getItbcRate());
               psscheduleresource.setString(2,employee.getSkills());
               if (psemployee.executeUpdate() != 1 && psscheduleresource.executeUpdate() != 1) {
                    throw new CreateException("error.create.employee");
          } catch (SQLException e) {
               e.printStackTrace();
               throw new RuntimeException("error.unexpected");
          } finally {
               try {
                    if (psemployee != null && psscheduleresource != null)
                         psemployee.close();
                         psscheduleresource.close();
               } catch (SQLException e) {
                    e.printStackTrace();
                    throw new RuntimeException("error.unexpected");
     }

Hi ,
U can use
set Auto Commit function here ..
let it be false first
and when u do with u r all queries ..
make it true
this function take boolean values
i e helful when u want record to be inserted in all or not at all..
Hope it helps

Which is the best way to create a connection object

hi,
Eventhough i am not new to java I just wanted to know that which is the best way for creating sql connection object.
Is it using the DriverManager.getConnection(..,..,..) or using a datasource and getting the connection.
Which is more efficient or Is there any other way to create sql connection which is even more better.
thanks in advance.
pradeepbhargav

AFAIK all connections, DataSource ones included are created by calling the DriverManager. A DataSource is a factory for Connection objects (from JavaDocs)
If you're talking about managing connections then it depends on the application. A DataSource is great for apps that can support many clients or are multi-threaded, but may require a JNDI implementation to get to it.
If however you have an single threaded app that hits the database in a serial fashion, then DataSource is probably an overkill.
Dave

Loosing datasource connection in a server thread

Hi,
In a backing bean I start a long term thread that uses the datasource connection taken from application module.
Everything works fine but after a period of time between one and two hours the connection is lost and server throws a
<BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "AEE2010DS" failed with exception: "java.sql.SQLException: Connection Closed".>
Is there any way to stop the server from closing the connection that is used in a separate thread, programmatically or using configuration?
Any comment will be helpful,
Thanks

That looks like something external is killing the connection, either the DBMS or a firewall.

What is the best, most efficient way to read a .xls File and create a pipe-delimited .csv File?

What is the best and most efficient way to read a .xls File and create a pipe-delimited .csv File?
Thanks in advance for your review and am hopeful for a reply.
ITBobbyP85

You should have no trouble doing this in SSIS. Simply add a data flow with connection managers to an existing .xls file (excel connection manager) and a new .csv file (flat file). Add a source to the xls and destination to the csv, and set the destination
csv parameter "delay validation" to true. Use an expression to define the name of the new .csv file.
In the flat file connection manager, set the column delimiter to the pipe character.

Most efficient way to make an ordered list?

Hi all,
I have a simulation where I have agents running around in an environment. These agents need to get the closest agent near them, and they have to do this a whole bunch of times each cycle -- closest predator to them, closest prey, closest mate, next-closest mate if that one isn't interested, etc. etc.
I realized that it would be faster if I just got all the agents in the vicinity ONCE, kept them in a sorted list, and then everytime you want the closest agent of a certain type, just search from the bottom of the list up until you find the first one of that type.
So here's the question: to make that list, I ask the environment for all the agents in the vicinity, and then go through them one-by-one. I find out the distance between myself and that agent. I then.... what?
I could put them all into an ArrayList, and then apply some sorting algorithm to that ArrayList. Or I can try to insert them in the right order WHILE I'm making the ArrayList. Or maybe there's some better Collection object that would be even more efficient -- somehow pushing them in and out of stacks, or whatever else smart programmers think up.
Can anyone suggest the most efficient way to do this? This is something that every agent has to do every step, so efficiency is key.
Thanks!
Edit: As a note, calculating the distance between two agents isn't free, and if I either sort or insert as I'm making it, the naive implementation (i.e. the way I would do it...) would require re-checking this distance for every agent in the list every single time a new agent was added. So maybe I could make some use of a HashMap, so that I can store these distances?
Edited by: TimQuinn on Oct 15, 2009 9:35 AM

TimQuinn wrote:
Ok, thanks for all the great suggestions. I think that caching the distance in a wrapper object is a big plus, and then I can run some tests and see if using a built-in collections sorting algorithm or using a treeset is faster in my specific case. Thanks!
Any thoughts as to the idea of creating one giant map of the distance from each agent to every other agent just once, rather than having each agent work out their own distances to each other agent? I feel like this would be faster (at the expense of memory), but don't know how I'd start approaching it.Well, your idea of the Map would probably work. You would have to make some object that pairs up two agents, something like this:
public class AgentPair {
   private final Agent a1, a2;
   public AgentPair(Agent a1, Agent a2) { //...
   public boolean equals(Object other) {
      //if distance is a symmetric operation (a.distanceTo(b) == b.distanceTo(a)) then the reverse pair should also be equal
   public int hashCode() {
      return 37*a1.hashCode() + a2.hashCode();
}This assumes either that you don't override equals or hashCode in Agent, or that you properly override both.
Then you would have a map that you can populate, given an array of all agents:
Map<AgentPair, Double> distMap;
Agent[] agents;
for ( int i = 0; i < agents.length-1; i++ ) {
   for ( int j = i; j < agents.length; j++ ) {
      distMap.put(new AgentPair(agents, agents[j]), agents[i].distanceTo(agents[j]));
}Alternatively, if you're not sure you'll definitely use all of the computations, you could alternatively test to see if the computation result is in the map, and if not, perform it; otherwise, use the cached result.
Any thoughts? Should I make a new post? Abandon the idea?As always, try it and see. Essentially, it will be faster assuming these two conditions:
1) You would have to do more than n ^2^ (well actually n choose 2) distance calculations otherwise, and
2) Computing the distance costs more than retrieving from distMap (this +isn't+ a given!). If each Agent had a sequential ID, you could do a two-dimensional array of doubles which would speed up lookups.
Edited by: endasil on 15-Oct-2009 3:39 PM

Most efficient way to consume log files

Hello everyone,
I've been absent from the forums for awhile but I'm back at it now...
I have a question about the most efficient way to consume log files. I read in Powershell in action, by Bruce Payette that using a switch statement with a regex worked pretty well, that being said I haven't tried it yet. Select-string is working pretty
well for me but I have about 10 different entry types that I need to search logs for every 5 minutes and I'm scanning about 15 GB of logs at every interval. Anyway, if anyone has information about how to do something like that as quickly as possible
I'd appreciate it.
1. piping log files that meet my criteria to select-string
- This seems to work well but I don't like searching the same files over and over again
2. running logs through get-content and then building a filter statement
- This is ok but it seems to use up a fair bit of memory
3. Some other approach that I haven't thought of yet.
Anyway, I know this is a relatively nebulous question, sorry about that. I'm hoping that someone on here knows a really good way to find strings in logs files quickly.
Hope that helps! Jason

You can sometimes squeeze out more speed at the expense of memory usage, but filters are pretty fast. I don't see a benefit to holding the whole file in memory, in this case.
As I mentioned earlier, though, C# code will usually blow PowerShell away in terms of execution time. Here's a rewrite of what I just did (just for the INI Section pattern, to keep the post size down):
$string = @'
#Comment Line
[Ini-Style Section Line]
Key = Value Line
192.168.0.1 localhost
Some line that doesn't match anything.
Set-Content -Path .\test.txt -Value $string
Add-Type -TypeDefinition @'
using System;
using System.Text.RegularExpressions;
using System.Collections;
using System.IO;
public interface ILineParser
object ParseLine(string line);
public class IniSection
public string Section;
public class IniSectionParser : ILineParser
public object ParseLine(string line)
object o = null;
Match match = Regex.Match(line, @"^\s*\[([^\]]+)\]\s*$");
if (match.Success)
o = new IniSection() { Section = match.Groups[1].Value };
return o;
public class LogParser
public static IEnumerable ParseFile(string fileName, ILineParser[] lineParsers)
using (StreamReader sr = File.OpenText(fileName))
string line;
while ((line = sr.ReadLine()) != null)
foreach (ILineParser parser in lineParsers)
object result = parser.ParseLine(line);
if (result != null)
yield return result;
$parsers = @(
New-Object IniSectionParser
$results = [LogParser]::ParseFile("$pwd\test.txt", $parsers)
$results
Instead of defining separate classes for each type of line and output object, you could probably do something more generic with delegates (similar to how I used ScriptBlock.Invoke() in the PowerShell example), but it might sacrifice some speed to do so.

Collecting Datasources in Transport request in R/3

Hi Experts,
Can anyone give information of how to collect Datasources in Transport request in R/3 Development system.I want
to move datasource from Development to Quality system in R/3 side

Hi,
Go to RSA6 R/3, Select your datasource. Click on the Transport button. Then this asks Transport request, then you can collect.
Or Select your datasource and click on change. In this way also, you can collect into TR
Hope this helps,
Regards,
Rama Murthy.

Iterators - most efficient way to get last object?

Collection of objects, such as from an EJB, and I want to only get the last object. What is the most efficient way of doing this?
TIA!

addendum to previous post.
Allthough, that test would call to mind the question what are you going to do if it is 0? Throw an exception, as the code stands it will throw an index out of bounds exception to the calling process which could be handled there, and in truth probably should be.
Modified and expanded example
public class ListThingie{
     java.util.ArrayList listOfThingies = null
     public ListThingie(){
          super() ;
          listOfThingies = new java.util.ArrayList() ;
          buildListOfThingies() ;
     public void buildListOfThingies(){
          //... build the ArrayList here
     public Object getLastThingie() throws IndexOutOfBoundsException{
          return listOfThingies.get((listOfThingies.size()-1)) ;
public class ThingieProcessor{
     public static void main( String[] args){
          try{
               ListThingie listThingie = new ListThingie() ;
               System.out.println(listThingie.getLastThingie()) ;
          catch(IndexOutOfBoundsException e){
               System.out.println(e.getMessage()) ;
}There, that's better.

SSRS 2005 change datasource / Connection String

Hi All
I need to change the some shared data source on ssrs 2005 for the migration of some dbs.
Can I do it on tsql, I need to update the datasource / Connection String only for the reports that uses it.
How to change it on table : [ReportServer].[dbo].[DataSource] table. ?
Thanks a lot in advance.

It is not recommended to update records directly in Catalog table.
You can try
programmatic way to update that.
SSRS is webservice so you have to use something like below.
https://<<Report Server Name>>/ReportServer/ReportService2005.asmx
Make sure you do BACKUP database before doing any changes.
Regards,
Vishal Patel
Blog: http://vspatel.co.uk
Site: http://lehrity.com

The efficient way to repair broken EPM report

Hi experts,
I'm looking for the efficient way to repair broken EPM report.
In following cases, the relevant EPM reports are broken and I can't push "Edit report" (gray out) and lose connection to model...
i) In removing dimension from a model (ex. rename dimension ID, add & delete it)
ii) in removing member which is located on page axis of EPM report.
To avoid the situation, I make a point of taking following measures:
i) - clean up the dimension that I want to delete from axis of EPM report before remove it from relevant model
ii) - clean up the member from EPM report before removing it.
However these measures terribly bothered me if number of relevant EPM reports is too large... If these reports can connect to model or be able to "Edit report", the work will be more efficient.
Do you mind if you tell me a good idea?
Regards,
Masa

Hi Vadim,
Here's the example in appearing issue ii).
No i) is my misconception, sorry...
in opening the broken EPM report:
This dialog appears if the member that has already removed is located in pase axis. Unfortunately, this broken report isn't able to execute "Edit Report".
My question is how I can repair the report by something to do. Please help me...
Best regards,
Masa

Efficient way to collect datasources connected to Infosources

Similar Messages

Maybe you are looking for