Multiple data flow and sql tasks in a container - are records available in other tasks before transaction commits?

If I have 3 data flow tasks A > B > C
Then a SQL task that executes a procedure.
Can the procedure refer to records that have been added in one of the previous data flow tasks?
All the tasks are in a container that will commit when its finished, but if its not finished yet, will the SQL task and the procedure be able to refer to any of the records that were loaded?

That depends on how you handle connections. Changes made in a transaction are visible to only the connection that made the changes until the transaction commits or rolls back.
David
David http://blogs.msdn.com/b/dbrowne/

Similar Messages

Sub data flow (Optimized SQL) execution order ?

I am looking for a solution in Designer of Data Services XI 3.2.
Is there a way to specifiy in a Data Flow
(without using 'Transaction control' options and Embedded Data Flow )
the order in which Sub data flows ( Optimized SQL ) are executed ?
Thank you in advance.
Georg

First, if you are using MDX to calculate the value of C - dont. MDX script logic can be extremely inefficient from a processing and memory utilization standpoint vs. SQL logic even if the syntax is shorter.
Logic executes in the order you place the code in the script. You have three commit blocks and they would execute in that order. I notice you don't have a commit after the calculation for C. You should always put a commit statement after each calculation section or you can get uncommitted data even though there is an implied commit after the last line of code executes. Don't get in the habit of relying on this.
You can see the logic logs from the temp folders on the file server as suggested above but they will mainly give you the SQL queries generated which can be helpful in debugging scoping issues but they can be hard to sift through.
I recommend trying putting a commit statement after your calculation of C and that will probably resolve the issue. I also strongly suggest you switch the calculation to SQL logic to avoid performance issues when you start having these calculations run under high concurrency or on larger volumes of data than what you're probably testing with.

Documentation of data flow and processes in BW

Hi,
Is anyone aware of the possibility to document data flow and job-flows from BW (source systems, datasources etc all the way to queries) and export it from BW.
I am looking for a SAP certified tool like ie. Erwin that can collect this documentation from BW. I have not been able to find out if Erwin supports BW.
My hope is that - now that these things are done in BW - I can extract/export this documentation and use it in our general documentation environment.
The alternative is to manually document it.
Regards,
Mick
Denmark

Hi Mick,
I don't think that there is a tool like the one you are talking about...
however, if you select your infoprovider and then right-click->display data flow...in this way, you can obtain a picture of your data flow from the datasource to your provider with all the interdependencies !
Hope it helps !
Bye,
Roberto

I just bought a Mac Book Pro and the Appstore show one upgrade of iPhoto (9.2.1). I started a section with my Apple ID (the account that I have I use to iTunes) but when I try to update it says that there are upgrades available for other accounts and that

I just bought a Mac Book Pro and the Appstore show one upgrade of iPhoto (9.2.1). I started a section with my Apple ID (the account that I have I use to iTunes) but when I try to update it says that there are upgrades available for other accounts and that I have to upgrade using the account that I used to buy iPhoto. What do I have to do to upgrade iPhoto?

Dear Katty,
Thank you very much for your answer! I have 2 Apple ID, and I have tried both of them and the problem continues. I founf several peolpe with the same problem in apple communities foruns and that really seems that there is some problem. I addded the links for 2 of those discussions.
https://discussions.apple.com/thread/3374419?start=0&tstart=0
https://discussions.apple.com/message/16628399#16628399
Do you have an idea of how can I solve this problem?
Thank you very much again.
Best regards,
Alfonso

Have an iPhone 5. Phone does not ring when calls come in and texts sent from non-iPhones are delayed by 4-5 hours before receiving.

Have an iPhone 5. Phone does not ring when calls come in and texts sent from non-iPhones are delayed by 4-5 hours before receiving.

This morning I woke up thinking that I should turn off my iPhone and then call it from a land line. If the problem is the network then there would be a delay before I heard ringing.
I turned my iPhone off and called it. Right away I heard my message.
I turned my iPhone back on and called it. It rang right away!
So, did Virgin Mobile fix the problem or did turning my iPhone off fix the problem?
I don't know, but I'll take either. I do know that Virgin Mobile said it would be four days to check the problem. Did the problem get fixed yesterday when the four business days were up. I do know that I've had my iPhone on for a long, long time. Did upgrading to 6.1.1 or 6.1.2 cause the problem and turning my iPhone off reset my iPhone?
If you have delayed ringing problem and turning your iPhone off and on again resolved it, please post a note here.
P.S. I did call Virgin Mobile and its records show the investigation is still open. I hope my points get passed on to the investigators.
P.P.S. Reading my notes, I had turned my iPhone off and on last week. Maybe it's all the phase of the moon.

Same parameter multiple times in Execute SQL Task

Hi all,
i have a fairly long parametrized query that needs to be run within an Execute SQL task. It has only 2 unique parameters, but these need to be used multiple within that query. The connection is OLEDB.
ill simplify my requirement by making up an arbitrary T-SQL "where" clause that will illustrate what i need:
where
x = @param1
and y = @param1
and z > @param2
and w > @param2
moving this into an SSIS execute SQL task will require the following:
where
x = ?
and y = ?
and z > ?
and w > ?
I know i need to specify 4 parameters and remap the same variables multiple times.. like so:
User:aram1   -> 0
User:aram1   -> 1
User:aram2 -> 2
User:aram2 -> 3
isnt there a better way? i ask this because in my real task i have 2 params, each is reused 4 and 5 times respectively and it seems stupid to repeat params like this.

@ _proffy_
you can pass the same variable or value as parameter multiple times sql task.
follow the steps below.
1) type the sql query with parameters in SQL statement tab of sql task editor
2. in the parameter mapping, select the variables.
you can select the same variables more than once.
give the parameter name as 0,1,2,3..... based on variables you require.
do not forget to chooose the appropriate Datatype.
ex:
select * from table1
where a= ?
and b=?
and c= ?
parameters:
Var name               param Name
user::Var1               0
user::Var1               1
user::Var2               2
so the value becomes a=var1, b= var1 and c= var2

Multiple Convert/Dump and Load tasks in a single SSIS package?

I'd appreciate some input. We have a single data file that has about 1,000,000 rows of data spanning 28 time periods in the columns across each row. The file is too large to import at one time, and so we have created 9 different transformation files to pull subsets of the timeperiods using MVAL. The end user does not want to have to break apart the file and/or schedule 9 separate imports to bring this file in each time. So, I've attempted to create a single SSIS package that runs each of the 9 required component imports, but I'm running into the following error any time that I try to run more than one import at once:
An error occurred while running a packageException of type 'System.OutOfMemoryException' was thrown.
I've tried using a ForEach loop to simply loop through each of the transformation files and run an import for each transformation file it finds. But, I understand that SSIS doesn't release memory until the end of the ForEach loop, which would explain an out of memory issue. I then broke it out and specified 9 distinct Convert task and 9 distinct Dump and Load tasks in the package with an order of Convert 1 --> Dump and Load 1 --> Convert 2 --> Dump and Load 2, etc. This results in the same out of memory issue any time I enable it to run more than 1 convert/dump & load task in the package - they are not running simultaneously, but rather sequentially. I don't understand this. In looking at the logs, it looks like it's creating the temp files for the first import and adding them into BPC, and then creating the temp files for the second import but then fails prior to the second load. This will work for a smaller data file, but shouldn't the memory be released after the task and allow subsequent tasks to complete? Any recommendations on how to address this and automate this load?

Quick update - I created unique ssis packages for the distinct imports and called those packages from within the initial package that is kicked off through Data Manager, and I ran into the same out of memory issue. Any ideas, suggestions, or help would be greatly appreciated.
Thanks!
Josh

ADF mobile Data sync and sql lite usage

Hi,
We are working on ADF mobile POC.(Jdev version 11.1.2.3.0)
Following Oracle mobile developer guide we generated "Webservice data control" which creates process(object) method to work with Webservice. We created the data-controls and used them in our Java code and are able to get the Webservice response also.
However we want to implement the offline mode feature and for this we are not able to get any document reference for implementation.
With offline mode support is it the application's responsibility to store the data locally using SQL Lite and do the data sync (using Web Service) OR will the framework would do the data sync automatically. Can someone please provide the implementation hint on how to do the Offline mode support in the mobile application using ADF.
Thanks
Pavan

Hi,
With offline mode support is it the application's responsibility to store the data locally using SQL Lite and do the data sync (using Web Service) OR will the framework would do the data sync automatically.
This is all you. In this version of ADF Mobile there is no automatic data synchronization between local data and the server side. The sample that come with the ADF Mobile extension have a SQLLIte example as well, which is in the HR application. Look for the "DBConnectionFactory" file
package application;
import java.sql.Connection;
import java.sql.SQLException;
import oracle.adfmf.framework.api.AdfmfJavaUtilities;
public class DBConnectionFactory {
    public DBConnectionFactory() {
        super();
    protected static Connection conn = null;
    public static Connection getConnection() throws Exception {
        if (conn == null) {
            try {
                // create a database connection
                String Dir = AdfmfJavaUtilities.getDirectoryPathRoot(AdfmfJavaUtilities.ApplicationDirectory);
                String connStr = "jdbc:sqlite:" + Dir + "/HR.db";
                conn = new SQLite.JDBCDataSource(connStr).getConnection();
            } catch (SQLException e) {
                // if the error message is "out of memory",
                // it probably means no database file is found
                System.err.println(e.getMessage());
        return conn;
}The LifeCycleListenerImpl class in the same demo shows how to use this SQL Lite connection
package application;
import java.io.BufferedReader;
import java.io.InputStream;
import java.io.InputStreamReader;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.sql.Statement;
import java.util.ArrayList;
import java.util.List;
import javax.el.ValueExpression;
import oracle.adfmf.application.LifeCycleListener;
import oracle.adfmf.framework.api.AdfmfJavaUtilities;
public class LifeCycleListenerImpl implements LifeCycleListener {
    public LifeCycleListenerImpl() {
     * The start method will be called at the start of the application. Only the
     * Application Lifecycle Event listener will be called on start up.
    public void start() {
        System.out.println("!!!!!!!!!!!!!! App Start !!!!!!!!!!!!!!");
        //InitDB();
        try {
            Statement stat = DBConnectionFactory.getConnection().createStatement();
            ResultSet rs = stat.executeQuery("SELECT * FROM EMPLOYEES;");
        } catch (SQLException e) {
            // if the error message is "out of memory",
            // it probably means no database file is found
            System.err.println(e.getMessage());
            System.out.println("Database does not exist, creating it");
            InitDB();
        } catch (Exception e) {
            System.err.println(e.getMessage());
        System.out.println("!!!!!!!!!!!!!! Done App Start !!!!!!!!!!!!!!");
     * The stop method will be called at the termination of the application. Only
     * the Application Lifecycle Event listener will be called on start up.
     * NOTE: Depending on how the application is being shutdown, this method may
     * or may not be called. Features should save off their state in the deactivate
     * handler.
    public void stop() {
        // Add code here...
     * The activate method will be called when the feature is activated. The
     * Application Lifecycle Event listener will be called on application
     * being started and resumed.
    public void activate() {
        // Add code here...
     * The deactivate method will be called when the feature is deactivated. The
     * Application Lifecycle Event listener will be called on application
     * being hibernated.
    public void deactivate() {
        // Add code here...
    private void InitDB() {
        try {
            System.out.println("!!!!!!!!!!!!!!InitDB Start!!!!!!!!!!!!!!");
            ClassLoader cl = Thread.currentThread().getContextClassLoader();
            InputStream is = cl.getResourceAsStream(".adf/META-INF/hr.sql");
            if (is == null) {
                System.err.println("###### Could not look up : /META-INF/hr.sql");
                return;
            BufferedReader bReader = new BufferedReader(new InputStreamReader(is));
            List stmts = new ArrayList();
            String strstmt = "";
            String ln = bReader.readLine();
            while (ln != null) {
                if (ln.startsWith("REM") || ln.startsWith("COMMIT")) {
                    ln = bReader.readLine();
                    continue;
                strstmt = strstmt + ln;
                if (strstmt.endsWith(";")) {
                    System.out.println(strstmt);
                    stmts.add(strstmt);
                    strstmt = "";
                    ln = bReader.readLine();
                    continue;
                ln = bReader.readLine();
            DBConnectionFactory.getConnection().setAutoCommit(false);
            for (int i = 0; i < stmts.size(); i++) {
                Statement pStmt = DBConnectionFactory.getConnection().createStatement();
                pStmt.executeUpdate((String)stmts.get(i));
            DBConnectionFactory.getConnection().commit();
            System.out.println("!!!!!!!!!!!!!!InitDB Done!!!!!!!!!!!!!!");
        } catch (Exception e) {
            e.printStackTrace();
}Hope this is what you were looking for
Frank

Data flows and technical terms

Hi all,
Anyone please give me SD data flow i.e what is sales order and when it will be generated and how it is linked with billing and delivery and what is invoice, cost centre, profit center, business area, wbs element etc.
And also the purchase data flow ie Purchase order purchase requisition, material document etc.
Provide me what exactly these mean in simple words.
I am new to BI and i am very confused with these technical terms.
Regards,
Nishuv.

Hi,
Cost centre & profit Centre Hierarchy:
you have to look at the Implementation Guide (IMG) for Profit Center Accounting, Master Data -> Create/Change/Display Hierarchy or something similar..with Transaction Code:KCH3 .
But if you want specfic one , need to build a specific hierarchy in R3 and load it in BW.
You can also build it directly in BW.
If it is product hierachy u have to generate the levels in R/3 side (using same transaction in SBIW), which activates PRODH1, PRODH2...etc.
SBIW or SAP reference IMG under General Logistics -> Master Material -> Material or Settings for Central Fields -> Sales-Relevant Data -> Define Product Hierarchies
Please check this link for the detailed procedure to create hiearchy;
http://help.sap.com/saphelp_nw04/helpdata/en/0e/fd4e3c97f6bb3ee10000000a114084/frameset.htm.
Create Hierarchy in R/3 -Sample
http://www.bwexpertonline.com/go/sample/
Pls chk this links;
Re: Hierarchy Loading from R/3 to BW
Product Hirarchies for 0MATERIAL (from R3)
R/3 Hierarchy Text upload issue
http://help.sap.com/saphelp_nw70/helpdata/en/b3/41cc373de44040e10000009b38f8cf/frameset.htm
http://help.sap.com/saphelp_nw70/helpdata/en/c6/f3dc3709e9ea12e10000009b38f8cf/frameset.htm
Hope this helps,
Regards
CSM Reddy

Multiple date formats using sql developer

Hello!
i have 2 date fields in a table.. one is populated using trunc(<date1>) and the other is to_date(<date2>,'YYYYMMDD HH24MISS'). We want <date1> to display as MM/DD/YYYY and <date2> to display as MM/DD/YYYY HH:MI:SS AMPM. When we set the date format under Preference -> Database -> NLS parameter in SQL Developer with a time format it adds 12:00:00 to <date1>, if we take it out, it drops the time in <date2>. What can we do?
thanks!

I think what the original poster wanted was to display the two date columns using different formats in the table "Data" tab and AFAIK that is not possible. Setting a date format in the Preferences accomplishes the same thing as the statement
ALTER SESSION SET NLS_DATE_FORMAT='<some format>';
in command-line SQL*Plus. To do what the OP wants they'll need to create a view that has a SELECT something like this:
SELECT TO_CHAR( date1, 'YYYY-MM-DD' ) date1
, TO_CHAR( date2, 'YYYY-MM-DD HH24:MI:SS') date2
FROM some_table;
One thing the OP needs to keep in mind is that the DATE datatype stores both date and time together. If they insert a date alone, the time defaults to midnight. (This is stated in the Oracle SQL Reference.)
Ed. H.

HELP I am doing a Data Merge and It is only giving me one record per page!

I really need help here. I am doing a data merge and have selected the options for doing multiple records per page but instead it is merging everything to it's own page. Can someone tell me what I am missing?

Why do you say you can't do a multiple record merge to a table?
I've never had any trouble putting placeholders into a table. It's the way I do most of the datamerge that I work with.
My mistake… I was confused with the script, and I must confess I had never tried (until now) to use tables as placeholders, but it works.
My apologies for this uncorrect answer

SQL Developer 1.1.0.21: Issues with Data Grid and SQL syntax checking

In this new release of SQL Dev, when I execute a SQL in the SQL Worksheet and click in the Data Grid in the Results tab and try to navigate within a record using arrow keys, the grid cell enters into edit mode by default and so I cannot use the Left or Right arrow keys to navigate the grid. I am forced to use tab key to navigate. This is counter intuitive in my opinion.
Is there any option to change this behavior?
Another issue that I have come across is with SQL syntax checking. In some cases, when I press F9 to execute a SQL, it shows the SQL as executed i.e. shows something like 0.0134 seconds in the toolbar and no results displayed. In reality, the SQL had some syntax error which were NOT reported. This can be frustrating since now I have to fall back to SQL*Plus or TOAD just for syntax check.
I like the fact that SQLDev highlights the current SQL but it would be more useful if it just indicated the first line of the current sql instead of highlighting the whole sql.
Manish

"In this new release of SQL Dev, when I execute a SQL in the SQL Worksheet and click in the Data Grid in the Results tab and try to navigate within a record using arrow keys, the grid cell enters into edit mode by default and so I cannot use the Left or Right arrow keys to navigate the grid. I am forced to use tab key to navigate. This is counter intuitive in my opinion."
In the "Results" tab, Click Ctrl & Tab keys (at the same time) or with mouse click on any cell other than the first column (a sequence or rownum), you will be able to navigate using the arrow keys.
"Another issue that I have come across is with SQL syntax checking. In some cases, when I press F9 to execute a SQL, it shows the SQL as executed i.e. shows something like 0.0134 seconds in the toolbar and no results displayed. In reality, the SQL had some syntax error which were NOT reported. This can be frustrating since now I have to fall back to SQL*Plus or TOAD just for syntax check."
The 0.0134 seconds could be the result of the most recently executed successful statement. Check the Script Output tab for errors. Use F5 (Run Script option) instead of F9.
"I like the fact that SQLDev highlights the current SQL but it would be more useful if it just indicated the first line of the current sql instead of highlighting the whole sql."
On the SQL statement (or code), Right Click -> Format SQL (or press Ctrl & B), proper formatting would help.
I use version 1.0.0.15.57 and seems to be working allright.
- Babu Rangasamy

Multiple Data Sources and Accessing External Java APIs

Hi Everyone,
I have a couple of questions for which I was not able to find satisfactory answers in the forum search, so here they are. I would be really grateful if you can help us out with this.
1. Accessing two Data Sources in the same report: We have a requirement to access two data sources in the same report, and use the data from one source to run a query on the other source. Our product (OIM) has its own DB. And it integrates with BPEL (another Oracle application) for some functionality. BPEL has its own DB. A few reports need data from both these repositories. For simplicity, consider that we need to join two tables, but one table is in OIM DB and the other is in BPEL DB. I guess such a join is not possible. So to work around it, we would like to run a query against one DB and then use the results to run a query on the other DB, which will basically simulate the join by running two queries.
Is something like this possible in BIP? If not directly available, can you suggest something which can act as a work around to achieve this?
2. Calling External Java APIs from BIP: We need to call some external APIs (for achieving Data Security) 'before' we run the queries in BIP. Basically the Java API will specifya set of keys which will have to be used in an 'in' clause. I looked at the section "Building a Data Template" in the BIP User's Guide (http://bipublisher.us.oracle.com/doc/prod_docs/BI_Publisher_10_1_3_3_3/bip.1013/b40017/T421739T434255.htm). As far as I can see, it discusses how to invoke a PL/SQL procedure using <datatrigger> but the usage is not clear to me. Is there any other document that discusses this in detail? Also, I am not sure if it is possible to access Java APIs. Has it been done before? If yes, then can anyone provide some sample code (sample report bits) which I can refer to to get this thing working?
Also, the data coming from the Java API may not be in the correct format. We may have to do some additional processing (like converting data in a Java Object to something like comma separated list to be plugged into a query). Is that possible? What will be the best approach here?
Sorry for the detailed post!
Thanks,
Jatan

Yes you should be able to use both - for example using a Flash Variable to pass in the URL of the XML that you want to load.
FlashVars are only supposed to be passed in on startup and they are defined as part of the OBJECT/EMBED tag for the HTML.
Actually it was possible to update FlashVars at runtime in Xcelsius 4.5 with certain JavaScript calls but not in Xcelsius 2008 (because Adobe Flex which Xcelsius 2008 is based on does not allow the same mechanism).
FYI, for those that are interested in Xcelsius 2008 you pass values into/out of Xcelsius at runtime using External Interface and JavaScript instead.
Regards,
Matt

Data Miner and SQL Developer

Is there any way to use the Data Miner 10.2.0.3.1 as an extension to SQL Developer 1.1.3.
Any hints/comments are appreciated!

Hi,
We should have a new extension in a month or so.
In the meanwhile, you can generate code from Data Miner directly and copy/load it into SQLDeveloper, or use JDeveloper.
Thanks, Mark

Data modeler and Sql Developer

Just downloaded sqldeveloper 3 EA - and the ability to drag a schema into data modeler for a quick logical diagram is gone.
Can this only be done now in the separate data modeler product?

It's still there - you can drag&drop tables from SQL Developer browser only to empty relational model diagram. Pressing Ctrl key will change the behavior - all child tables also will be imported.
You can drag&drop object types on data types model diagram.
Now you have more possibilities - to rearrange/format and print diagram, to generate DDL.
Philip

Multiple data flow and sql tasks in a container - are records available in other tasks before transaction commits?

Similar Messages

Maybe you are looking for