Executing the ETL for populating the data in the Warehouse schema

i have developed an ETl and executed it to populate the data but it keep on running for the whole day and no end result. moreover how i can edit the ETL queries myself.

This forum is for feedback about OTN content and services. Please post your question in the Oracle Warehouse Builder forum:
Warehouse Builder

Similar Messages

Help me to fix the error while running DBMaintain Against the Database Schema in ASE.

Hi All,
I am trying to install sybase mobiliser platform 5.1 SP 03.I am referring the following guide
http://infocenter.sybase.com/help/topic/com.sybase.infocenter.dc01871.0513/pdf/Mobiliser_Platform_Installation_Guide_5.1…
Now I have configured the ASE database server with default settings and now it is running fine.
Now my concerns are as follows:
1) I have executed the database schema (mobr5): 001_MONEY_drop_and_create_user.DDL with the help of linux command
isql -Usa -SASE1 -Phello@123 -i/opt/sybase/db/sql/001_MONEY_drop_and_create_user.DDL -o/opt/sybase/ASE-15_0/install/ASE1.log
How do I check the created database schema and user with default name 'mobr5'?
2) While running DBMaintain Against the Database Schema, I have followed the steps mentioned in the guide and made the following changes in the file dbmaintain.properties.ase
database.driverClassName=com.sybase.jdbc4.jdbc.SybDriver
database.url=jdbc:sybase:Tds:ASE1:5000/mobr5
database.userName=mobr5
database.schemaNames=mobr5
database.password=paybox
#Must be set if the driver is not packaged inside the scriptarchive or is present on the classpath
#e.g. /path/to/driver.jar
#database.driverLocation=/path/to/jconnect.jar
database.driverLocation=/opt/sybase/db/sql/com.sybase365.mobiliser.vanilla.standalone-5.1.3.RELEASE-scriptarchive-ase.jar
database.driverLocation=/opt/sybase/db/sql/com.sybase365.mobiliser.vanilla.standalone-5.1.3.RELEASE-scriptarchive-ase-vanilla.jar
When I execute the script archives ,
java –jar /opt/sybase/db/sql/com.sybase365.mobiliser.vanilla.standalone-5.1.3.RELEASE-scriptarchive-ase-driverless.jar -c /opt/sybase/db/sql/dbmaintain.properties.ase
java –jar com.sybase365.mobiliser.vanilla.standalone-5.1.3.RELEASE-scriptarchive-ase-vanilla-driverless.jar -c dbmaintain.properties.ase
I get the following error:
So please help me to resolve the issues.

Hi All,
Issue is resolved and database has been updated successfully..
Error was in database .url field of dbmaintain.properties.ase file.
I have changed the database.url field from database.url=jdbc:sybase:Tds:ASE1:5000/mobr5
to database.url=jdbc:sybase:Tds:<Private IP of Linux instance>:5000/mobr5
Note:- I am installing mobiliser platform on AWS cloud.So I have made use of Private IP address of AWS Linux instance.

Current date should be populated when executing the hierachy variable.

Hi bw Pro's
I have a customer hi-erachy.For that hierachy i created a variable.
The variable name is hieraachy date.
the variable will be executed with user entry/default value.
the characteristic i used for thata variable is date.
Now the requirement is the date should be populated with current date when ever i executed the variable automatically
I thk i need to develop customer exit for this. I am not so comfort with coding.
can anybody will help me on this issue. suggest me with logic or any further idea.
any help is appreciated .
Thanks,
suri

Hi Jasprit,
Below is the erro when i added the code and i restrict the customer exit variable.
ERRORS:
INCORRECT FORMAT WITH KEY DATE FOR ELEMENT "43Z6K6807CL51WZ025Q1GPHER"(VALUE "&&" IS INVALID).
Below is the diagnosis for the error.
You are using a key date specification in the query. This can be either in the query key date directly or in the key date for a selection or presentation hierarchy. the element, in which this error was found, is called "43Z6KGHDHHJ5VYWJU8UEVBRRK". The invalid value is called "&&".
System response
The problem is reported with the check.
Procedure
Check the incorrect format in the specified element and correct it.
Technical name (UID) of the element: "43Z6KGHDHHJ5VYWJU8UEVBRRK".
I am checking the UID in rsa1> transprot connection>query element-->variable.But system is not showing any UID. Any idead on the above issue.
Can you please help me in this.
thanks
suri

How to Load data for extra columns exist in the dest schema....

Hi Experts,
Please help me.
I need to replicate data from SchemaA to SchemaB.
SchemaB has 3 extra columns. Two are varchar2 type and other is Integer type.
I need to replicate the data from SchemaA to SchemaB in the same database.
When ever i inserted the data in SchemaA, The extra columns should be populated with some default data.
And if we did any update on SchemaA then the extra columns on SchemaB should be populated with other Data.
I wrote some DML_HANDLER but it always populating same data.
I dont know ow to handle this type of situation.
my Handler is:
CREATE OR REPLACE PROCEDURE dml_handler(in_any in sys.anydata)
IS
lcr SYS.LCR$_ROW_RECORD;
rc PLS_INTEGER;
object_owner VARCHAR2(30);
BEGIN
rc := in_any.GETOBJECT(lcr);
object_owner := lcr.GET_OBJECT_OWNER();
IF lcr.get_object_owner() = 'SchemaB' THEN
lcr.add_column('new','SHIP_DATE',sys.anydata.convertvarcahr2('N'));
lcr.add_column('new','SHIP_ZONE',sys.anydata.convertvarchar2('N'));
lcr.add_column('new','SHIP_REACH_BY_DATE',sys.anydata.convertnumber(1));
lcr.EXECUTE(TRUE);
END IF;
END;
BEGIN
DBMS_APPLY_ADM.SET_DML_HANDLER
(object_name => 'SchemaB.TAB_TEST',
object_type => 'TABLE',
operation_name => 'INSERT',
error_handler => FALSE,
user_procedure => 'STRMADMIN.DML_HANDLER');
END;
On extra columns in SChemaB
if its a first insert then the default values are (N,N,1).
If we did any update the values should be (Y,Y,2)
Post any script or give me some idea.
Thanks,
Ray
Edited by: user7423698 on Mar 3, 2009 6:12 PM

CREATE OR REPLACE PROCEDURE dml_handler (
in_any IN SYS.ANYDATA
IS
lcr sys.lcr$_row_record;
rc PLS_INTEGER;
cmd_type VARCHAR2 (30);
BEGIN
rc := in_any.getobject (lcr);
cmd_type := lcr.get_command_type;
IF cmd_type = 'INSERT'
THEN
lcr.set_values ('new', lcr.get_values ('new', 'N'));
lcr.add_column ('new', 'type', sys.anydata.convertchar ('I'));
lcr.set_values ('old', NULL);
lcr.add_column ('new', 'time', sys.anydata.converttimestamp (systimestamp));
lcr.execute (TRUE);
END IF;
END;
Set the DML handler for INSERT and write a similar one for UPDATE.

Custom SharePoint 2010 designer page throws "The data source control failed to execute the insert command" exception while adding the new item after the August 13, 2013 CU has installed

We have the SharePoint Server 2010 with SP1 environment on which the custom SP2010 designer pages were working as expected before the
August 13, 2013 CU has installed. But, getting the below exception while trying to add the new item after the CU has installed.
Error while executing web part: System.NullReferenceException: Object reference not set to an instance of an object.     at Microsoft.SharePoint.WebControls.SPDataSourceView.ExecuteInsert(IDictionary values)     at
System.Web.UI.DataSourceView.Insert(IDictionary values, DataSourceViewOperationCallback callback) 3b64c3a0-48f3-4d4a-af54-d0a2fc4553cc
06/19/2014 16:49:37.65 w3wp.exe (0x1240)                       0x1300 SharePoint Foundation
Runtime                       tkau Unexpected Microsoft.SharePoint.WebPartPages.DataFormWebPartException: The data source control
failed to execute the insert command. 3b64c3a0-48f3-4d4a-af54-d0a2fc4553cc    at Microsoft.SharePoint.WebPartPages.DataFormWebPart.InsertCallback(Int32 affectedRecords, Exception ex)     at System.Web.UI.DataSourceView.Insert(IDictionary
values, DataSourceViewOperationCallback callback)     at Microsoft.SharePoint.WebPartPages.DataFormWebPart.FlatCommit()     at Microsoft.SharePoint.WebPartPages.DataFormWebPart.HandleOnSave(Object sender, EventArgs e)
at Microsoft.SharePoint.WebPartPages.DataFormWebPart.RaisePostBackEvent(String eventArgument)     at System.Web.UI.Page.RaisePostBackEvent(IPostBackEventHandler sourceControl, String eventArgument)     at System.Web.UI.Page.ProcessRequestMain(Boolean
inclu... 3b64c3a0-48f3-4d4a-af54-d0a2fc4553cc
06/19/2014 16:49:37.65* w3wp.exe (0x1240)                       0x1300 SharePoint Foundation
Runtime                       tkau Unexpected ...deStagesBeforeAsyncPoint, Boolean includeStagesAfterAsyncPoint) 3b64c3a0-48f3-4d4a-af54-d0a2fc4553cc
I have tried changing the "DataSourceMode" as below, now the insert command is working, but update command is not working.
<SharePoint:SPDataSource runat="server" DataSourceMode="ListItem" />
Also, the lookup dropdown fields are displaying the value as "<a href="Daughterhttp://cpsp10/sites/Employees/_layouts/listform.aspx?PageType=4&ListId={8F62F444-FB6A-4F03-9522-C4696B45DCD1}&ID=10&RootFolder=*">Daughter</a>"
instead of only "Daughter".
Please provide the solution to get rid of this issue.
Thanks
Ramasubbu

Try below:
http://social.technet.microsoft.com/Forums/en-US/ae910269-3a0c-4506-844b-e8bc89d95b71/data-source-control-failed-to-execute-the-insert-command
http://blog.jussipalo.com/2012/01/sharepoint-2010-data-source-control.html
While there can be many causes for this generic error message, in my case the first parameter or ddwrt:DataBind function inside the SharePoint:FormFields element was
'i' and I was working with an Edit Form. Changing it to
'u' as it was with every other FormField fixed the issue.
<SharePoint:FormField runat="server" id="ff1{$Pos}" ControlMode="Edit" FieldName="Esittaja" __designer:bind="{ddwrt:DataBind('u',concat('ff1',$Pos),'Value','ValueChanged','ID',ddwrt:EscapeDelims(string(@ID)),'@Esittaja')}"
/>
Explanation:
DataBind operation type parameters (the first parameter) are listed below:
'i' stands for INSERT,
'u' stands for UPDATE,
'd' stands for DELETE.
http://webcache.googleusercontent.com/search?q=cache:d9HHY4I7omgJ:thearkfloats.blogspot.com/2014/03/sharepoint-2010-data-source-control.html+&cd=4&hl=en&ct=clnk&gl=in
If this helped you resolve your issue, please mark it Answered

Performance Problem when executing the report for the first time.

Hi,
We have a Zreport...to improve the performance i created Index on few Data Base table..before my changes it used to take more than 15 minutes after the changes it taking less than 1 min for the same variant and for other variants also.
But when executing the first in morning its taking the same time more than 15 min.Please let me know how to increase the performance when executing first time also,
Thanks,
Kiran.

Hi all,
Appreciate your valuable replies...
@ Thomas: i do accept with your solution running a background job..but user is not accepting for it..thanks for your reply.
@Siegfried Boes : for testing purpose Im running this manytimes..but for user they may
require when ever they need to know open oders.the volume of the data is barongs 300-350 at
max.
@Brad Bohn : After creating the index the repose time reduced to half ...i hope i have
created a right index.
Observation here...I executed the report in production system more than 5 times it took the
same time, my changes are still in quality..so i think may be for selecting the right index
its taking this much time.and for the next time is taking right index n doing it so it taking
less.
Do you accept it?.if so Please let me know how to explicitly say the select statement to
use my index.
Thanks,
kiran.

Error while executing the transaction QC22 (Quality Certificate for Batch)

Hello Friends,
While executing the transaction QC22(Quality Certificate for Batch), after giving the Batch Number and Customer Number, when i am executing it , system is throwing the error message as "Not all data was found for characteristic 90139982 in profile D80D8".
Message no. ZQ010
Diagnosis
Not all data was found for characteristic 90139982, referenced as number 0030 in certificate profile D80D8. The missing data could be the short text, specifications, or results.
System Response
The missing charactertistic will not be printed on the certificate,
Procedure
Review the settings for data orgin of the short text, specifications, and results, and adjust accordingly.
One more thing i would like to add here as against the same batch in april we had taken the print of COA (Quality Certificate) through the transaction QC22. But now we are trying to do that than system is thrown above mentioned error.
As i am new in QM, kindly explain we were to maintain the certificate profile.
Waiting for the experts inputs.
Thanks and Regards,
Jitendra Chauhan

Hi
Try with QA33 you may have display authorization, or check in MB51 on the base of material and batch you can find the lot number generated, then go to QA03 and check the result, if you want to validate the characters check with the inspection plan, the characters entered in the inspection plan and the characters in the concerned certificate profile.
Regards
Naveen.
Edited by: vaddapalli naveen on Jul 1, 2010 1:57 PM

F110-Executing the Payment program for a number of company codes

We are executing the payment program (transaction F110) for a number of different company codes. On the PARAMETERS tab, we have to type in the company codes every time we do a payment run. Is there some way to store the parameters tab in a variant so that we can just go get the variant each day instead of typing in the company codes??

Hi Bonnie,
in Parameters tab, on the top u have a button (copy parameters (F9)) press that key and give your previous Identification/date, then it will automatically, copies the Company code, Payment Method, Next run date, and Customer and vendors. just change the next rundate. and save
form next time onwords when u select copy parameters the, it will automatically praposes previously used identifier. that means, pressing F9 then enter will finish ur work.
Satish
Assign points if useful.

How to execute the data in the form when the data is already avaliable

Hi,
I am working with forms 6i. I have a problem while executing the data in the form
Actually, the data is already present in the form. But when i run the form, the data is not displayed.
can anyone please help me how to execute the data. below is the code
Set_Alert_Property(alert_id,ALERT_MESSAGE_TEXT,'Do you want to refresh new Data for that Year and Field ? (it will take a time).') ;
               SET_ALERT_BUTTON_PROPERTY(alert_id, ALERT_BUTTON1, LABEL, 'Yes');
               SET_ALERT_BUTTON_PROPERTY(alert_id, ALERT_BUTTON2, LABEL, 'No');
               SET_ALERT_BUTTON_PROPERTY(alert_id, ALERT_BUTTON3, LABEL, 'Cancel');
               button_number :=Show_Alert(alert_id) ;
               synchronize;
               if button_number != ALERT_BUTTON3 then
                    if button_number = ALERT_BUTTON1 then
                         :param.field := :control.f_cd;
                         :param.year := :control.year;
                         build_tables;
                         fields;
-- areas(:param.field);
                         PUT_PARAM;
                         COMMIT_FORM;
                    go_block('wet_criterias');
                    end if;
                    if button_number = ALERT_BUTTON2 then
                         :exhibits.field_display := :control.f_name || ' - Exhibits';
                         go_block('RESERVOIR');
                         execute_query;
                    end if;
               end if;
          end if;
else
     message('Fields must be entered...');
end if;
else
message('Fields must be entered...');
end if;

It's hard to know what logic you are trying to implement.
However, by looking at your code, it seems that if the user select 'Yes' to the question "Do you want to refresh", nothing is done except the go_block('wet_criterias'). Should there be an 'Execute_Query' ?
No idea...

What are the setting for Save button for saving plan data in WAD template

Hi,
i created SAVE button in Webtemplate for saving plan data.But this button is not
active.is there any setting for this?
thanks in advance
chandu

Hi Chandu,
The settings to Configure the Save function.
Right click the Button Group Item ® Properties ® * Button ®
Type Caption Save ® Command ® Select All Commands Tab ®
De-select Execute Planning Function and then select checkbox Save
Changed Data ® Double click on Save Changed Data ® OK ® OK ® Save your template.
*pls assign points,if info is useful*
Regards
CSM Reddy

Splitting and executing the query for each 1 lac and executing parallel.

Hi All,
We have a table with around 10 keys and each key is having more than millions of records for a given date.
And my requirement is to find the sum of the sale_price of each keys.
( example :
Select key, sum(sale_price) from table1 where date1=sysdate
group by key
Since, each set of key contains more than a millions of records, It's time consumption is too high.
Is thr any way to achieve as below,
For key 1 (assume 1 million records)
and we will spilt these into 100 parts and execute parallelly.
At the end get sum of all 100 parts.
Similarly for other keys....
Is it possible to divide the records into 1 lac each and give it for parallel execution ?

If the key column is also the partition key, I would expect that to work well with parallel query. What have you tried that isn't working? Also what is your Oracle version?

Message "No applicable data found" after executing the report

Hi all,
I have 60 records in a cube which is extracted from a function module. I am able to see the data in the cube but when I execute the report I am getting the message u201CNo applicable data foundu201D. Why is that so?
Can any one please explain me what to do to bring data when the report is executed?
When I execute the query there is only one field selection criteria 0P_FPVANT and this is mandatory. When I checked the data in the cube I didn't find any field 0P_FPVANT but I found a field Fiscal Period Variant with the technical name, 0FISPER
I executed the query in RSRT and there also I am getting the same message, "No applicable data found".
Please advise what do I need to do inorder to get data when the report is executed?
Thank you.
Regards,
Pavan.

I think so.
Ok let me take the other report 0FIAR_C02_Q1003. For this report the selection criteria is
Company code,
Customer and
Period/Fiscal Year
Of these only company code is mandatory. In the data in the cube I see that for co. code BP01 data is available. So I executed the report with co. code as BP01 but no data.
Then I gave co. code BP01 and Period /Fiscal year as 2008, 2008.03, still I see no data.
I tried with values in all the fields that are available in cube
co. code - BP01
Customer - PCS-C10
Period/Fiscal Year - 2008011
Now with respect to Period/Fiscal Year selection field in report, in cube there are 4 columns
Fiscal Year Period,
Posting Period,
Fiscal Year Variant and
Fiscal Year
I've tried all of them but when I enter values in all the fields still I am getting the same error, "no applicable data found".
Please advise.
Thank you.
Pavan.

How to know the User name and date, who executed the report last time.

Hi All,
We are collecting a list of reports which are not executed for past 3 months. Can anybody tell me how to know the username and date they executed the report last time.
Is there any table to look ? or is there any process ?
Thanks,
Ravi.

Ravi,
Use SE16 - then look at rszcompdir.
We look up Version = 13 for queries.
Regards
Gill

Code for populating the field

Hi,
can any one help me out for populating the appended field to data source.
<u><b>My requirement:</b></u> I have enhanced the data source 2lis_11_vahdr by appending the field zzmatnr in to its extract structure, Now i want to populate this field from the field available in the MARC table. so can any one help me out the whole code for this?
apart from this i have one another question that is if i append this field to the communication structure( like mcvbak, mcvbap... etc) then how we will populate this field.
and what is the exact difference between appending the field to the extract structure and appending the field to the communication structure.
Thanks

1)Just a sample code to add old material code(zzoldmatno) to the data source
'2LIS_02_S012'.
The function module is EXIT_SAPLRSAP_001.
You have write the code in the include zxrsau01.
when '2LIS_02_S012' .
data : it_s012biws like s012biws .
tables : mara .
loop at c_t_data into it_s012biws .
l_tabix = sy-tabix.
select single bismt from mara into mara-bismt where matnr =
it_s012biws-matnr.
if sy-subrc = 0.
it_s012biws-zzoldmatno = mara-bismt .
endif.
clear mara-bismt .
modify c_t_data from it_s012biws index l_tabix.
endloop.
2) Replicate the datasource.
3) Now with the above code datasource R/3 part is finished.To receive the new column at the BW end you have to add a column to your ODS or infocube as well to the communication structure(say ZOLDMAT in my case) and map the new field(ZZOLDMATNO) to the field (ZOLDMAT).
4) Activate the Transfer Rule.
Hope this helps.
Regs
Gopi.

The data source control failed to execute the insert command

Hi,
We have installed SharePoint 2010 on Windows Server 2008 Enterprise Edition. We've started using the "Employee Training Scheduling and Materials" template that is available at
http://www.microsoft.com/government/en-us/campaigns/Pages/SharePoint-Templates.aspx. Till last friday (17th Oct,2013) everything was working fine, but after that we are getting an error "The data source failed to execute the insert command"
when I click on the "Save" button available on the Registrations.aspx. Could any one help me resolve this issue?
Kinldy revert if you need more details.
Though I see many posts regarding this, most of them are associated with Windows Server 2008 R2. So, most of the hot fixes mentioned there could not help me.
Your help me is greatly appreciated. Thanks for taking time to go through this post.
Thanks and Regards
Praveen.
Thanks and Regards Praveen.

I have the exact same problem. I updated the 2007 Employee training template to the 2010 version and then 2 months ago, presumably when our Sharepoint had the July 10th patch 14.0.7102.5004 applied, it all broke. An attempt to register for a class always
comes back with "Failure to execute insert command".
I tried changing the DateSourceMode from "ListItem" to "List" that gets rid of the error but does NOT update the registrations list.
Anyone have any success fixing this?

Executing the ETL for populating the data in the Warehouse schema

Similar Messages

Maybe you are looking for