Partial replication of tables using streams

I need to replicate a subset of master table (few columns) to another database. destination tables are read only. But this needs to happen in real time. I was using oracle streams to replicate entire table. To make it partial, can we have something like streams replicating materialized views from maser. Any clue on how can this be achived with better performance.

The data needs to be replicated in a few seconds, if we run a materialized view on all the tables in seconds, will it not have a performace impact on the source database.Since some tables needs to be replicated entirely at real time we are using streams for those tables.Now to get a partial one, I am trying to create a rule set with delete_columns, rename_columns etc combination of dbms_rules package.
Any links that could help this construction?
Do you still feel that materialized viwe would be a better alternative to the problem, to replicate few columns of lot of tables in real time?

Similar Messages

Can we capture changes made to the objects other than tables using streams

Hello All,
I have setup a schema level streams replication using local capture process. I can capture all the DML changes on tables but have some issues capturing DDL. Even though streams are used for sharing data at different or within a database I was wondering if we can replicate the changes made to the objects like views, procedures, functions and triggers at the source database. I am not able to replicate the changes made to the views in my setup.
Also, when I do a "select source_database,source_object_type,instantiation_scn from dba_apply_instantiated_objects" under the column 'object_type' I just see the TABLE in all the rows selected.
Thanks,
Sunny boy

Hello
This could be a problem with your rules configured with capture,propagation or apply. Or might be a problem with your instantiation.
You can replicate Functions, Views, Procedure, Triggers etc using Streams Schema level replication or by configuring the rules.
Please note that the objects like Functions, Views, Procedure, Triggers etc will not appear in the DBA_APPLY_INSTANTIATED_OBJECTS view. The reason is because you do a schema level instantiation only the INSTANTIATION_SCN in DBA_APPLY_INSTANTIATED_SCHEMAS is accounted for these objects. At the same time tables would get recursively instantiated and you would see an entry in DBA_APPLY_INSTANTIATED_OBJECTS.
It works fine for me. Please see the below from my database (database is 10.2.0.3):
on capture site_
SQL> connect strmadmin/strmadmin
Connected.
SQL> select capture_name,rule_set_name,status from dba_capture;
CAPTURE_NAME RULE_SET_NAME STATUS
STREAMS_CAPTURE RULESET$_33 ENABLED
SQL> select rule_name from dba_rule_set_rules where rule_set_name='RULESET$_33';
RULE_NAME
TEST41
TEST40
SQL> set long 100000
SQL> select rule_condition from dba_rules where rule_name='TEST41';
RULE_CONDITION
((:ddl.get_object_owner() = 'TEST' or :ddl.get_base_table_owner() = 'TEST') and
:ddl.is_null_tag() = 'Y' and :ddl.get_source_database_name() = 'SOURCE.WORLD')
SQL> select rule_condition from dba_rules where rule_name='TEST40';
RULE_CONDITION
((:dml.get_object_owner() = 'TEST') and :dml.is_null_tag() = 'Y' and :dml.get_so
urce_database_name() = 'SOURCE.WORLD')
SQL> select * from global_name;
GLOBAL_NAME
SOURCE.WORLD
SQL> conn test/test
Connected.
SQL> select object_name,object_type,status from user_objects;
OBJECT_NAME OBJECT_TYPE STATUS
TEST_NEW_TABLE TABLE VALID
TEST_VIEW VIEW VALID
PRC1 PROCEDURE VALID
TRG1 TRIGGER VALID
FUN1 FUNCTION VALID
5 rows selected.
on apply site_
SQL> connect strmadmin/strmadmin
Connected.
SQL> col SOURCE_DATABASE for a22
SQL> select source_database,source_object_owner,source_object_name,source_object_type,instantiation_scn
2 from dba_apply_instantiated_objects;
SOURCE_DATABASE SOURCE_OBJ SOURCE_OBJECT_NAME SOURCE_OBJE INSTANTIATION_SCN
SOURCE.WORLD TEST TEST_NEW_TABLE TABLE 9886497863438
SQL> select SOURCE_DATABASE,SOURCE_SCHEMA,INSTANTIATION_SCN from
2 dba_apply_instantiated_schemas;
SOURCE_DATABASE SOURCE_SCHEMA INSTANTIATION_SCN
SOURCE.WORLD TEST 9886497863438
SQL> select * from global_name;
GLOBAL_NAME
TARGET.WORLD
SQL> conn test/test
Connected.
SQL> select object_name,object_type,status from user_objects;
OBJECT_NAME OBJECT_TYPE STATUS
TEST_VIEW VIEW VALID
PRC1 PROCEDURE VALID
TRG1 TRIGGER VALID
FUN1 FUNCTION VALID
TEST_NEW_TABLE TABLE VALID
5 rows selected.
These Functions, Views, Procedure, Trigger are created on the source and got replicated automatically to the target site TARGET.WORLD. And note that none of these objects are appearing in DBA_APPLY_INSTANTIATED_OBJECTS view.
I have used the above given rules for capture. For propagation I dont have a ruleset itself and for apply I have same rules as of the capture rules.
Please verify your environment and let me know if you need further help.
Thanks,
Rijesh

How to populate the table using streaming data

Dear folks
M about to create a midlet application in which i need to populate my table with the current stock exchange values. Since these values get changed dynamically , I planned to use streaming. Since m new to streaming ,pls someone come up to guide me in right path. M using Canvas application. I appreciate all the replies

Dear folks
M about to create a midlet
application in which i need to populate my table
with the current stock exchange values. Since these
values get changed dynamically , I planned to use
streaming. Since m new to streaming ,pls someone
come up to guide me in right path. M using Canvas
application. I appreciate all the repliesthats fine and funny....
let me tell you something, in GCF everything you fetch through GPRS is bound to come as an inputstream and whatever request you send is passed as outputstream. so if you have worked with GCF, you have worked with streaming already. isn't it.
SD

Problem in Update using STREAMS in Ora 10g EE

Hi
I am using Oracle 10g Enterprise Edition for replicating datas after failover occurs in DB
I had followed the steps in below URL..
http://blogs.ittoolbox.com/oracle/guide/archives/oracle-streams-configuration-change-data-capture-13501
The replication is achived using streams.
INSERT,DELETE operations working fine without any issue. But UPDATE operation is not replicated immediately.
I did UPDATE and gave COMMIT, no replication. Again I did UPDATE and gave COMMIT, now only it updates the Streams table.
For every UPDATES it needs two times? Why? How to solve this?
Or Any other URL which gives working examples of Streams in 10g..
Any help regard this highly appreciated..

Thanks for ur reply..
There is no specific reason to use STREAMS..
I have to replicate the data during my properity database stated up.
We already discuss with this topic
Data Replication in after downtime
Instead of using Triggers or procedure, i have to use anyone of the technologies in Oracle 10g for DataReplication..
Can you give me more info like advantages of using DataGuard or other techologies in Oracle 10g EE .

Table replication using streams uni-directional

Hi,
I recently started using streams and configured the table level replication using streams. I have configured all required processes in a "local capture" method and capture, propogate processes are running fine (status shows to be fine). The apply process at target database is running fine. The logminer is minging the redo logs as per the alert log at source. But i do not see any changes applied on target. suppose, i insert a row at source table it should be appeared at target after some time.
I am trying to find if there is any thing not satisfied at the apply level. I am looking for some directions on the below questions. please dont point me to some links please as i have been going through several sites.
What is captured on source is formed into a LCR. Now, how can i see an LCR at source database (through a query or procedure) when any insert or update is done at source?
How can i see if the LCRs are propagated to target database or not?
If LCRs are propogated properly what query or any object helps me to find out what is in the LCR at target site?
You may probably ask me any questions related to streams configuration and i will check if i have done it properly or not.
Regards,
sree

Hi,
Thanks for your reply. Yes. It is 11g.
In my later research i found the below error message from the alert.log at apply site.
knllgobjinfo: MISSING Streams multi-version data dictionary!!!
knlldmm: gdbnm=STRM2.ORDB.NET
knlldmm: objn=16914
knlldmm: objv=1
knlldmm: scn=17541786
When checked on the source site, the SCN i retrieved is,
At Capture Site:
==========
SQL> SELECT DBMS_FLASHBACK.GET_SYSTEM_CHANGE_NUMBER FROM DUAL;
GET_SYSTEM_CHANGE_NUMBER
17550440
At Apply site:
=========
SQL> SELECT DBMS_FLASHBACK.GET_SYSTEM_CHANGE_NUMBER FROM DUAL;
GET_SYSTEM_CHANGE_NUMBER
17550779
When looked at the metalink note, i found that it might be an instantiation issue or the Issue with Propogation. I am trying to get help from the oracle documents but it looks like it might take little more time. Can you quickly guide me.
How to make sure that propogation is going fine. It is understood that there occurs when the Streams data dictionary information for the specified object is not available in the apply database.
I have instantiated my table at source using DBMS_STREAMS_ADM.ADD_TABLE_RULES and added propagation rules DBMS_STREAMS_ADM.ADD_TABLE_PROPAGATION_RULES as well. Later i stopped capture and apply, executed DBMS_CAPTURE_ADM.PREPARE_TABLE_INSTANTIATION at source (nothing done at destination), restarted the apply, capture process. I believed that it would do the instantiation again.
How to make sure that the instantiation is done properly?
Thank you for your patience.
Regards
Sree
Edited by: user9501019 on Oct 13, 2009 4:19 PM

Replicate to a different schema using streams

All,
I'm performing replication using streams, I have read the doc and steps by steps notes on metalink getting the replication successfully.
But now, I want to do the same but on differents schemas ie.
source DB: Schema= A Table=test
Destination DB: Schema= B Table=test
On both databases the schemas are basically the same but with different names.
What changes o additional steps I need to perform in order to complete the replication?
Thanks in advance..!

Here is the procedure
1) Follow the instructions from the documentation to create the streams administrator user on both source and target.(e.g. steams_adm)
2) Connect to the streams administrator user at the TARGET (10.2) database
--Create a queue
Begin
Dbms_streams_adm.set_up_queue(
queue_name => 'APPLY_Q',queue_table => 'APPLY_Q_QT');
End;
--Create rules for apply process
begin
dbms_rule_adm.create_rule(rule_name =>'APPLY_RULE',
condition => ':dml.get_object_owner()=''<put your source schema owner>'' ');
end;
begin
dbms_rule_adm.create_rule_set(rule_set_name => 'streams_adm.apply_ruleset',
evaluation_context => 'SYS.STREAMS$_EVALUATION_CONTEXT');
dbms_rule_adm.add_rule(rule_set_name => 'APPLY_RULESET',rule_name =>'APPLY_RULE');
end;
--Set the rule to rename the schema
begin
dbms_streams_adm.rename_schema(
rule_name=>'APPLY_RULE',
from_schema_name =>'<put the source schema>',
to_schema_name => '<put the target schema>');
end;
--Create the apply
begin
dbms_apply_adm.create_apply(apply_name => 'APPLY_CHANGES',
rule_set_name => 'APPLY_RULESET',
queue_name => 'APPLY_Q',
source_database => '<source database name>',
apply_captured => true);
end;
BEGIN
DBMS_APPLY_ADM.SET_PARAMETER(
apply_name => 'APPLY_CHANGES',
parameter => 'DISABLE_ON_ERROR',
value => 'N' );
END;
--Start apply
begin
dbms_apply_adm.start_apply('APPLY_CHANGES');
end;
3) Connected as strmadmin on SOURCE (9.2) database:
--Create a database link to the TARGET database connected as streams_adm. The name of the dblink must match the target database name since you have to set global_names=true in the init files of both databases
--Create a queue
Begin
Dbms_streams_adm.set_up_queue(
queue_name => 'CAPTURE_Q',queue_table => 'CAPTURE_Q_QT');
End;
--Create the rule and rulesets
*** Here replace the schema owner and the list of tables you'd like to capture changes *** from
begin
dbms_rule_adm.create_rule(rule_name =>'FILTER_TABLES',
condition => ':dml.get_object_owner()=''<put your schema owner>'' and :dml.get_object_name() in (''TAB1'',''TAB2'')');
end;
begin
dbms_rule_adm.create_rule_set(rule_set_name => 'streams_adm.capture_ruleset',
evaluation_context => 'SYS.STREAMS$_EVALUATION_CONTEXT');
dbms_rule_adm.add_rule(rule_set_name => 'CAPTURE_RULESET',rule_name =>'FILTER_TABLES');
end;
--Prepare the schema for instantiation
*** Replace the schema name with your schema name
BEGIN
DBMS_CAPTURE_ADM.PREPARE_SCHEMA_INSTANTIATION(
schema_name => '<put your schema name here>');
END;
--Create propagation
BEGIN
DBMS_PROPAGATION_ADM.CREATE_PROPAGATION(
propagation_name => 'streams_propagation',
source_queue => 'streams_adm.capture_q',
destination_queue => 'streams_adm.apply_q',
destination_dblink => '<database link>',
rule_set_name => 'streams_adm.capture_ruleset');
END;
--Create capture process
BEGIN
DBMS_CAPTURE_ADM.CREATE_CAPTURE(
queue_name => 'streams_adm.capture_q',
capture_name => 'capture_tables',
rule_set_name => 'streams_adm.CAPTURE_RULESET',
first_scn => NULL);
END;
--start capture
begin
dbms_capture_adm.start_capture('CAPTURE_TABLES');
end;
Let me know if you have any questions

Replicate using streams to a different schema

All,
I'm performing replication using streams, I have read the doc and steps by steps notes on metalink getting the replication successfully.
But now, I want to do the same but on differents schemas ie.
source DB: Schema= A Table=test
Destination DB: Schema= B Table=test
On both databases the schemas are basically the same but with different names.
What changes o additional steps I need to perform in order to complete the replication?
Thanks in advance..!

There are demos of both Change Data Capture (superior for what you appear to be doing) and Streams in Morgan's Library at www.psoug.org. Some of them duplicate exactly what you describe.
PS: There is a specific Streams forum. In the future please post Streams related requests there. Thank you.

How do we use "streams" functionality in Oracle 8i?

Hello Gurus,
Oracle Streams is only available as of Oracle 9i. I need to replicate data from an Oracle 8i database to another database. The tables don't match exactly and i want a solution that can mimic streams. How can that be done? Is there any sample code available to do this type of streaming between Oracle 8i dbs?
Thanks.

You can use Materialized views (used to be called Snapshot) or Advanced Replication. But I think AR is an extra option not included in Enterprise Edition.
You could also develop trigger based replication using database link. But I advice you don't go that way. Don't reinvent the wheel. Think of what happens when one db goes down - you don't want the other to sink with it...
You should give Snapshot a try. Look for fast snapshot refresh. It uses incremental log, so it is a lot faster in most cases.
You need at least 9i R2 to use Streams, but you're better off with 10.2.0.3.

Unable to load data in to table using sqlloader

Hi,
Oracle Version :10.2.0.1
Operating system:windows Xp
I was unable to load the data in to table from csv file .Can any one please help me .
Here is the output of my log file
SQL*Loader: Release 10.2.0.1.0 - Production on Thu Jun 3 12:43:22 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Control File:   ach_staging.ctl
Data File:      E:\SQL LOADER\ACH_STAGING.csv
Bad File:     E:\SQL LOADER\load_bad.bad
Discard File: E:\SQl LOADER\emp.dsc
(Allow all discards)
Number to load: ALL
Number to skip: 0
Errors allowed: 50
Bind array:     64 rows, maximum of 256000 bytes
Continuation:    none specified
Path used:      Conventional
Table ACH_STAGING, loaded from every logical record.
Insert option in effect for this table: INSERT
TRAILING NULLCOLS option in effect
   Column Name                  Position   Len Term Encl Datatype
ACH_CODE                            FIRST     *   , O(") CHARACTER
LOAN_CODE                            NEXT     *   , O(") CHARACTER
LOAN_TYPE                            NEXT     *   , O(") CHARACTER
TRAN_ID                              NEXT     *   , O(") CHARACTER
BO_CODE                              NEXT     *   , O(") CHARACTER
BO_NAME                              NEXT     *   , O(") CHARACTER
ST_CODE                              NEXT     *   , O(") CHARACTER
ACH_TYPE                             NEXT     *   , O(") CHARACTER
ACH_EFFECTIVE_DATE                   NEXT     *   , O(") CHARACTER
AMT                                  NEXT     *   , O(") CHARACTER
CHECK_ACCNT_NO                       NEXT     *   , O(") CHARACTER
ABA_CODE                             NEXT     *   , O(") CHARACTER
ACH_STATUS                           NEXT     *   , O(") CHARACTER
TRAN_STATUS                          NEXT     *   , O(") CHARACTER
IS_HOLD                              NEXT     *   , O(") CHARACTER
IS_CANCELLED                         NEXT     *   , O(") CHARACTER
COMMENTS                             NEXT     *   , O(") CHARACTER
UPDATED_BY                           NEXT     *   , O(") CHARACTER
DATE_UPDATED                         NEXT     *   , O(") CHARACTER
CREATED_BY                           NEXT     *   , O(") CHARACTER
DATE_CREATED                         NEXT     *   , O(") CHARACTER
LOAN_TRAN_CODE                       NEXT     *   , O(") CHARACTER
ACH_AUTH                             NEXT     *   , O(") CHARACTER
REBATE_AMT                           NEXT     *   , O(") CHARACTER
PROMOTION_AMT                        NEXT     *   , O(") CHARACTER
TDC_ACH_NO                           NEXT     *   , O(") CHARACTER
INST_NUM                             NEXT     *   , O(") CHARACTER
DISABLE_ACH                          NEXT     *   , O(") CHARACTER
STMT_NO                              NEXT     *   , O(") CHARACTER
NEW_LOAN_TRAN_CODE                   NEXT     *   , O(") CHARACTER
REVOKED_BY                           NEXT     *   , O(") CHARACTER
REVOKED_DATE                         NEXT     *   , O(") CHARACTER
CHECK_STATUS                         NEXT     *   , O(") CHARACTER
value used for ROWS parameter changed from 64 to 30
Record 1: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 2: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 3: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 4: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 5: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 6: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 7: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 8: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 9: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 10: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 11: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 12: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 13: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 14: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 15: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 16: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 17: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 18: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 19: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 20: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 21: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 22: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 23: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 24: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 25: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 26: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 27: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 28: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 29: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 30: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 31: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 32: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 33: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 34: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 35: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 36: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 37: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 38: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 39: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 40: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 41: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 42: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 43: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 44: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 45: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 46: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 47: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 48: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 49: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 50: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
Record 51: Rejected - Error on table ACH_STAGING, column ACH_EFFECTIVE_DATE.
ORA-01830: date format picture ends before converting entire input string
MAXIMUM ERROR COUNT EXCEEDED - Above statistics reflect partial run.
Table ACH_STAGING:
0 Rows successfully loaded.
51 Rows not loaded due to data errors.
0 Rows not loaded because all WHEN clauses were failed.
0 Rows not loaded because all fields were null.
Space allocated for bind array:                 255420 bytes(30 rows)
Read   buffer bytes: 1048576
Total logical records skipped:          0
Total logical records read:            60
Total logical records rejected:        51
Total logical records discarded:        0
Run began on Thu Jun 03 12:43:22 2010
Run ended on Thu Jun 03 12:43:23 2010
Elapsed time was:     00:00:00.17
CPU time was:         00:00:00.10
{code}
and the data from the CSV file is
{code}
1767641     7537506     ILP     ADV     506703     MICHELLE WHITE     -40     CRE     07-NOV-08 01.36.04.000000000 PM     650               INP     PRO     N     N          54564     06-NOV-08 06.06.28.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2060997     PPD     0     0          0     N     1                    ACH
1767642     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     01-DEC-08 12.00.00.000000000 AM     76.5               INP     PRO     N     N     Updated During EOD PAY : ACH     1     28-NOV-08 09.00.17.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2061201     PPD     0     0          1     N     1                    ACH
1767643     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-DEC-08 12.00.00.000000000 AM     76.5               INP     PRO     N     N     Updated During EOD PAY : ACH     1     15-DEC-08 09.00.16.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2061614     PPD     0     0          2     N     1                    ACH
1767644     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     02-JAN-09 12.00.00.000000000 AM     76.5               INP     PRO     N     N     Updated During EOD PAY : ACH     1     31-DEC-08 09.00.55.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2063375     PPD     0     0          3     N     1                    ACH
1767645     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-JAN-09 12.00.00.000000000 AM     76.5               INP     PRO     N     N     Updated During EOD PAY : ACH     1     15-JAN-09 09.01.10.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2064023     PPD     0     0          4     N     1                    ACH
1767646     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     02-FEB-09 12.00.00.000000000 AM     76.5               INP     PRO     N     N     Updated During EOD PAY : ACH     1     30-JAN-09 09.00.22.000000000 PM     54562     06-NOV-08 01.36.04.000000000 PM     2064639     PPD     0     0          5     N     1                    ACH
1767647     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     17-FEB-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          6     N     1                    ACH
1767648     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     02-MAR-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          7     N     1                    ACH
1767649     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-MAR-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          8     N     1                    ACH
1767650     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     01-APR-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          9     N     1                    ACH
1767651     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-APR-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          10     N     1                    ACH
1767652     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     01-MAY-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          11     N     1                    ACH
1767653     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     18-MAY-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          12     N     1                    ACH
1767654     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     01-JUN-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          13     N     1                    ACH
1767655     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-JUN-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          14     N     1                    ACH
1767656     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     01-JUL-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          15     N     1                    ACH
1767657     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     16-JUL-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          16     N     1                    ACH
1767658     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     03-AUG-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          17     N     1                    ACH
1767659     7537506     ILP     PAY     506703     MICHELLE WHITE     -40     DEB     17-AUG-09 12.00.00.000000000 AM     76.5               NOP     NOP     N     Y     Cancelled during Payment By -> BUY : ACH     54605     13-FEB-09 09.03.23.000000000 AM     54562     06-NOV-08 01.36.04.000000000 PM     1778544     PPD     0     0          18     N     1                    ACH
{CODE}
Thanks & Regards,
Poorna Prasad.

Hi,
At last i was able to insert the data into the table but here i am facing another problem i the csv file i am having some null values in the data because of that only few records was inserted and remaining data was not inserted.
Here is the syntax what i am using to insert even null values are present
    ACH_EFFECTIVE_DATE "to_timestamp(:ACH_EFFECTIVE_DATE,'DD-MON-RR HH.MI.SSXFF AM')" NULLIF ACH_EFFECTIVE_DATE=BLANKSand the error what i am getting is
E:\SQL LOADER>sqlldr userid=rr/rr control=ach_staging.ctl log=ss1.log
SQL*Loader: Release 10.2.0.1.0 - Production on Fri Jun 4 12:24:32 2010
Copyright (c) 1982, 2005, Oracle. All rights reserved.
SQL*Loader-350: Syntax error at line 16.
Expecting "," or ")", found keyword nullif.
EFFECTIVE_DATE,'DD-MON-RR HH.MI.SSXFF AM')" NULLIF ACH_EFFECTIVE_DATE=
                                            ^
{code}
can any one please help me what is the correct syntax i need to user here .
Thanks & Regards,
Poorna Prasad.

How to populate the table using webservice

Hi,
i have created the web service from function module and integrated this web service in interactive form using New data connection.
I have drag and drop all field into the form table and test the form,but its not populate table.
if any script need for this,
Kindly explain in detail or give the sample code.
Thanks in advance
Parthasarathi

Dear folks
M about to create a midlet
application in which i need to populate my table
with the current stock exchange values. Since these
values get changed dynamically , I planned to use
streaming. Since m new to streaming ,pls someone
come up to guide me in right path. M using Canvas
application. I appreciate all the repliesthats fine and funny....
let me tell you something, in GCF everything you fetch through GPRS is bound to come as an inputstream and whatever request you send is passed as outputstream. so if you have worked with GCF, you have worked with streaming already. isn't it.
SD

Create Delveries(Partial) for one order using BAPI_OUTB_DELIVERY_CREATE_SLS

Hi All,
In ECC Transaction VL10A, for example for one order having 5 QTY, user can process 2 QTY and create delivery, remaining
with 3 QTY another delivery is possible.
Same way i am trying to create deliverys using BAPI_OUTB_DELIVERY_CREATE_SLS.
For Processing delivery ( giving Partial QTY ) i am using another application and that is working. But when i am trying to create
delivery for same order (which is Parial delivered), it is not allowing to create delivery. giving error.
No Instance of object type Outbound delivery has been created external reference.
No Schedule lines due for delivery upto the selected date.
Is there any other BAPI is there for like this scenario or how can i process this using this BAPI??
Please give me any help?
This is code i am using to process BAPI...
if sy-subrc is INITIAL.
    LOOP AT IT_VBAP INTO WA_VBAP.
      WA_TAB-REF_DOC    = WA_VBAP-VBELN.
      WA_TAB-REF_ITEM   = WA_VBAP-POSNR.
      WA_TAB-DLV_QTY    = WA_VBAP-KWMENG.
      WA_TAB-SALES_UNIT = WA_VBAP-VRKME.
      append WA_TAB to DEL_TAB.
    ENDLOOP.
ENDIF.
* Calling BAPI_OUTB_DELIVERY_CREATE_SLS
CALL FUNCTION 'BAPI_OUTB_DELIVERY_CREATE_SLS'
    EXPORTING
      SHIP_POINT        = lv_ship_point
      DUE_DATE          = lv_ledat
    IMPORTING
      DELIVERY          = del
    TABLES
      SALES_ORDER_ITEMS = del_tab
      RETURN            = bapi_return.
Thanks,
Venkat.

Hi Venkat,
If you check the Function Module Documentation, there is a note which mentions:
Order (SALES_ORDER_ITEMS-REF_DOC)
Unless specified otherwise, the entire order is delivered. This means that it is not necessary to list all the order items. It is sufficient to specify the order number.
Please try this.
Regards,
Pranav.

Pivoting records for reporting using streams

Hi
I would like to use streams for pivoting a records.
I have a table called employees
Dept Name
10 Larry
10 Ray
10 Philips
20 Winston
20 Gayle
Whenever records are inserted or updated or deleted in the employee table .
i would to like to pivot the records and populate a employee_report table.
Dept Name(clob feild)
10 Larry,Ray,Philips
20 Winston,Gayle
Pivoting can be done in using straight sql and ETL tools but we want to explore if this can be done using
streams and my version of Oracle is 10.2.0.4 and but open to upgrade to higher versions.
regards

How are you going to pivot it? The result of the COUNT will be 1. What operation will Streams perform at the target database?
Will it subtract from one count and add to another?
How?yes, it will.
I don't tell that is the best solution, but at least it works and easy to implement. And ones again - everything depends on requirements.
that's your source table as I understand:
PRO LINE_NUMBER CUST ORDER_DATE           DELIVERED_DATE
747         733 NWO 02-OCT-2011 13:56:16 12-JAN-2014 13:56:16and after update:
PRO LINE_NUMBER CUST ORDER_DATE           DELIVERED_DATE
737         733 NWO 02-OCT-2011 13:56:16 12-JAN-2014 13:56:16and that is the target structure - let's say airplanes_report table:
before update:
PROGRAM_ID AAL DAL NWO ILC
747        0   0   1   0after update:
PROGRAM_ID AAL DAL NWO ILC
737        0   0   1   0
747        0   0   0   0so, the dml handler would do (by UPDATE on airplanes):
1. take from LCR "old" and "new" program_id value.
2. take "old" (or "new" - doesn't matter) customer_id (NWO in this case) from the same LCR
3. substract 1 from NWO value in airplanes_report table where "old" program_id
4. add 1 to NWO value in airplanes_report table where "new" program_id
that is.

Replicaition environment from non-Oracle to Oracle using Streams

Hi guys,
I'm finding my way to establish a replication environment from any non-Oracle db to Oracle using Streams.
I've checked Oracle's documentation about this function. The answer is I have to write a custom application which will capture changes in Heterogeneous db and access pl/sql to format this changes to LCRs and enqueue these LCRs into Oracle Streams.
theoretically, we all can understand this idea, but I don't know if there's any more detailed comments on this.
Anyone have such experiences, pls give your introduction hereby, and we can make an example like replicate from Sqlserver to Oracle using Streams, or even any other techniques.
Assuming we have establish the HS connectivity using Transparent gateway.
Followups are welcomed.

Hi Yukun,
I'm developing right now an environment that will replicate changes from an Adabas (mainframe) database to Oracle. The greatest challenge is to pass your (sqlserver or other database) data to the Oracle db. When done you must have (like it is said in documentation) a manual process that will convert your data in LCRs then enqueue them. From there, it is a normal streams environment. I can (try to) answer more detailed questions if you need it. I don't have any experience with sqlserver database.
Claudine

Backup Procedure using stream in 11G

Hi,
I want to work (test) with new backup and recovery methods using streams.
I also want to know about the new backup and recovery technologies.
I will appreciate if I get the idea from this forum about it.
Madni

By the way, in the thread you are linking, you made a big "recut" or "copy&paste" of a metalink note, you should take care, copy&paste a metalink note is forbidden and break your terms of usage contracts with Oracle support.Hi Nicholas,
Thanks for the suggestion. I thought I am giving the script which I used to test streams functionality. But yes, I'm right.
Some points which makes it different from the metalink note. I request you to notice it.
1. My post doesn't describe how to establish log transfer.
2. The metalink note is explained using single schema, my post is showing with two schemas (This clarifies that two or more schemas can be managed with a single capture/apply process).
3. The metalink note doesn't describe +ve or -ve rules. I have used -ve rules to exclude database objects.
My testing started after going through that metalink note. This may be why it appeared the same to you. Apart from that I have clearly mentioned in the post that I have used that metalink note as reference(I have utilized Oracle: Replication administrator's Guide also). Believe me it's not copied and pasted.
Regards,
S.K.

Is there a need for Partial Replication ?

Partial replication is the possibility to replicate only a subset of a DIT. It can be Fractional Replication (Subset of attributes per entry), Sparse (Subset of entries) or Subtree (Only a portion of the tree).
If you have needs for partial replication, it is time to discuss with us about your requirements, your replication scenarios...
Ludovic Poitou
Directory Server Replication Architect.

There are a number of situations where partial replication would be beneficial to most organizations.
Fractional:
Various differing national laws prevent companies from sending personal information (such as home addresses and telephone numbers, and government identification numbers) into or outside of particular countries. If you wish to geographically distribute your directory services for performance reasons, non-fractional replication would make that a manual or scheduled process, likely with an LDIF intermediary of some kind. From our perspective, the need for this type of partial replication is greatest.
Sparse:
This could again be useful for companies with geographical data distribution concerns, or with specialized/purposed directory servers. How would this be accomplished - using LDAP search filters, or some other method?
Subtree:
We would be particularly interested in this type of replication for security reasons. For example, we want to have sensitive authentication/authorization information used for private administrative applications or high-security applications (such as a PKI) stored only on secured servers over which we have physical control. This would also allow us to deploy single-purpose servers (containing only a subset of our entries) where creating an additional database is not a viable option.
As our environments grow, in number of servers and in global reach, the ability to perform replication in "untraditional" (<i>i.e.</i>, non-database) ways becomes a significant product differentiator.

Partial replication of tables using streams

Similar Messages

Maybe you are looking for