Association rules ( non - transactional data)

Hi
Is there a way to calculate association rules in a table that its not in a transactional format? In my case the data is like that:
fid attribute1 attribute2 attribute3
1
2
3
If not is there an easy way to convert it to a transactional format?
Thank you very much
K

It is possible to do it with ODM using the APIs (PL/SQL and Java). One needs to be careful as, usually, data in the format like yours are not sparse. In this case you should start with a large value for support and confidence to avoid generating too many rules and running out of system resources.
ODMR 10.2, however, only supports association rules (AR) on transaction data. AR models built using the APIs can be viewed through ODMR.
--Marcos

Similar Messages

Non transactional data source and ejb transaction

Inside an ejb method with trans-attribute = Required,
Do a bunch of things using a transactional data source and a bunch of things using
a non trasnactional data source.
Looks like the time spent doing the non-transactional data source related work
does not count for the transaction timeout defined for the ejb.
So, what happens here, the ejb transaction is suspended ( when I start using the
non transactional ds ) ?

Hi,
"siddiqut" <[email protected]> wrote in message news:3fa7c79d$[email protected]..
Inside an ejb method with trans-attribute = Required,
Do a bunch of things using a transactional data source and a bunch of things using
a non trasnactional data source.
Looks like the time spent doing the non-transactional data source related work
does not count for the transaction timeout defined for the ejb.
So, what happens here, the ejb transaction is suspended ( when I start using the
non transactional ds ) ?The transaction is not suspended when you call something
which is not non-transactional.
Regards,
Slava Imeshev

Need Help for Non Transactional Data

Hi,
I need your help for getting the non-transactional data. I am looking for some solution where I can have employee list with both transaction and non transaction along with the measure in the report.
Thanks in advance.
Phani.

Looks like you either want a procedure with OUT parameters, or to return a record (which you'd need to declare somewhere that your function and calling procedure can both see)

Association rules Java API (non-transactional data)

Hi
I am looking at the demo java program (dmardemo.java) for association rules.
This iconverts the data from transactional format to non by using a nested column.
In my case the data are already non-transactional do I have to create a nested column or the model can be build based on the original columns?
Thank u
Kate

Hi Kate,
Here is what we provide for ODM 10.2 (thanks to Kathy from our doc team in compiling this for me).
The following are db docs provided by Oracle, with sections noted that contain more info on transformations.
You can go to this link to view them: http://www.oracle.com/pls/db102/homepage
Concepts - Chapter 2 (general data prep)
Application Developer's Guide - Chapters 2 (general data prep), 5 (text transformation), and 7 (Java data prep).
Java API Reference (javadoc)
PL/SQL Packages and Types Reference -- DBMS_DATA_MINING_TRANSFORM. In 10.2, the source code is still available.
Here are a few more sources:
Sample programs (The source code and embedded comments are quite helpful)
View this at: http://www.oracle.com/technology/products/bi/odm/index.html
ODMr Tutorial -- Chapter 2
View this at: http://www.oracle.com/technology/products/bi/odm/odminer.html
There is also a book on the java api that is out.
You can go to Amazon and check it out:
http://www.amazon.com/Java-Data-Mining-architecture-implementation/dp/0123704529/sr=8-1/qid=1172519948/ref=pd_bbs_sr_1/105-8560904-8042036?ie=UTF8&s=books
In ODM 11, there have been alot of improvements related to transformations, but I can say anything about that until ODM 11 is released.
Thanks, Mark

Compound char and transaction data

Hi experts
We have a new characteristic ZCONTRACT.
A few master data datasources delivers this new object with attributes.
ZCONTRACT consists of time dependent attributes and additionaly this field ZOBJ_NO (object number).
ZOBJ_NO is compounded to ZCONTRACT, reason:
ZCONTRACT
ZOBJ_NO
DATETO
DATEFROM
ZOBJ_TY
ZDISCONT
80245202
7000000458
31.12.9999
01.01.1000
1
80245202
7000000460
31.12.9999
01.01.1000
6
80245202
31.12.9999
01.01.2014
2
Characteristic ZDISCONT is time-dependent and has no relation to compounded field ZOBJ_NO.
ZOBJ_TY (object type) is delivered with ZCONTRACT and ZOBJ_NO from one datasource; at this place the valid dates are set constant.
ZOBJ_NO and ZOBJ_TY are non-transactional data relevant, meaning that there is no split or logic in the transactional data including these fields.
The business requirement is to report over ZOBJ_TY.
The idea was to use ZOBJ_TY as active navigational attribute in the infocube.
While assigning ZCONTRACT to the infocube, the compounded field ZOBJ_NO automatically is assigned to the cube.
Now, as there is no logic for this field ZOBJ_NO (and also ZOBJ_TY) in the transactional data, I recognized that it is not possible to solve it through this way.
Do you agree? Are there any other ways to realize this requirement?
Thanks

Hi Thomas,
ok, it get's a bit more complicated.
As I understood 0CML_CASHFLOW only returns ZCONTRACT, but not compounded to ZOBJ_NO. ZDISCONT is part of 0CML_CASHFLOW.
IF you follow the approach above, you have to duplicate your data from 0CML_CASHFLOW to new DSO.
Example:
ZONTRACT ZOBJ_NO 0DATETO ZOBJ_TY
1                  1                 1.1.2013    1
1                  1                  1.1.2014   2
2                  1                  1.1.2013   1
2                  2                  1.1.2014   3
As you said is ZDISCONT time-dpendent.
So data in 0CML_CASHFLOW looks like that
ZCONTRACT   0DATETO ZDISCONT
1                        1.7.2013    1
1                        1.3.2014     2
2                        1.3.2012     1
2                        1.4.2013     2
2                        1.5.2014     3
Now you have to find for each contract the correct validity period from master data and create correpsonding records:
Goal is following records in New DSO, if I understood correctly:
ZCONTRACT   ZOBJ_NO    0DATETO   ZOBJ_TY   ZDISCONT
1                               1          1.1.2013         1              1
1                               1           1.1.2014         2              2
2                               1           1.1.2013         1              2
2                                2          1.1.2014         3              3
For this you need a lookup in the endroutine in transformation from 0CML_CASHFLOW to new DSO which finds for each ZCONTRACT the corresponding ZCONTRACT master data entry and creates the ZDISCONT value in New DSO.
Regards,
Jürgen

Non-transactional datastores

In the WebLogic 5.1 documentation it mentions that for non-transactional
          datastores in a cluster that you can use a custom "dictionary" object to
          keep track of which webLogic server instance is currently hosting a given
          entity bean. This approach is used to insure the integerity for entity EJBs
          in the cluster.
          My question is, has anyone done this or does someone at WebLogic have an
          example or additional information on what all is required to implement this
          "dictionary" object?
          Thanks in advance,
          Michael


I would suggest that you use read-only entity beans for caching
          non-transactional data. Much of the data on websites is
          non-transactional and can be cached for a while.
          For transactional data, I would use a regular entity bean and incur the
          overhead of going to the db.
          -- Rob
          Michael Rousey wrote:
          >
          > I am runningWL 5.1 in a clustered environment. I have an entity bean which
          > represents a complex hierarchy of objects. I would like to be able to take
          > advantage of a caching mechanism so that every call to the bean does not
          > force a reload from the database. In order to accomplish this I need to
          > either guarantee all calls to a single instance of the bean go to a single
          > machine(so the cache is in sync with the DB), or have a clustered cache(I
          > don't want to try and tackle this). The documentation under "entity EJBs
          > in a cluster" talked about a "dictionary" object that appears to act as a
          > router. The idea is for the dictionary object to keep track of which
          > instance of the bean is deployed on a specific machine in the cluster. All
          > actors would use the dictionary to obtain the specific instance of the bean
          > they need. If the instance is new, then WL would create a new instance in a
          > normal fashion; the dictionary object would keep track of the new instance
          > and forward and new request to the machine where the instance was created.
          > This is similar to factory based routing in WLE.
          >
          > Any help on how to implement this or any additional ideas would be helpful.
          >
          > Thanks,
          >
          > Michael
          >
          > "Rob Woollen" <[email protected]> wrote in message
          > news:[email protected]...
          > > Hmm, I'm not sure what the docs were talking about here.
          > >
          > > Can you provide some more details about what you are trying to do?
          > >
          > > -- Rob
          > >
          > > Michael Rousey wrote:
          > >
          > > > In the WebLogic 5.1 documentation it mentions that for non-transactional
          > > > datastores in a cluster that you can use a custom "dictionary" object to
          > > > keep track of which webLogic server instance is currently hosting a
          > given
          > > > entity bean. This approach is used to insure the integerity for entity
          > EJBs
          > > > in the cluster.
          > > >
          > > > My question is, has anyone done this or does someone at WebLogic have an
          > > > example or additional information on what all is required to implement
          > this
          > > > "dictionary" object?
          > > >
          > > > Thanks in advance,
          > > >
          > > > Michael
          > >

Data for Association rules

Hi,
I want to apply an AR model to data that are not "Transactional Data" but "Single-record case data".
Is it possible to do it with Oracle Data Miner (SQL3) ?
The docs says :
"Association Rules is normally used with transactional data, but it can also be applied to single-record case data (similar to other algorithms)."
But I don't found how !
TKS

Hi,
The Association node in ODMr only takes transactional data input, BUT, you can create a AR model using 2d data using the API and then use the Model node in ODMr to pull the AR model in for viewing.
See simple script below that can be run in SQL Developer Worksheet as a script:
BEGIN
DBMS_DATA_MINING.CREATE_MODEL(
model_name => 'AR_2D_MODEL',
mining_function => dbms_data_mining.association,
data_table_name => 'mining_data_build_v',
case_id_column_name => 'cust_id');
END;
See the server api for more details on how to change the default settings for the create_model operation.
http://www.oracle.com/technetwork/database/options/odm/odm-documentation-170506.html
Thanks, Mark

Bill Presentment Architecture, how to Overide Default Rule and ensure the AR Invoice/Transaction Chooses "Customer Transaction Data Source"

Hi Intelligentsia,
we are on 12.2.4 on linux, i have setup external template with supplementary Data source as "Customer Transaction Data Source", when i test it fails, i am not able to debug it , however when i run the BPA Transaction Print Program (Multiple Languages) it always gives me the default layout.
Query is
How do i ensure the Default rule Does not apply to my Invoice and i am able to override it
is there a method to explicitly Ensure the Supplementary Data Source as "Customer Transaction Data Source", when i am creating the AR Invoice/ Transaction? Am i missing some setup in AR Invoice Transaction Flexfield where i need to setup this "Customer Transaction Data Source" as the DFF Context ?
please let me know if you need any more information.
Abdulrahman

Hello,
Thanks for the answer. When you say rule data is that Rule creation date or the "Bill Creation From Date" that we setup while creating the rule? I have created a new invoice after the rule created, but it did not pick the new custom template.
I have another issue. It would be greate if you could help. I have split my logo area into 2 vertically to display logo in one and legal entity and addres on the other one. In the Online Preview I can see the logo and Legal address. But in the print preview , i am not able to see them. It just shows a blank space. Any Idea?
Thanks in advance

Association rule in SQL Server Data Mining

I have been working on a problem on association rules in SQL Server Data Tools (Visual Studio 2008) for quite a while but have not yet been able to figure out the solution.
The problem is: I have a table named Sales_history in my SQL database. This table has following columns: CustomerID, ItemID, Month (from May2012 to April 2013), QtyShipped. I am looking to find association between Items and i want to provide recommendation
to the Customer (In this case CustomerID) based on their purchases.
Note: there are around 630 customers and about 34000 products in my table.
My approach:
I marked History_Table as both Key and nested. And in the Key, i checked CustomerID as input and Key whereas in nested, i checked ItemId as Key, input and Predict.
When i run the model, i get a solution but i am not sure if i am configuring it right. Also i am not sure how i can write prediction join query to generate Item recommendations . I am really struggling with
this problem, eagerly waiting for the reply. Thank you.

Hi Tatyana,
Thank you so much for your reply. I have now been able to create the data mining model using association rule and by writing a DMX query, i am able to generate the item recommendations to be given to customers for items they have purchased. However, i have
noticed one thing that in the DMX query, it gives the same item recommendation for any item i put inside the query.
Also, if i put any item in the DMX query from the generated list of recommended items, the output of that query also shows the item that is inputted inside the query.
Here is the query, that i am writing to generate item recommendations
SELECT predictassociation (CrossSellingModelV3.[Ztb Customer Item v3],INCLUDE_STATISTICS,5)
FROM CrossSellingModelV3
NATURAL PREDICTION JOIN
(SELECT
(SELECT '17IS56126' as m )
AS Ms)
AS t
What can be the possible reason behind this? Is this something related to the kind of data i have? In my data, there are 632 distinct customers and 34000 distinct products.
If i execute this query in management studio.
select customer_CD, COUNT(Item_CD) from ztb_Sales_History
group by customer_CD
order by 2 desc
the output shows that there are some customers who have bought just 1 item and also there are customers who have bought 2400 items. i mean the range is very high.

How to store data in NON -Transactional ODS

Hi,
for reporting reasons I wish to store data in non-transactional ODS. Reading in this forum I found only the standard fm 'RSDRI_ODSO_MODIFY' but this fm is used only for transactional ODS.
Any suggestions?
Thanks in advance.
Regards,
Giovanni

First of all, many thanks for the quick reply.
To focus on my problem I have the necessity to realise what it is detailed in a document at this url:
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/60938938-de6f-2910-2080-fc80d38ebfec
Working in SEM environment I have the necessity to handle text field in a non-transactional ODS for reporting without using an InfoSet.
Observing the exceptions raised by calling the fm 'RSDRI_ODSO_MODIFY' it is possible to find the ODS_TYPE_NOT_TRANSACTIONAL showing that a non-transactional ODS is not handled.
I hope to have explained my intention and my problem and I'm confident to receive your support.
Thanks.
Giovanni

Transfering Master and Transaction data to active and non active versions

Hi Gurus,
I am planning to transfer ECC master and transaction data to APO active and simulation versions.My question is
1. Is it possible to release Master and transaction data to active and non active versions ?
2. How i need to config if i want to release Master and Transaction data in version 001?
Please let me know .
Thanks in Advance
Regards,
Raj

Hi Raj,
1) Once you create active integration models for master data and
transactional data, the data will get updated in active version 000
2) For creation of non active version use transaction
/SAPAPO/MVM
3) For copying of data from active to non active version, use
transaction /SAPAPO/VERCOP
Regards
R. Senthil Mareeswaran.

Generate Association rules using Oracle 10 g Data Mining Tool

Hi,
How to Generate Association rules using Oracle 10 g Data Mining Tool ?

As far as I remember in 10g it is pretty much the same
http://download.oracle.com/docs/cd/B28359_01/datamine.111/b28129/market_basket.htm
Regards,
Husnu

Need more Info about "Load transactional data when master data not loaded"

Hi,
Can you please explain me this option in the infopackage " Load transactional data when master data is not loaded"....
Say i load a transactional data record which has a material no. AAAXX.
In the fact table, the material no. is replaced with the corresp. DIM ID.
Now, assume that there is no entry for this Material no.
AAAXX in the master data table...so no DIM ID for it..
How is it then stored in the fact table ?
Hope i have managed to explain the scenario..
Thanks in advance,
Punkuj

Hello Punkuj K,
How r u ?
No, if the entry for that Material Number "AAAXX" is not there in the Master Data then it will create a SIDs & DIMs ID for that & Transaction Data will be loaded.
Use
Choose this indicator if you want to always update the data, even if no master data for the navigation attributes of the loaded records exists. The master data is generated from the loaded transaction data. The system draws SIDs. You can subsequently load the master data.
Dependencies
The texts, attributes, and hierarchies are not recognized by the system. Load the texts / attributes / hierarchies for the corresponding InfoObjects separately.
This function corresponds to the update. Possible errors when reading the master data into the update rules are not associated with this indicator.
Recommendation
We recommended loading the master data into the productive systems in advance. Select this indicator especially in test systems.
Best Regards....
Sankar Kumar
+91 98403 47141

Non-transactional cursor writes block reads

I'm opening a cursor without using a transaction like so:
CursorConfig conf = new CursorConfig();
Cursor cursor = db.openCursor(null, conf);
I then iterate over the items, sometimes replacing a value. I want to be able to read (and maybe write) to any value from another thread while the cursor is still open, but gets result in the following error:
com.sleepycat.je.DeadlockException: (JE 3.3.74) Lock expired. Locker 32098350 -1_NioProcessor-3_ThreadLocker: waited for lock on database=settings LockAddr:1537969 node=2623139 type=READ grant=WAIT_NEW timeoutMillis=500 startTime=1229438453225 endTime=1229438453730
Owners: [<LockInfo locker="11743647 -1_NioProcessor-1_ThreadLocker" type="WRITE"/>]
Waiters: []
I would have expected that outside a transaction any update made through a cursor would be applied immediately, but instead the record is locked until the cursor is closed. This happens whether or not je.env.isTransactional is set to true.
Setting je.env.isLocking to false gives me the cursor behaviour that I want, but I'm not sure what else is affected by this setting, and the javadoc comment is just vaguely worrying rather than helpful ("This property should be set to false only in special circumstances when it is safe to run without record locking.")
I am not planning on using any transactions in this application.

Cormac,
I was looking through the documentation for a reference page to direct you to, and I realized that probably the clearest explanation in the javadoc is in the com.sleepycat.je.LockMode page here: [http://www.oracle.com/technology/documentation/berkeley-db/je/java/com/sleepycat/je/LockMode.html]. There is a reference to it from the CursorConfig page, but I can see that the link between the two pages is not that clear.
From the LockMode javadoc, there is this paragraph.
bq. Locking Rules \\ Together with CursorConfig, TransactionConfig and EnvironmentConfig settings, lock mode parameters determine how records are \\ locked during read operations. Record locking is used to enforce the \\ isolation modes that are configured. Record locking is summarized below for \\ read and write operations. For more information on isolation levels and \\ transactions, see [Writing Transactional Applications|http://www.oracle.com/technology/documentation/berkeley-db/je/TransactionGettingStarted/index.html]. \\ With one exception, a record lock is always acquired when a record is \\ read or written, and a cursor will always hold the lock as long as it is \\ positioned on the record. The exception is when [READ_UNCOMMITTED|http://www.oracle.com/technology/documentation/berkeley-db/je/java/com/sleepycat/je/LockMode.html#READ_UNCOMMITTED] \\ is specified, which allows a record to be read without any locking.
Transactional cursors, by default, hold all locks until the cursor is closed. In your case, you are using a non transactional cursor, and locks are not collected the same way. But a lock for modified record is still taken in a non transactional cursor, and is held as long as the cursor is positioned at that record, to provide cursor stability. I am guessing that is what is happening in your case. If you close the cursor or move to a different position, you will be releasing the lock.
In a second posting, you comment on your experiences using the je.env.locking property. That property is really only to be used in cases where the application is very constrained and has high performance requirements; frankly, that was put in for a particular set of power users and we really don't recommend it for general purpose use. (We should doc it better too). One characteristic is that it disables log cleaning, because the lack of locks makes it impossible for us to properly coordinate access to the data from the log cleaning threads.
Regards,
Linda
Edited by: Linda Lee on Dec 16, 2008 2:19 PM (changed " link between the two pages is that clear" -> not that clear)

Problems with Association Rules

Hi all,
I am trying to use ODMr to run association rules and am getting the following error message:
Server task state: error
Server task detail:
ORA-40101: Data Mining System Error ORA-40101: Data Mining System Error ORA-40101: Data Mining System Error ODM_ASSOCIATION_MODEL-BUILD--20010
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 105
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 144
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 1396
ORA-00902: invalid datatype
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 105
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 144
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 1396
ORA-06512: at "DMSYS.DBMS_DATA_MINING", line 305
ORA-06512: at "DMSYS.DBMS_JDM_INTERNAL", line 157
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 86
ORA-06512: at "DMSYS.DBMS_JDM_INTERNAL", line 179
ORA-06512: at line 1
This error is generated on the sample data as used in the ORACLE 10G Release 2 Data Mining Tutorial, and on other datasets that I tried.
My sense is that the algorithm is expecting data in the datatype of DM_NESTED_NUMERICALS, even though the documentation asks for transactional data. When I converted to nested columns, the prog errored out again as it was expecting a number rather than nested column.??

Hi Carolyn,
I reviewed the tutorial and tested out the example for Association Rules. The example uses SH.SALES and SH.PRODUCTS.
It worked fine.
ODMr converts the "transactional" data, in the case of Association Rules, into DM_NESTED_NUMERICALS.
When ODM documentation refers to transactional data, it implies the use of nested columns. This can be confusing given that older versions of ODM actually supported a "transactional format", which is now supported only through nested columns.
I copied the following view definition that was passed in to ODM to build the Association Rules model (based on the tutorial noted above). Take a look at them to get a better understanding on what ODMr is doing to prepare the data.
If you can give us a specific example including the tutorial table you used and the settings you specified in the Association Rules Wizard, I can review that to see what the problem might be.
Thanks, Mark
SELECT caseTable."DMR$CASE_ID", txnTable1."PROD_ID" FROM "DMUSER"."DM4J$VSALES657013432" caseTable, (SELECT "DMR$CASE_ID", CAST(COLLECT(DM_Nested_Numerical("NAME", "VALUE")) AS DM_Nested_Numericals) "PROD_ID" FROM "DMUSER"."DM4J$SALES423975876" GROUP BY "DMR$CASE_ID") txnTable1 WHERE caseTable."DMR$CASE_ID" = txnTable1."DMR$CASE_ID"
The view makes references to other tables/views defined below:
DM4J$VSALES657013432 is shown below:
SELECT distinct "DMR$CASE_ID" FROM
(SELECT "CUST_ID","TIME_ID", DENSE_RANK() OVER (ORDER BY "CUST_ID","TIME_ID") DMR$CASE_ID FROM "SH"."SALES")
ORDER BY "DMR$CASE_ID"
DM4J$SALES423975876 is shown below:
SELECT DMR$CASE_ID, CAST("PROD_ID" AS VARCHAR2(30)) as NAME, 1 as VALUE
FROM
(SELECT "PROD_ID", "CUST_ID","TIME_ID", DENSE_RANK() OVER (ORDER BY "CUST_ID","TIME_ID") DMR$CASE_ID FROM "SH"."SALES")
ORDER BY DMR$CASE_ID

Association rules ( non - transactional data)

Similar Messages

Maybe you are looking for