Hiding Sensitive Association Rule for Sanitization algorithm implementation

Hello Sir,
I am doing my research in the area of Data Mining and my problem is hiding industrial information using Hiding Sensitive Association Rule. If anybody having Sanitization process and algorithm implementation using Java.
If anybody having relate materials, algorithms implementation, documentation and related web address. Please send to my mail id: [email protected]
Regard
Kannan
Message was edited by:
user591845

And your version of Oracle is?
If 10g look into using Transparent Data Encryption (TDE). You can find docs on it at http://tahiti.oracle.com.

Similar Messages

Two Parameters for Association Rules Algorithm

I'm working on association rules algorithm dmx.
every sample is just on parameter. Like Product name. Then algorithm find correlation with products.
But in my db has many products that is the same name but different supplier name. So i must to calculate and find relation by supplier name and product name. Do you have any idea or sample?

Hello -- if you look at the "Sample Excel Data" which comes with the Excel data mining add-in, there is a table in there which shows the layout. There would be one record per product, and then you could have multiple records per supplier.
Or you could be saying that the transactions have multiple combinations of products and suppliers. In that case, you can perform the analysis either on the supplier or the product. Since the product names are same across suppliers, I would concatenate
product and supplier together into a single field.
Mark Tabladillo PhD (MVP, SAS Expert; MCT, MCITP, MCAD .NET) http://www.marktab.net

Association Rules - algorithm ?

Hi all,
I have created an association rules model in Oracle 10.2.0.3 and the rules came out fine however i can not understand why Oracle makes all permutations of the items and create rules for them.
For example if i have a shooping basket of items milk,eggs and bread then i get rules like these
if milk = 1 & bread =1 then eggs =1 support - 0.566 confidence 94.555
if milk = 1 & eggs =1 then bread = 1 support - 0.678 confidence 92.89
How does it put items in if and then and what sort order it follows to do so.
Aren't the 2 rules essentially saying the same thing.
Can anyone familiar with the Apriori Algorithm explain how Oracle creates the rules.
Thanks a lot !!

Sorry for the confusion, it was a mistake on my part.The Support is same in both cases, the confidence is different.
One thing that's still confusing to me is how Oracle is implementing the algorithm.Creating a pl/sql package also did not clarify it much.
I could see the internal tables but to actually see the code that creates those tables would be helpful.
I have made some good progress into getting reasonable results but the underlying process is still not very clear.
Thanks,
PB

Data for Association rules

Hi,
I want to apply an AR model to data that are not "Transactional Data" but "Single-record case data".
Is it possible to do it with Oracle Data Miner (SQL3) ?
The docs says :
"Association Rules is normally used with transactional data, but it can also be applied to single-record case data (similar to other algorithms)."
But I don't found how !
TKS

Hi,
The Association node in ODMr only takes transactional data input, BUT, you can create a AR model using 2d data using the API and then use the Model node in ODMr to pull the AR model in for viewing.
See simple script below that can be run in SQL Developer Worksheet as a script:
BEGIN
DBMS_DATA_MINING.CREATE_MODEL(
model_name => 'AR_2D_MODEL',
mining_function => dbms_data_mining.association,
data_table_name => 'mining_data_build_v',
case_id_column_name => 'cust_id');
END;
See the server api for more details on how to change the default settings for the create_model operation.
http://www.oracle.com/technetwork/database/options/odm/odm-documentation-170506.html
Thanks, Mark

Implementing a custom matching rule for AR lockbox

I need to Implement a custom matching rule for AR lockbox.
Client has a requirement like to match with pack slip.
Any one have the coding for this?
Kindly help me to solve this.

I need to Implement a custom matching rule for AR lockbox.
Client has a requirement like to match with pack slip.
Any one have the coding for this?
Kindly help me to solve this.

How to Implement Dynamic Modification Rule for Material & multiple vendor Combination

Hi Team,
In dynamic modification rule for Material & vendor combination, i have maintained material & vendor in Inspection plan at Material Assignments
1.If i purchase same material from different vendors then how to implement ?

Hi Balaji,
I am not sure if i have followed your requirement.
What do you want to do with Vendor Z? Do you want to inspect each lot from Z?
If yes:
Then Create 2 Inspection plans with same Operations and Same MICs, In Material Assignment, mention Vendor as Z so that 1st inspection plan will only be for Vendor Z. Do not enter DMR in Header.
In 2nd inspection plan Enter DMR and do not mention any vendor so this plan will be applicable for all vendors except Z.
If No:
Then create Qm info record for vendor Z with "No inspection" set in QI06.
Amol.

Problems with Association Rules

Hi all,
I am trying to use ODMr to run association rules and am getting the following error message:
Server task state: error
Server task detail:
ORA-40101: Data Mining System Error ORA-40101: Data Mining System Error ORA-40101: Data Mining System Error ODM_ASSOCIATION_MODEL-BUILD--20010
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 105
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 144
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 1396
ORA-00902: invalid datatype
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 105
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 144
ORA-06512: at "DMSYS.ODM_ASSOCIATION_RULE_MODEL", line 1396
ORA-06512: at "DMSYS.DBMS_DATA_MINING", line 305
ORA-06512: at "DMSYS.DBMS_JDM_INTERNAL", line 157
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 86
ORA-06512: at "DMSYS.DBMS_JDM_INTERNAL", line 179
ORA-06512: at line 1
This error is generated on the sample data as used in the ORACLE 10G Release 2 Data Mining Tutorial, and on other datasets that I tried.
My sense is that the algorithm is expecting data in the datatype of DM_NESTED_NUMERICALS, even though the documentation asks for transactional data. When I converted to nested columns, the prog errored out again as it was expecting a number rather than nested column.??

Hi Carolyn,
I reviewed the tutorial and tested out the example for Association Rules. The example uses SH.SALES and SH.PRODUCTS.
It worked fine.
ODMr converts the "transactional" data, in the case of Association Rules, into DM_NESTED_NUMERICALS.
When ODM documentation refers to transactional data, it implies the use of nested columns. This can be confusing given that older versions of ODM actually supported a "transactional format", which is now supported only through nested columns.
I copied the following view definition that was passed in to ODM to build the Association Rules model (based on the tutorial noted above). Take a look at them to get a better understanding on what ODMr is doing to prepare the data.
If you can give us a specific example including the tutorial table you used and the settings you specified in the Association Rules Wizard, I can review that to see what the problem might be.
Thanks, Mark
SELECT caseTable."DMR$CASE_ID", txnTable1."PROD_ID" FROM "DMUSER"."DM4J$VSALES657013432" caseTable, (SELECT "DMR$CASE_ID", CAST(COLLECT(DM_Nested_Numerical("NAME", "VALUE")) AS DM_Nested_Numericals) "PROD_ID" FROM "DMUSER"."DM4J$SALES423975876" GROUP BY "DMR$CASE_ID") txnTable1 WHERE caseTable."DMR$CASE_ID" = txnTable1."DMR$CASE_ID"
The view makes references to other tables/views defined below:
DM4J$VSALES657013432 is shown below:
SELECT distinct "DMR$CASE_ID" FROM
(SELECT "CUST_ID","TIME_ID", DENSE_RANK() OVER (ORDER BY "CUST_ID","TIME_ID") DMR$CASE_ID FROM "SH"."SALES")
ORDER BY "DMR$CASE_ID"
DM4J$SALES423975876 is shown below:
SELECT DMR$CASE_ID, CAST("PROD_ID" AS VARCHAR2(30)) as NAME, 1 as VALUE
FROM
(SELECT "PROD_ID", "CUST_ID","TIME_ID", DENSE_RANK() OVER (ORDER BY "CUST_ID","TIME_ID") DMR$CASE_ID FROM "SH"."SALES")
ORDER BY DMR$CASE_ID

Association Rule Model Fails to Build

Hi all
I am running the association rules model (java api) and sometimes when I use attributes from lower hierarchies the model fails to complete and runs for
ever. In addition when I stop the process from netbeans the hard disk indicator remains permenantly on and my computer is really slow and I am unable to access anything. My attributes are quite long strings (include also gaps). Do you think that affects the model?
Thank u
K

Based on the number of rows and transactions, you are averaging 23.5 items per transaction. With only 80+ items and a few value combinations for each, my guess is that the baskets are quite dense. Many of the transactions will contain a decent-sized portion of the item name-value combinations.
Association rules has a parameter to limit the length of the rules that are generated. Have you set this to try limiting to shorter rules? Have you tried a maximum of length 2 to see if it completes? My guess is that the density of the data leads to exponentially larger combinations of rules as the length of the rule increases, and this requires more memory.
Please try to constrain the rule length to experiment. Once you have short rules (single antecedent item), take a look and see how many rules and itemsets are generated at your provided support and confidence levels (support will constrain itemsets, and support plus confidence will constrain rules). Try to increase the maximum rule length by one more, and see how fast the count of rules and itemsets expand.
This should help understand more about your data and the correct choice of algorithm parameters.
Ari

Association rules - memory issue

Hi everyone,
I'm testing oracle data mining to generate a high number of association rules, starting from a table containing around 100 columns and 1800 lines. I transformed the table in a view as shown with the market basket demo, but I'm still having a memory error each time I'm trying to launch the data mining process.
I've tried with a table containing less columns and lines, and it worked fine.
Is there a way to set ODM to allow it to process this big table and generate millions of association rules without having some memory errors ?
Is it possible to find how exactly the apriori algorithm works, I mean to find if the sql process is only working with the RAM and writes in the database in the end, or if it commits into the database during the process (before exploding memory).
Merry christmas by the way !!!!!

Hi,
thanks again for your reply. I tried the tweak with the shared_pool_size, and I'm still having some memory issues.
Do you know how the model is build, and how it works technically ?
I can see that itemsets and rules are created when you build the model. Is it stored in a procedure (which applies the apriori algorithm), computes the model and then stores the rules generated into the database during commit ?
In this case all the process (model building) is stored in RAM, am I right ?
And that's why the process crash when there are too much data processed. Is it possible to avoid this, I mean commit the rules even during the process to free some RAM space in order to continue the rule generation ?

Association rules Java API (non-transactional data)

Hi
I am looking at the demo java program (dmardemo.java) for association rules.
This iconverts the data from transactional format to non by using a nested column.
In my case the data are already non-transactional do I have to create a nested column or the model can be build based on the original columns?
Thank u
Kate

Hi Kate,
Here is what we provide for ODM 10.2 (thanks to Kathy from our doc team in compiling this for me).
The following are db docs provided by Oracle, with sections noted that contain more info on transformations.
You can go to this link to view them: http://www.oracle.com/pls/db102/homepage
Concepts - Chapter 2 (general data prep)
Application Developer's Guide - Chapters 2 (general data prep), 5 (text transformation), and 7 (Java data prep).
Java API Reference (javadoc)
PL/SQL Packages and Types Reference -- DBMS_DATA_MINING_TRANSFORM. In 10.2, the source code is still available.
Here are a few more sources:
Sample programs (The source code and embedded comments are quite helpful)
View this at: http://www.oracle.com/technology/products/bi/odm/index.html
ODMr Tutorial -- Chapter 2
View this at: http://www.oracle.com/technology/products/bi/odm/odminer.html
There is also a book on the java api that is out.
You can go to Amazon and check it out:
http://www.amazon.com/Java-Data-Mining-architecture-implementation/dp/0123704529/sr=8-1/qid=1172519948/ref=pd_bbs_sr_1/105-8560904-8042036?ie=UTF8&s=books
In ODM 11, there have been alot of improvements related to transformations, but I can say anything about that until ODM 11 is released.
Thanks, Mark

Oracle for genetic databases: implementations, overviews?

I'm interested in obtaining information on Oracle
implementations incorporating large volumes of information on &
including: genetic experiments (i.e., gene codes or
identifiers), optics (wavelengths, intensities, etc.) &
increases in cell growth. I'm going to be interested in Oracle
datamining &/or datawarehousing in order to get information out
of this that is not otherwise going to be obvious by looking at
it. Is there a general overview of other implementations of
Oracle (8i or 9i?) like this in the field? I'd be very grateful
for info...thanks,
Noel Whelan

Kevin,
I would definitely focus on 9i as we've added many new features that are relevant for bioinformatics. NEW in 9i:
- Ability to store and search XML data types
- Data mining embedded natively within database (Naive Bayes and Association Rules in 9i, Clustering and Decision Trees (using adaptive Bayes networks) in 9iR2)
- UPSERT (facility to fast update a record or insert a new record). Great for updating life science data.
- IFS forcollaboration and centralized storage of external data types such as powerpoint, word, etc. docs. Users can drag & drop files into IFS for storage, management and access within the database.
- Table Functions to allow piplined "C" procedures for performance improvements of compute intensive operations.
Many useful features are already in 8i (see below) but have been updated or now can be integrated with new 9i features:
- Gateways for native access to external data sources
- External tables for ability to make an external table appear equivalent to a native Oracle table so you can query and perform operations on.
- Oracle Text for efficient text searches
- Oracle InterMedia for storage of image, video etc. data types and ability to perform basic queries and operations on them.
- Oracle Workflow for automating processes within the database. E.g Upload data from GenBank, Mine data to find "targets" and distribute reports to appropriate scientists.
- Oracle Portal to facilitate collaboration and set up company "My.company.com" standard portals with personalized information, reports, etc.
- Oracle Thesaurus so you can define multiple synonyms for a word, gene or pathogen etc.
- Extensible indexing to enable efficient search and retrieval functions for complex domains such as text, spatial, image, chemistry, proteomics and genomics
But, bottom line, I'd jump to the new release. Check OTN and Oracle University for technical information and training materials.
cb
Dear Charles Berger,
How can I see the Internal LInks that you posted?
They look useful as I am a student in bioinformatics currently taking an intro course to database systems and will be implementing a db in Oracle8i.
Also, would you suggest I try to work with 9i and skip 8i. THe problem I have is that all the books and documentation I have is for 8i. Is 8i already history?
Kevin
[email protected]

Data not coming from DOE to Mobile After defining Rule for device attribute

Hi All,
I have created a DO and rule for it.In case of Bulk Rule for all definition when i triggere extract from Portal then all the data comes to outbound queue but when i define rule for Device attribute then no data comes to my Outboun queue.Here is the scenario what i am doing :
1. I have order header in my backend which has a field named "Work_Center" and this will be criteria field.
2. In CDS table i have all the records for all the work center.
3. Now in RMM under customized , i have added an attribute named "Work_center".
4. Now i defined a rule with Device attribute mapping and activated the rule.
5. Now on Portal i assigned this data object and in the device attribute tab i assigned the value(this value exist in CDS table for few orders) of a Work center to the attribute "Work_Center" .
6. Then i triggrere extract but its Outbound queue is empty, what could be the reason.
Is my approach is correct
Regards,
Abhishek

Hi Abhishek,
You can check one ore thing, after you have performed all the steps till step 5, i.e. just before triggering
extract. Check if the AT table for ur DO has entries based on the criteria specified by you...
1. In the workbench click on the Data Object, and then right click and select "View Metadata".
2. Select Distribution Model tab.
3. Now select your DO's Association table.
4. For the input field DEVICE ID specify your corresponing device id,and also for status field specify it
as "I" and execute
If there are any entries now in the AT table, and on triggering extract if they are not coming to the
outbound Q there is some EXTRACT Q blocked. And is there were no entries in the AT then the rule
specified is not the satifying.
Thanks,
Swarna
Now if you have entries w

Error when activating update rules for R/3 training and event management

hi all,
when iam trying to activate update rules for training and event management cube it is giving fallowing error."IC=0PE_C01 IS=0HR_PE_1 error when checking the update rules
Message no. RSAU461".
please guide me how to solve this issue.
thanks & regards
Vamshi D Krishna

Hi Vamsi,
Have you followed the following document to implement HR ?
https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/a0780530-bf03-2b10-d5ad-e9e8a53def23

Capital Project Settlement Rule for lower WBS

Hello,
At my present client, for Investment projects the client want to settle top level WBS to AUC and capitalise it. So ideally the cost from lower level WBS should flow to top WBS. I am using substitution to remove investment profile from lower WBS.My concern is how do I auto populate the settlement rule for lower WBS to top WBS. I am aware about settlement strategy and OSS note 211324 (however dont want to implement this note)
The appraoch I am looking for is using "WBS_SETTLEMENT_RULE' BAdI . However this BADI calls for strategy and I could not maintain the required strategy (settlement to top WBS). Is there some BADI/Function module available which can be called for updating the settlement rules on lower WBS while saving or Release ? Can I make use of exits in Substitution?
Please let me know your opinions.
Thanks
Sarang

Thanks Virendra. I agrree the only approach is development. But I need to give inputs to my developer.
We tried with BADI "WBS_SETTLEMENT_RULE" but it didnt work as it calls strategy in configuration.
So I am checking for some other options for e.g "WORKBREAKDOWN_UPDATE" which is called during save or Fn modules K_SETTLEMENT_RULE_FILL or K_SETTLEMENT_RULE_SAVE which I can use. This is a client requirement to create AUC only at top level n all cost to be rolled up to superior WBS n then settle to AUC.
The other option I was thinking is of using exits thru substitution.
What will be the best approach?
Thanks
Sarang

Error in global conversion rule for InfoObject 0PERSLANGU when activating

Dear Experts
We are working on HR in BI7.0 with Ehp1.
I am trying to Activate the Transfer Rules of 0HR_PA_PA_1 DataSource which has the BID (BW Development) as the Source System to itself in order to load 0PAPA_C02 (Headcount) InfoCube.
When trying to Activate, it gives the following error message:
Error in global conversion rule for InfoObject 0PERSLANGU
Message no. RSAR263
Diagnosis
Errors with the global conversion rule for the field 0PERSLANGU.
System Response
The function module delivers the following error message:
Incorrect statament: Expression missing Operand mi
Procedure
Check the definition of the global conversion rule for an InfoObject.
In fact, we are Re-implementing 3.0b BW System in new BI7.0 Ehp1 System. I have checked the Config of InfoObject 0PERSLANGU to the one available in existing BWP (3.0b Production) system and it's all the same.
Has anyone come across similar error message and how did you resolve. Any help is very much appreciated.
Many Thanks,
Chandu

HI Chandu ,
It is a bug in the system , can you take a look at the SAP note
Note 1070702 - RSAR 263: Error in global conversion rule for InfoObject
Hope it helps ,
Regards,'
Sathya

Hiding Sensitive Association Rule for Sanitization algorithm implementation

Similar Messages

Maybe you are looking for