Anbody used Hash partioning? - what about queries not using partition key

Hi there,
We have a table, will have over 3 billion rows when loaded and wish to implement partioning.
Brief structure
cal_id -- relates to date of transaction
prod_id
cust_id,
sales_qty
The id's are all surrogate id's/dimension keys
About 80% of queries expected to use by on_sale_date of product rather than date of transaction hence considering using hash partition on product_id.
Queries will hit > 1 partition in general and also some e.g 15% of queries wil be by date of transaction.
Qusetions I have - how will these 15% of queries be affected. I expect will be poorer performance-wise because of partioning but becuase of size of table and 80% queries by product have to use partition.
Also will partition-pruning work if queries use between rather than = operator
Anbody used hash partioning - keen to hear other people's ideas/experience with hash partioning.
Many Thanks

Hi,
When partition pruning is not used, then that depend on the access path.
If it does a full table scan, then there is nearly no overhead to full scan all partitions (compared with full scanning the same non-partitioned table)
If it is an index access and if indexes are local, then all indexes must be read. But with global index, again, there is no overhead in comparison with a non-partitioned table (except that indexes are a bit larger when global on partitioned table)
However can be expected to partition even when reading all partitions, especially with parallel query.
the between is not optimal with hash partitions, s it is hash partition, not range partition.
Regards,
Franck.

Similar Messages

  • How do I find out what features are not useful in my Classifier?

    How do I find out what features are not useful in my Classifier? I am trying to trim down the number of features to speed up the training of my data, I have about 3700 features. I have found the Filter Based Feature Selection Module and have not been successful
    in using it. I have looked through all the examples and have not been able to find any examples using the module. Will the Filter Based Feature Selection Module help me to trim features. If so how do I use it?

    One way to do this would be is to use a random forest classifier. Feature/variable importance can be obtained relatively easily with random forests. 
    Here is how you may do it in R.
    > install.packages('randomForest') #install randomForest package in R if it is not already there
    > library(randomForest) # reference the library
    > data(mtcars) # load motor cars data that ships with 
    #train a random forest 
    > mtcars.rf <- randomForest(mpg ~ ., data=mtcars, ntree=1000,keep.forest=FALSE, importance=TRUE)
    > importance(mtcars.rf)
    > importance(mtcars.rf)
    #You will see an output like below
           %IncMSE IncNodePurity
    cyl  16.168645     169.96741
    disp 18.672188     260.08722
    hp   17.584375     184.95007
    drat  6.948743      63.54528
    wt   17.818509     254.30347
    qsec  4.772889      33.25546
    vs    5.303058      24.39064
    am    5.210181      17.36626
    gear  4.619161      21.55450
    carb  8.577037      28.46715
    # or plot the importance as follows
    > varImpPlot(mtcars.rf)
    What this tells you is how important predictors/features/variables like horsepower(hp), weight(wt), no. of cylinders (cyl) is in predicting miles per gallon (mpg).
    If you are wondering how the data looks like. Try this
    head(mtcars) # gives first few lines of the data set.
     mpg cyl disp  hp drat   wt ... 
    Mazda RX4     21.0   6  160 110 3.90 2.62 ... 
    Mazda RX4 Wag 21.0   6  160 110 3.90 2.88 ... 
    Datsun 710    22.8   4  108  93 3.85 2.32 ... 
    . Try this
    Here is a few useful resources:
    Random Forest documentation (Check out the pages on variable importance and variable importance plot)
    http://cran.r-project.org/web/packages/randomForest/randomForest.pdf 
    Motor cars data: http://stat.ethz.ch/R-manual/R-devel/library/datasets/html/mtcars.html

  • How to tell what methods where not used in the code?

    Hi there,
    I wonder if there's a way to check what method are not used in the execution code (void main).
    Example:
    in the code below, the following method where not used:
    setAge, getAge, getName,setName, addFeedback
    public class Test
         public static void main(String args[])
              Employee empl = new Employee("John", 54);
              System.out.println(empl.getDeatils());
    public class Employee
         private int age;
         private String name;
         public Employee(String name, int age)
              this.name=name;
              this.age=age;
         public String getDeatils()
              return name+" ("+age+")";
         public void addFeedback()
              //do something here.
         public int getAge()
              return age;
         public void setAge(int age)
              this.age = age;
         public String getName()
              return name;
         public void setName(String name)
              this.name = name;
    }

    Yucca wrote:
    georgemc wrote:
    Yucca wrote:
    Sound like you should visit the logging API or you could do SOP all over your code which would make it very unreadableI don't see why logging code will make his code any less messy than SOP everywhere. Unless you're talking about applying logging by AOP, which is equally messy in a different way.I never implied that the one was tidier than the other. O merely recommended my knowledge on how to help the OP and gave 2 choices. Oh right. It looked like you were suggesting SOP was messier somehow. Never mind, then.
    Besides is AOP really that bad when using Interceptors? I know that this is new to Java but interceptors are really not that untidy.I didn't say they were untidy. I didn't say there was anything wrong with AOP. But logging by AOP results in pretty useless, messy logs. "This method was called with these parameters" all over the place, rather than something nice and friendly. Remember, logging is more often read by support staff than developers, so while it might be obvious to you what "getLlama(200, 3)" means, it's probably garbage to the support bods.

  • The people's posted videos no longer work on my ipad  Note: I am using the Facebook app, I am not using safari  Please don't tell me to use adobe flash player, it is not compatible with ipad, but it used to work nevertheless.

    The people's posted videos no longer work on my ipad
    Note: I am using the Facebook app, I am not using safari
    Please don't tell me to use adobe flash player, it is not compatible with ipad, but it used to work nevertheless.

    Facebook videos are still working for me in the Facebook App (using iOS 7.0.6).
    Have you tried restarting or resetting your iPad?
    Restart: Press On/Off button until the Slide to Power Off slider appears, select Slide to Power Off and, after It shuts down, press the On/Off button until the Apple logo appears.
    Reset: Press the Home and On/Off buttons at the same time and hold them until the Apple logo appears (about 10 seconds).
    No data will be lost.

  • HT201364 i am try to use my itunes which i have not used in a while trying to do all the upgrade. i have an older macbook but i cant download anything. so is apple saying that i will not be able to connect my iphone to macbook ever unless i get a new lapt

    i am try to use my itunes which i have not used in a while trying to do all the upgrades. i have an older macbook but i cant download anything. so is apple saying that i will not be able to connect my iphone to macbook ever unless i get a new laptop?

    Your MacBook is compatible with Mac OS X 10.6.8, which is the minimum required to install the current version of iTunes and sync devices running iOS 7. It doesn't need to be compatible with Lion, Mountain Lion, or Mavericks.
    (101906)

  • HT204380 i have a i phone and my partner have a samsung .. can i use facetime with her if she not using iphone

    I have a i phone and my partner have a samsung .. can i use facetime with her if she not using iphone

    No. Facetime is exclusive to iOS devices and Macs. There is no android version. You would have to use a 3rd party app/service like Skype.

  • HT4759 Can I use outlook 2003 if I am not using icloud e-mail?

    Can I use outlook 2003 if I am not using icloud e- mail system?

    Syncing with iCloud requires Outlook 2007 or higher.  You won't be able to sync Outlook 2003 with your iCloud account.

  • About operator not using thesaurus

    Hello,
    I'm trying to use about query, and extending my knowledge base by loading a thesaurus,
    but it doesn't seem like working...
    Can someone tell me what i'm doing wrong?...
    This is my table:
    X@dev> select * from test_table;
    NUM STR
    1 my car is big
    2 automobile is good
    3 the sea is blue
    4 the ocean is wide
    5 surf forever
    This is my thesaurus:
    Seas
    SYN Breakers
    SYN Estuaries
    SYN Surf
    SYN Waves
    NT Oceans
    Then loading:
    ctxload -user x/x@dev -thes -name default -file test
    Then compiling:
    ctxkbtc -user x/x@dev -name default
    Then:
    begin
    ctx_ddl.create_preference('mylex','BASIC_LEXER');
    ctx_ddl.set_attribute('mylex','index_themes','YES');
    ctx_ddl.set_attribute('mylex','index_text','YES');
    ctx_ddl.set_attribute ( 'mylex', 'mixed_case', 'NO');
    ctx_ddl.set_attribute ( 'mylex', 'PROVE_THEMES', 'NO');
    end;
    and creating the index:
    create index test_idx on test_table(str) indextype is ctxsys.context
    parameters ('LEXER mylex');
    but then:
    X@dev> select * from test_table where contains(str,'syn(sea)',1)>0;
    NUM STR
    3 the sea is blue
    X@dev> select * from test_table where contains(str,'syn(seas)',1)>0;
    NUM STR
    5 surf forever
    X@dev> select * from test_table where contains(str,'about(sea)',1)>0;
    NUM STR
    3 the sea is blue
    X@dev> select * from test_table where contains(str,'about(seas)',1)>0;
    NUM STR
    3 the sea is blue
    The about operator is not using the thesaurus. why?
    and also:
    X@dev> select * from test_table where contains(str,'about(SEA)',1)>0;
    no rows selected
    If the mixed_case is set to "NO" i'm supposed to get results with upper case as well, don't I?
    Thanks for your help!!

    Hi,
    Check this out - seems to match what you're experiencing:
    Expectations of the Thesaurus??????
    -Ron

  • Queries not using indexes

    We installed and configured a new environment of OBIEE and are trying to run a simple query in our data warehouse. This simple query takes only 7 seconds to complete in our previous data warehouse using TOAD but is taking 8+ minutes to complete in our new environment also using TOAD.
    Looking at the explain plans, the query in the new environment is not using indexes. Does anyone have an idea why it is not using the indexes? We checked and all of the indexes have been created and still exist. We also ran Analyze again on the two tables used n the query but the query still did not use the indexes.
    Please let me know if anyone has ideas ASAP since we are baffled.

    - Are the object statistics identical? The ANALYZE statement has been depricated for a while, particularly for data warehouse environments where there may be partitioning. Were you not using the DBMS_STATS package to gather statistics in the previous environment? Were statistics computed on the indexes?
    - Can you post the two query plans (formatted via DBMS_XPLAN and including the filter conditions)? It is not immediately obvious to me what index(es) might be useful here unless one of the two conditions is particularly selective which doesn't seem terribly likely based on just the table names involved.
    - When you do post the query plans, please use the \[code\] and \[code\] tags to preserve the white space so that the output is readable.
    Justin

  • About query not using extended knowledge base

    Hello,
    I compiled a small thesaurus to the knowledge base:
    ctxkbtc -user dcenter/dcenter -name THES_PLACE
    It contains:
    GERMAN
    USE FEDERAL REPUBLIC OF GERMANY
    UF FRG
    BT EUROPE
    NT BAVARIAN
    I have 2 record, 1 containing GERMAN, 1 containing BAVARIAN.
    Field is indexed with a context index, and the index is synchronized.
    I'm using 8.1.7.2 english.
    Using an ABOUT operator, I always get 1 hit.
    SQL> select count(*) from file_info where contains (places, 'about(BAVARIAN)') > 0;
    The (9i) doc says:
    When you augment the existing knowledge base with your new thesaurus, you query with the ABOUT operator which implicitly expands to synonyms and narrower terms.
    How can I get the ABOUT query to expand to the narrower term in 8.1.7.2? Is this a bug, do I have to upgrade, or am I missing something?
    Thanks

    Hello.
    Did you load the supplied english thesaurus as your DEFAULT thesaurus using the command line utility ctxload (or some other method)?
    I had the same experience until I loaded the sample thesaurus in $ORACLE_HOME/ctx/sample/thes/. Now my ABOUT and SYN queries work as expected though I still have a concern about the incomplete nature of the sample thesauri (I'll open a new thread on that topic).
    Hope this helps.

  • How do I delete old Bex queries not used within 13 months?

    Hello all,
    I have a large number of Bex queries that are no longer used (3000 - three thousand).  I'd like to delete any query that has not been used in 13 months.
    Can someone provide some guidance?
    Also, is there anyway to archive old reports?
    Thank you.
    JIm

    Murali,
    The RSZCOMPDIR table contains this information - thank you.
    The only remaining challenges are:
    1) how do I interpret or convert the values in the LASTUSED field?  The numbers are of the magnitude of 20,060,601,210,130.
    2) Once I determine which queries were not used within the last 13 months, how do I delete them?  Is it as simple as writing a SQL statement against this table?
    Thanks you.

  • I have been using RoboForm. Now I can not use it even after PURCHASING THE latest vr!

    I have been trying for the last TWO days to get Roboform to work with the new Firefox! I have even ''purchased'' the latest version of Roboform but I still can not get its tool bar to appear on Firefox. After trying to follow your support's instructions, I can not get it to work with Firefox! I can get it to work with MS Windows Internet Explorer!
    What a mess! I will not use Firefox again!

    check out this link which answers your question http://support.apple.com/kb/HT1242
    after re reading your post, I think you need an SMC reset instead: http://support.apple.com/kb/ht3964
    what does activity monitor show? screenshots?

  • Deleted iPhoto and now I can't reinstall it -I'm using a second hand iMac so not using the Apple ID used to register it

    I had trouble updating iPhoto so I uninstalled it but now I can't reinstall it. I'm using a second hand iMac so I'm not using the Apple ID that was used to first register it. When I go to the App Store and try to download iPhoto it just says (accept) I click this but nothing happens ?
    Please help 

    Maybe you need to register the computer with Apple:
    Register Your Apple Product
    Your Support Profile for Registered Purchases

  • Is it possible to use iMessage only over WiFi, and not use cellular data?

    When I go to Settings -> Cellular, there is no toggle for messages. Is there some way I could selectively disable cellular data usage for messages? That is, I want messages to be sent with SMS instead of data even if cellular data is available, but not if WiFi is available. If WiFi is available, then I would want the message to use the WiFi.
    My situation is that I will be traveling internationally and will have a plan that allows unlimited texting but limited data. I don't want to have to toggle iMessage on and off every time I connect to WiFi to prevent data use with messages!
    Thanks for any help!

    The only option you have is to turn off cellular data completely. You are correct, there is no setting for cellular data for messages. If you toggle iMessage off/on multiple times, you will end up with problems, since others will not know if you have iMessage off/on, and will continue to try to send iMessages to you. Also, you may find you will have problems with iMessage activating again after turning it off. iMessages do not use very much data, but if you are using data for other reasons, that could use up the limited pool of data you mentioned

  • TS4006 what is the function 'lock and track used for ? What is 'remote wipe' used for ?

    I just fired up my iPhone and iPad with 'Find My iPhone app.....not sure how to use  'Function and Track & Remote Wipe' options
    Thanks
    S

    Lock - many users foolishly do not use a passcode, to lock the device.  This function lets a user lock the lost device with a password to prevent a thief from gaining access to the apps and data.
    Track - when lost or stolen, the device can be tracked on a map.  This assumes the device is connected to the internet, is turned on, and has not been reset.
    Wipe - this deletes all data of the lost device to prevent a their from viewing the data.  Once a remote wipe is placed, you cannot remotely unwipe it, same for lock.

Maybe you are looking for

  • Iphone 5 to tv usb

    I have just purchased my new I phone 5S and want to buy the right cable or adapter to connect it to my TV. My television has both USB and HDMi ports but looking online if I buy the apple lightning adapter (£40) and a HDMi cable it works out quite exp

  • Missing table (jdo_sequencex)

    Hi! Have a strange problem - hope you can help me: The Stage: to control access to several resources i want to have ACLs. Therefore i implemented the java.security.acl.Acl interfaces. All persitent classes were correctly enhanced and are working fine

  • Photoshop CC not compatible?

    I have a Photoshop CC document that has a few layers of live text on top of a bitmap image of a web form with empty fields. When I bring it into Motion 5.1, some of the text objects are not there. They are in Photoshop CC but not in Motion. Flattenin

  • How to install Photoshop Elements 10 (not Premiere) from disc?

    Can anyone help me?  Purchaed Photoshop Elements 10 at Best Buy.  Finally figured out how to get serial number.  Figured out you have to insert disc 2 first.  Wizzard comes up. Only comes up with choice to install Photoshop Premiere Elements 10, ( no

  • How do i prevent Photos from auto opening?

    I use lightroom,  I want this app to stop automatically opening when I connect a card to my computer