How do I find out what features are not useful in my Classifier?

How do I find out what features are not useful in my Classifier? I am trying to trim down the number of features to speed up the training of my data, I have about 3700 features. I have found the Filter Based Feature Selection Module and have not been successful
in using it. I have looked through all the examples and have not been able to find any examples using the module. Will the Filter Based Feature Selection Module help me to trim features. If so how do I use it?

One way to do this would be is to use a random forest classifier. Feature/variable importance can be obtained relatively easily with random forests. 
Here is how you may do it in R.
> install.packages('randomForest') #install randomForest package in R if it is not already there
> library(randomForest) # reference the library
> data(mtcars) # load motor cars data that ships with 
#train a random forest 
> mtcars.rf <- randomForest(mpg ~ ., data=mtcars, ntree=1000,keep.forest=FALSE, importance=TRUE)
> importance(mtcars.rf)
> importance(mtcars.rf)
#You will see an output like below
       %IncMSE IncNodePurity
cyl  16.168645     169.96741
disp 18.672188     260.08722
hp   17.584375     184.95007
drat  6.948743      63.54528
wt   17.818509     254.30347
qsec  4.772889      33.25546
vs    5.303058      24.39064
am    5.210181      17.36626
gear  4.619161      21.55450
carb  8.577037      28.46715
# or plot the importance as follows
> varImpPlot(mtcars.rf)
What this tells you is how important predictors/features/variables like horsepower(hp), weight(wt), no. of cylinders (cyl) is in predicting miles per gallon (mpg).
If you are wondering how the data looks like. Try this
head(mtcars) # gives first few lines of the data set.
 mpg cyl disp  hp drat   wt ... 
Mazda RX4     21.0   6  160 110 3.90 2.62 ... 
Mazda RX4 Wag 21.0   6  160 110 3.90 2.88 ... 
Datsun 710    22.8   4  108  93 3.85 2.32 ... 
. Try this
Here is a few useful resources:
Random Forest documentation (Check out the pages on variable importance and variable importance plot)
http://cran.r-project.org/web/packages/randomForest/randomForest.pdf 
Motor cars data: http://stat.ethz.ch/R-manual/R-devel/library/datasets/html/mtcars.html

Similar Messages

  • HT4211 how can you find out what kb are being used by what apps

    how can you find out what kb are being used by what apps there is always alot of kb being used even when I don't use my phone

    Go into settings , general, usage and it tells you what the apps use. If your refering to the memory storage of the apps.

  • How do I find out what applications are running in the background

    I have a 2008 iMac with 2GB memory.  How do I find out what programs are running in the background?  I am going to buy a new iMac before the end of the year to replace this one.  When I looked at Activity Monitor it shows 1.8Gb used but doesn't tell all the programs running.

    open activity monitor [if it doesnt launch click winders>Activity Monitor]. then it'll show all proceses

  • How do i find out what devices are authorised on my apple ID?

    I have just bought a new iMac and want to get all my itunes library etc on it.  However, apparently i have reached my limit of 5 authorisations, which is entirely possible as I have had a number of iphones, Macair and ipads, some of which I either no longer own or are no longer functioning.  How do I find out what devices are authorised and then deauthorise any that I don't use any more - given that they may not even work!

    Welcome to the Apple Community.
    You can't de-authorise just the computers you no longer have access to.
    Your only option is to de-authorise all your computers and then re-authorise those you wish to be authorised. You can do this by logging into your account settings in iTunes on your computer (Store > View My ID) and selecting the option to de-authorise all.
    Please note however, you are only permitted to do this once in each 12 month period, therefore you would be better de-authorising your computers before you lose access to them. you can do this from the 'Store' menu in iTunes.

  • How do i find out what drives are present in a particular system

    Hi,
    How do i find out what drives are available in a particular system either by giving the systems ipaddress or the systems name...

    You can't do that. That would be a real security risc.
    /KAj

  • Are not the right ones for the icloud account. How can I find out what these are?

    I have downloaded icloud onto my PC. When I try to access my account I am told that although my Apple ID and password are correct they are not the right ones for the icloud account.How can I find out what these are?

    Christine Helen wrote:
    I can't find any way of creating an icloud ID. I only have a PC. no Mac product except an iPod classic.
    Oh, then you can't unless you know someone with a Mac you could use for a moment or 2. (Like at the Apple Store)

  • How can I find out what apps are on my step daughters phone without the phone?

    How can I find out what apps are on my step daughters phone without the phone? She is on my phone plan but does not live with me and I am concerned about the apps she may be using.

        baniville108,
    Thank you for reaching out to us. We certainly know the importance of being able to know what options are available with your device. With apps on devices, thoses are specific to the phone itself, so there is no open forum to view what apps are downloaded. The only option would be to physically review from the phone, or if you have the same Apple ID you can log into it and view from there. Please let us know if you need anymore assistance.
    Thank you,
    TonyG_VZW
    Follow us on Twitter @VZWSupport

  • Hard drive shows 159gb of other (yellow) how do I find out what these are to free up space?

    hard drive shows 159gb of other (yellow) how do I find out what these are to free up space?

    Hope this helps.
    1. Empty Trash.
        http://support.apple.com/kb/PH10677
    2. Delete "Recovered Messages", if any.
        Hold the option key down and click "Go" menu in the Finder menu bar.
        Select "Library" from the dropdown.
        Library > Mail > V2 > Mailboxes
        Delete "Recovered Messages", if any.
        Empty Trash. Restart.
    3. Repair Disk
        Steps 1 through 7
        http://support.apple.com/kb/PH5836
    4. Disk space / Time Machine ?/ Local Snapshots
       http://support.apple.com/kb/ht4878
    5. Re-index Macintosh HD
       System Preferences > Spotlight > Privacy
       http://support.apple.com/kb/ht2409

  • How can I find out what objects are in a datafile???

    My database is 8.1.7...
    I have a tablespace with multiple datafiles. How can I find out what objects are in a specific datafile???
    Thanks in advance...

    DBA_SEGMENTS
    DBA_SEGMENTS describes the storage allocated for all segments in the database.
    Related View
    USER_SEGMENTS describes the storage allocated for the segments owned by the current user's objects. This view does not display the OWNER, HEADER_FILE, HEADER_BLOCK, or RELATIVE_FNO columns.
    Column Datatype NULL Description
    OWNER
    VARCHAR2(30)
    Username of the segment owner
    SEGMENT_NAME
    VARCHAR2(81)
    Name, if any, of the segment
    PARTITION_NAME
    VARCHAR2(30)
    Object Partition Name (Set to NULL for non-partitioned objects)
    SEGMENT_TYPE
    VARCHAR2(17)
    Type of segment: INDEX PARTITION, TABLE PARTITION, TABLE, CLUSTER, INDEX, ROLLBACK, DEFERRED ROLLBACK, TEMPORARY, CACHE, LOBSEGMENT and LOBINDEX
    TABLESPACE_NAME
    VARCHAR2(30)
    Name of the tablespace containing the segment
    HEADER_FILE
    NUMBER
    ID of the file containing the segment header
    HEADER_BLOCK
    NUMBER
    ID of the block containing the segment header
    BYTES
    NUMBER
    Size in bytes, of the segment
    BLOCKS
    NUMBER
    Size, in Oracle blocks, of the segment
    EXTENTS
    NUMBER
    Number of extents allocated to the segment
    INITIAL_EXTENT
    NUMBER
    Size in bytes requested for the initial extent of the segment at create time. (Oracle rounds the extent size to multiples of 5 blocks if the requested size is greater than 5 blocks.)
    NEXT_EXTENT
    NUMBER
    Size in bytes of the next extent to be allocated to the segment
    MIN_EXTENTS
    NUMBER
    Minimum number of extents allowed in the segment
    MAX_EXTENTS
    NUMBER
    Maximum number of extents allowed in the segment
    PCT_INCREASE
    NUMBER
    Percent by which to increase the size of the next extent to be allocated
    FREELISTS
    NUMBER
    Number of process freelists allocated to this segment
    FREELIST_GROUPS
    NUMBER
    Number of freelist groups allocated to this segment
    RELATIVE_FNO
    NUMBER
    Relative file number of the segment header
    BUFFER_POOL
    VARCHAR2(7)
    Default buffer pool for the object
    This view with this another viwe can help you to identify where the object is:
    DBA_DATA_FILES
    DBA_DATA_FILES describes database files.
    Column Datatype NULL Description
    FILE_NAME
    VARCHAR2(513)
    Name of the database file
    FILE_ID
    NUMBER
    NOT NULL
    File identifier number of the database file
    TABLESPACE_NAME
    VARCHAR2(30)
    NOT NULL
    Name of the tablespace to which the file belongs
    BYTES
    NUMBER
    Size of the file in bytes
    BLOCKS
    NUMBER
    NOT NULL
    Size of the file in Oracle blocks
    STATUS
    VARCHAR2(9)
    File status: AVAILABLE or INVALID (INVALID means that the file number is not in use, for example, a file in a tablespace that was dropped)
    RELATIVE_FNO
    NUMBER
    Relative file number
    AUTOEXTENSIBLE
    VARCHAR2(3)
    Autoextensible indicator
    MAXBYTES
    NUMBER
    Maximum file size in bytes
    MAXBLOCKS
    NUMBER
    Maximum file size in blocks
    INCREMENT_BY
    NUMBER
    Autoextension increment
    USER_BYTES
    NUMBER
    Corresponding number of bytes
    USER_BLOCKS
    NUMBER
    Number of blocks which can be used by the data
    Joel Pérez
    http://otn.oracle.com/experts

  • How do I find out what devices are linked to my account

    How do I find out what devices are linked or registered to my account or apple Id?

    http://support.apple.com/kb/ht4627

  • How do I find out what computers are authorized to use my Store Account.

    How do I find out what computers are authorized to use my Store Account? Do my iPhones count towards the 5?

    "How do I find out what computers are authorized to use my Store Account? "
    The ones that you authorized.  There is no list.
    "Do my iPhones count towards the 5?"
    No.
    ONLY computers count.

  • HT1689 I forgot my answers to the secret questions on iTunes. How do I find out what they are?

    I forgot the answers to my secret questions. How do i find out what they are again?

    Can I change the answers to the security questions for my Apple ID?
    Yes. You can change the answers to the security questions provided when you originally signed up for your Apple ID. Go to My Apple ID and click Manage your account.

  • HT201272 I have 3 charges on my credit card same day same time.  How do I find out what they are for?

    I have three charges on my credit card from apple, same day and same amount.  How do I find out what these are for?

    You should receive an email receipt for any purchase (though it may not appear immediately, mine sometimes appear the following day).
    You've checked the purchase history on your account (Store > View My Account, Store > View My Apple ID on iTunes 11, menu option on your computer's iTunes), and have you made any in-app purchases ? If not and you haven't added or changed your credit card details (when you do then a small temporary store holding charge may be applied to check that the details are correct and valid, which should disappear within a few days) then you could contact iTunes Support and ask if they can help : http://www.apple.com/support/itunes/contact/ - click on Contact iTunes Store Support on the right-hand side of the page, then Purchases, Billing & Redemption

  • HT204088 I forget the answers to my security questions, how do I find out what they are?

    I'm trying to buy a song for an important event and due to it being the first time on this laptop that I am purchasing a song, I have to provide the answers to my securit questions and i cant remember them. How do I find out what they are? Please.

    f you have a rescue email address set up on your account then you can try going to https://appleid.apple.com/ and click 'Manage your Apple ID' on the right-hand side of that page and log into your account. Then click on 'Password and Security' on the left-hand side of that page and on the right-hand side you might see an option to send security question reset info to your rescue email address.
    If you don't have a rescue email address set up then go to Express Lane and select 'iTunes' from the list of 'products' in the middle of the screen.
    Then select 'iTunes Store', and on the next screen select 'Account Management'
    Next choose 'iTunes Store Account Questions' or 'iTunes Store account security' (it appears to vary by country) and fill in that you'd like your security questions/answers reset.
    You should get an email reply within about 24 hours (and check your Spam folder as well as your Inbox).
    Or you could see if the second half of Kappy's reply in this thread helps : https://discussions.apple.com/message/20357006#20357006

  • HT1420 How do i find out what computers are authorized on my account

    How do i find out what computers are authorized on my account

    And why isn't there a list of authprized devices available? Apple knows I have x number of authorized devices, and they know what they are. Why can't I have access to this information about my own account?

Maybe you are looking for