Clarifications needed for full text search

Hi,
I need some clarification regarding full text search.
1) Is japanese part of the standard Oracle full text search?
2) if it is not, how to install the japanese lexer?
3) how oracle is sorting international characters. If a column contains both english, japanese and french, how will be the output?
Thanks
Muneer

Follwoing is the sql statement and the result i got
select language, description,lengthb(description) bytes, length(description) length, vsize(description) vsize from t2;
LANGUAGE      DESCRIPTION      BYTES      LENGTH      VSIZE
English      abcdefghij      10      10      10
English      zyxwvutsrq      10      10      10
French      désignéess      16      12      16
French      réconcilia      13      11      13
German      Einfuhrzöl      13      11      13
German      müßtämpfer      19      13      19
Greek      Î´Î·Î¼Î¿ÏƒÎ¹Î¿Î³ÏÎ±      40      20      40
Greek      Î±Ï€Î¿ÎºÎ»ÎµÎ¹ÏƒÏ„ι      42      20      42
Russian      Ð¿Ñ€ÐµÑÑ‚упник      42      20      42
Russian      Ð¿Ñ€Ð¸Ð²ÐµÐ´ÐµÐ½Ð¸Ñ      41      20      41
Japanese      å…¥é–“市の会社の銀行口      65      30      65
Japanese      ç¥žæˆ¸å¸‚ä¸å¤®åŒºã®æ±éŠåœ’      62      30      62
Korean      ì¶œë°œì ë¶€í„°ì¶œë°œì ë¶€í„°      64      30      64
Korean      ë³´ì¢Œê´€ì„출발점부터경      64      30      64
Hindi      à¤•à¤¤à¤œà¤¨à¤¤à¤®à¤¨à¤œà¤¤à¤¶à¥à¤°      73      36      73
Hindi      à¤¨à¥€à¤šà¥‡à¤¨à¥€à¤šà¥‡à¤¨à¥€à¤šà¥‡à¤¨à¥€à¤šà¥‡à¤¨à¥€à¤šà¥‡      130      60      130 I think it explains a lot. I am facing another problem in searching blob columns when it contains japanese or korean characters. I tried with multi lexer (adding japanese as sub lexer and making english as default lexer). But it is not searching the column. Do i have to set any other parameters (editing registry, changing enviornment setting etc). I used the following script to set the lexer.
begin
     ctx_ddl.create_preference('english_lexer','basic_lexer');
     ctx_ddl.set_attribute('english_lexer','index_themes','yes');
     ctx_ddl.set_attribute('english_lexer','theme_language','english');
     ctx_ddl.create_preference('german_lexer','basic_lexer');
     ctx_ddl.set_attribute('german_lexer','composite','german');
     ctx_ddl.set_attribute('german_lexer','mixed_case','yes');
     ctx_ddl.set_attribute('german_lexer','alternate_spelling','german');
     ctx_ddl.create_preference('japanese_lexer','japanese_vgram_lexer');
     ctx_ddl.create_preference('korean_lexer','KOREAN_MORPH_LEXER');
     ctx_ddl.set_attribute('korean_lexer','COMPOSITE','NGRAM');
     ctx_ddl.create_preference('global_lexer', 'multi_lexer');
     ctx_ddl.add_sub_lexer('global_lexer','default','english_lexer');
     ctx_ddl.add_sub_lexer('global_lexer','german','german_lexer','ger');
     ctx_ddl.add_sub_lexer('global_lexer','japanese','japanese_lexer','jpn');
     ctx_ddl.add_sub_lexer('global_lexer','korean','Korean_lexer');
end;Hope i presented enough details.

Similar Messages

  • "Filter/partition key" for full-text searching

    Hi there,
    We have a challenge whereby we have a table of products by store, each store having say 200,000 products.  Basically, for each store, we want to allow searching by product name.  The best solution for this is to have full-text searching, but there
    is no way to have a "filter" or "partition" key on the store ID.
    So in essence what happens, the full-text search scans the entire full-text catalog for the products, then it uses the primary key to match to the table and then filters out the other stores.  Considering we have hundreds of stores in the table, this
    is not a good solution.
    We contemplated adding separate indexed views and full-text catalogs for every store, but this would be a nightmare to manage.
    I was expecting to see some sort of a "partition by Column" in the full-text indexes, but it doesn't exist.  This basically means we have to scrap full-text and look for a third party solution.
    Does anyone have any idea how we could achieve this with just standard SQL full-text searching?

    Hi Adam,
    Thank you for your question.  I am trying to involve someone more familiar with this topic for a further look at this issue. Sometime delay might be expected from the job transferring. Your patience is greatly appreciated. 
    Thank you for your understanding and support.
    If you have any feedback on our support, please click
    here.
    Elvis Long
    TechNet Community Support

  • Full Text Search In UCM

    Currently we are looking at the integration of UCM and Webcenter. Can u please guide us in doing a full text search using UCM.
    The steps we followed for full text search is
    1. Stopped the Content Server service.
    2. On the Content Server's file system, navigated to search folder in Content Server Installed Path and altered activeindex.hda with the entry change verity.1 to IdcColl1
    3. Renamed all files under the following locations:
    CS\search\lock
    CSsearch\update
    CS\search\rebuild
    4. Started the Content Server service
    5. Logged into CS and rebuilt the indexes from repository manager and restarted the CS from Admin Server Page
    Please let me know if any of the steps is wrong or any more components need to be added.
    We get no errors on doing fulltextsearch but we do not any result (displays "found 0 potential items").
    Thanks in advance!

    When checked the CS Log after changing metadata to fulltext and rebuilding indexes under collection rebuild cycle
    helperservice: data exception in INDEXERSTATE.RECORDWEBCHANGE_SUB IndexerState.IindexerState Unable to find query 'IndexerState.IindexerState'. [ Details ]
    An error has occurred. The stack trace below shows more information.
    !$helperservice: data exception in INDEXERSTATE.RECORDWEBCHANGE_SUB IndexerState.IindexerState !csUnableToFindQuery,IndexerState.IindexerState
    intradoc.data.DataException: !csUnableToFindQuery,IndexerState.IindexerState
         at intradoc.jdbc.JdbcConnection.getQueryDefAllowMissing(JdbcConnection.java:390)
         at intradoc.jdbc.JdbcConnection.getQueryDef(JdbcConnection.java:369)
         at intradoc.jdbc.JdbcWorkspace.execute(JdbcWorkspace.java:635)
         at helper.HelperUtils.execute(HelperUtils.java:1527)
         at helper.HelperService.doAction(HelperService.java:692)
         at helper.HelperService.doActions10g(HelperService.java:383)
         at helper.HelperService.doActions(HelperService.java:119)
         at helper.HelperUtils.executeService(HelperUtils.java:3185)
         at helper.HelperUtils.executeService(HelperUtils.java:3031)
         at helper.HelperUtils.executeService(HelperUtils.java:3027)
         at helper.HelperUtils.executeService(HelperUtils.java:3023)
         at helper.HelperFilters.doFilter(HelperFilters.java:1287)
         at intradoc.shared.PluginFilters.filter(PluginFilters.java:92)
         at intradoc.indexer.IndexerBulkLoader.createBulkLoad(IndexerBulkLoader.java:333)
         at intradoc.indexer.IndexerBulkLoader.doWork(IndexerBulkLoader.java:164)
         at intradoc.indexer.Indexer.doIndexing(Indexer.java:431)
         at intradoc.indexer.Indexer.buildIndex(Indexer.java:340)
         at intradoc.server.IndexerMonitor.doIndexing(IndexerMonitor.java:1012)
         at intradoc.server.IndexerMonitor$4.run(IndexerMonitor.java:832)
    Thanks!

  • Full text search in Filenet via SAP DMS

    Hello experts,
    Hopefully you can help me with the following. My customer has SAP DMS and uses FileNet (v4.0) as content repository. They use Verity as tool for full text search (SAP and non-SAP). Verity has it's own user interface / search screen. Question is if it is possible for SAP (easy)DMS users to do full text search (via CV04N or EasyDMS searchscreen) and search in the FileNet repository (directly with TREX or via Verity). The customer has the ACSAP connector up and running.
    I've implemented TREX with SAP content server and index server before, but I'm not familiar with FileNet possibilities in that area, so hopefully someone has experience with this?
    thanks in advance, Erwin

    Dear  NAG
    For text search you have activate TREX Server
    follow the steps
    Set TREX
    A:- Transaction: SRMO
    Install TREX , and create RFC destination to connect to
    TREX.
    B:- Transaction: SKPR06
    Check the flag to Document Area "DMS" to utilize this document area for
    document search.
    For Indexing
    A: Transaction: SE38
    Run the report program "RSTIRIDX_REINDEX" to create Index. 
    Also, run the report program "RSTIRIDX" to create Index.
    Set mime type for the text search
    A: SPRO --
    Cross-Application Components > Document Management System > General
    Data > Settings for Storage Systems > Create MIME types for full
    text search,
    Enter MIME type like
    "application/msword",
    "application/pdf".
    Retrive document via Test Search
    A: Then, test retrieval document search using
    Transaction: SKPR07.
    Enter Document Class "DMS_PCD1", Language "EN", Document Class "DMS",
    and try "TEST search".
    Regards
    Tushar Dave

  • TREX Full text search in ITSM 7.1

    Hello,
    I use  Full-Text Search with TREX - SAP IT Service Management on SAP Solution Manager - SCN Wiki
    documentation for setup TREX in SAP Solution Manager 7.1 for full trex search. After complete all steps, in UI part i have TREX error Index does not exist; index=saf:sol 001 ka
    when i start transaction CRMC_SAF_TOOL and do all step for configuration, result
    if you see (SDB, SDB_PROBLEMS, SDB_ATTACHMENT, SDB_SOLUTION) not index generated.
    BR, Baha

    Dear  NAG
    For text search you have activate TREX Server
    follow the steps
    Set TREX
    A:- Transaction: SRMO
    Install TREX , and create RFC destination to connect to
    TREX.
    B:- Transaction: SKPR06
    Check the flag to Document Area "DMS" to utilize this document area for
    document search.
    For Indexing
    A: Transaction: SE38
    Run the report program "RSTIRIDX_REINDEX" to create Index. 
    Also, run the report program "RSTIRIDX" to create Index.
    Set mime type for the text search
    A: SPRO --
    Cross-Application Components > Document Management System > General
    Data > Settings for Storage Systems > Create MIME types for full
    text search,
    Enter MIME type like
    "application/msword",
    "application/pdf".
    Retrive document via Test Search
    A: Then, test retrieval document search using
    Transaction: SKPR07.
    Enter Document Class "DMS_PCD1", Language "EN", Document Class "DMS",
    and try "TEST search".
    Regards
    Tushar Dave

  • Full-text search in ucm10g

    hi all,
    I am using ucm10gr3 plus wc11.1.1.3.
    I checked in a content with both Primary File and Alternate File , I used webcenter search taskflow to search word in alternate file, but search result show me the Primary File, how to resolve this issue?
    I also opened a case in webcenter services.
    Best regards
    Edited by: user1411365 on Aug 8, 2010 1:07 AM

    Hi,
    According to Metalink note 871388.1: " The weblayout file is what typically gets indexed for full text searching". it is possible to set some parameters in order the native file to be indexed but the note says nothing about indexing the alternative file.
    Regards

  • Full text search in cv04n

    hi experts,
    i have some questions about full text search in cv04n, please bare with me as am new to dms.
    1. what is the impact on the existing data if i activate the full text search.
    2. how to activate the full text search - please mention step by step process
    thanks in advance.

    Dear  NAG
    For text search you have activate TREX Server
    follow the steps
    Set TREX
    A:- Transaction: SRMO
    Install TREX , and create RFC destination to connect to
    TREX.
    B:- Transaction: SKPR06
    Check the flag to Document Area "DMS" to utilize this document area for
    document search.
    For Indexing
    A: Transaction: SE38
    Run the report program "RSTIRIDX_REINDEX" to create Index. 
    Also, run the report program "RSTIRIDX" to create Index.
    Set mime type for the text search
    A: SPRO --
    Cross-Application Components > Document Management System > General
    Data > Settings for Storage Systems > Create MIME types for full
    text search,
    Enter MIME type like
    "application/msword",
    "application/pdf".
    Retrive document via Test Search
    A: Then, test retrieval document search using
    Transaction: SKPR07.
    Enter Document Class "DMS_PCD1", Language "EN", Document Class "DMS",
    and try "TEST search".
    Regards
    Tushar Dave

  • Building the sample prefilter for full-text seach

    Hi.
    I'm struggling with the sample prefilter for full-text search in SA12. The problem is that the build.bat isn't producing any output files.
    I am completely blank on C++, and I have only barely gotten the build.bat to run without errors, but that is obviously not enough.
    If anybody could build the files for me, it would be nice, but even better is if there was an working VS solution, or at least some more documentation on how to build this thing.
    Thanks.

    Hello again tNeeson!
    You are a few builds behind the current build. I would advise bringing your server up to current build 9.00.5324.
    If you patch the servers and try again and see if the build works this time, I know there were 3 cumulative patches between your build and the current. Check out the below link
    http://sqlserverbuilds.blogspot.co.uk/
    I'm sure you can get someone to patch it for you if you aren't the one in control of the patching ;-)

  • Full text search across books in iBooks for Mavericks

    Is there a way to do full text search of all documents under iBooks for Mavericks?
    I have quite a few books in categories and collections that are not mutually exclusive. It is becoming quite tedious to find the book I need when I need it. I have tried search in iBooks but it only seems to hit titles, maybe some keywords, and perhaps other fields, but not the full text of the documents.
    I cannot find any way in Spotlight preferences or in iBook preferences to specify that the body of documents under iBooks should be indexed/searched.
    Best regards,
    Tom

    Just to register that I have fixed the problem.
    I tried reinstalling RH, but that didn't work. I was about to
    give up when I noticed that an error was coming up when I compiled
    the project: the infamous "HHC6003: The file itircl.dll has not
    been registered correctly". I found out that you only fix that
    problem by registering another dll: itcc.dll
    Once you fix this, the compilation is perfect and the
    full-text Search works properly again.
    Thanks anyway for the interest.
    Paulo.

  • Full text search for web ? Yes or no ?

    Hi,
    I have a DB that has more then 1.8mil records in a single table .... and would like to implement full text search or some sort of caching for quicker Web search ....
    Let me describe you what I have .... The table that holds 1.8mil records is made out of 30 clob columns ... each holding text .... actually these are alphabetic columns ... so words that start with char 'A' are in the first clob ... 'B' in second 'C' in third and so forth ....
    Searching is always done first by customerID and CreateDate which are both indexed columns , and then clobs are searched using instr ...
    Execution plan was good ... but searching times started to increase ....
    So therefor I would like to improve the search ... by implementing some sort of caching mechanism ....
    I read a lot about this and found an example where I would create a table containing unique words and table for occurrences of the words ... but this would then
    make like 1.8mil articles containing approc 500 words , which would then repeat through articles ... so ok there would be less then 50.000 unique words (in our language ) , but the occurrences would dramatically increase cause every word inside article has to have a link in occurrences table ... so this would then be like 900mil records inside table ..
    Is this at all possible to have so many records inside single table ? And still make it quick ?
    Is the Oracle Full text search the only right way in this situation ?
    Any suggestions ? Did anyone implement anything like this ?
    Thanks,
    Kris

    Let's start with your Oracle version. Please specify which version you run because Text capabilities vary dramatically between releases.
    >
    I tried using Oracle Text as suggested ... now if I understand correctly ....
    CTXCAT - would be great because when new records are added, index is updated automatically .... but doesn't support CLOBs ... so no go
    >
    CTXCAT is a concatenated transactional index that is supposed to optimize combined searches on text and other columns. No go for you as it indeed does not support CLOB columns.
    >
    CONTEXT - supports CLObs , but I need to explicitly synchronize index ....
    There are like 4000 inserts per day ..... and they all need to be indexed in a real-time ...
    >
    Not true, at least since 10g: SYNC(ON COMMIT) parameter makes this index type transactional (it's synchronized automatically on commit with this parameter set.)
    >
    If CTX_DLL.SYNC_INDEX procedure synchronize the whole table which is now 1.8mil records, this can take a while ... so it can't be run after inserts ....
    >
    It does not, it only synchronizes changed data since last sync operation.
    So CONTEXT is actually perfectly suited for your needs (just redesign those 30 columns into one document column and index it.) Note that you need to regularly maintain CONTEXT indexes by scheduling CTX_DDL.OPTIMIZE_INDEX to run at off-hours and purge stale/removed data and rebuild its own internal index bitmaps for better performance. Otherwise you will see performance degrade as changes to the indexed data accumulate. You might also want to tweak initial indexing parameters, especially MEMORY parameter, as it greatly affects resulting index fragmentation - the more memory you give for initial indexing or optimization, the less fragmented and the more performant the index will be all other things equal.

  • When can oracle support full text search for Simplified Chinese?

    When I create index using the create index clause,the following errors appears
    "ORA-29855: error occurred in the execution of ODCIINDEXCREATE routine
    ORA-20000: interMedia Text error:
    DRG-11440: operation not supported for the SIMPLIFIED CHINESE language"
    Maybe I have to use like to query words...
    Did somebody encounter the same problem and have a good solutions?I am expecting your help!
    null

    Hi,
    Full-text search capabilities is not currently not supported and Unfortunately, we do not have a timeline as to when it will be available.
    You can post a feedback on the below link.
    http://feedback.azure.com/forums/217321-sql-database
    Regards,
    Mekh.

  • Document Management / Full Text Search in Projects & SolMan Directory

    Hello experts!
    I want to implement Full Text Search in my SolMan and therefore need your help.
    I have installed Trex 7.10 and am already able to search within my Solution Database (Problems/Solutions).
    Now I want to be able to search within all documents in my SolMan Installation - e.g. Roadmaps, SAP Scenario Descriptions or my own uploaded documents.
    In the IMG I already found the section Document Management but I cannot get the needed RFCs (IMSDEFAULT and IMSDEFAULT_REG) working.
    There is already a RFC called IMSDEFAULT, which was created during the installation of Trex and runs the
    Registered Server-Program: Trex_SOT_20080327090311
    I tried to configure my RFCs according to the IMG but, as I said, cannot manage to get them working.
    I hope anybody has an idea or an guide on how to implement Full Text Search!
    Please be so kind and provide help - thanks in advance!
    Best regards
    Gerold

    Gerold,
    I am running into the same issues because we want to do full text search on project documentation within Solution Manager. The default RFC connections IMSDEFAULT_REG and IMSDEFAULT do not work with the standard settings.
    We created one index for IWBSOLAR so maybe I also need to check IWBPROJ in SKPR06 for project documentation and create a new index for this one ?
    The indexing for IWBSOLAR now fails although there seem to be over 6000 documents marked but none are put in the index. After indexing there is a list of the documents all with code 6401 but cannot find any where what this code means. It seems to be succesful as all entries are green.
    Any help/suggestions on this topice would be greatly appreciated.

  • Full-Text Search has not worked since we upgraded to 2012

    I have a filestream database and table. Our full-text searches have always worked until we upgraded to SQL 2012 in December.  Now, no file that has been uploaded since December is searchable.  What has gone wrong here.  It should have been
    a clean upgrade.  We are not getting any error messages.  We are just not getting any records returned when we search on a word that we know are in the documents we've uploaded since December (for instance, the word 'aluminum'). 
    Filestream is enabled for the instance.
    A full-text catalog exists and contains a full-text index (the same one we've always had).  Full-text indexing is ENABLED.
    I've tried rebuilding the catalog and the index.  I've tried to do a FULL POPULATION on the table.
    We haven't changed our queries nor the way the files are uploaded.
    Nothing works.  I have been a database administrator since the SQL 2005 days and I have never seen anything like this.
    Please help.

    Hi GINGER PIERCE,
    Since the issue regards SQL Server Search. I will help you post the question in the related forums. It is appropriate and more experts will assist you.
    According to your description, in theory , if you can do a full-text search for SQL Server 2008, when upgrading the SQL Server version from 2008 to 2012, the Full text indexing feature should be run well in SQL Server 2012 databases. If not , you can try
    to restore your database from SQL Server 2008 to SQL Server 2012, create an new Full-Text Catalog and Index on the table or view in the database, and then use Full Text Index to search words, phrases and multiple forms of word or phrase via FREETEXT() and
    CANTAINS() with “and” or “or” operators.  check if it is normal that the full-text search feature is enabled in the SQL Server 2012 instance. For more information , see:
    Full Text Search step by step in SQL Server 2012.
    Note:  In SQL Server 2012 SP1 , the server will report that Full Text Search is not supported in this edition of SQL Server when it clearly is. The workaround is to create the initial catalog by using a T-SQL query:
    CREATE FULLTEXT CATALOG  
    In addition, since it is a fileStream database, we need to verify if you do Full Text Searches on documents in FileTables, if yes, you should enable FileStream database for your SQL Server, and enable FileTable options for the database. For more information,
    see:
    Full Text Searches on Documents in FileTables.
    Regards,
    Sofiya Li
    If you have any feedback on our support, please click here.
    Sofiya Li
    TechNet Community Support

  • QUESTION OF FULL TEXT SEARCH IN R/3 4.6C USING TREX IN EP 6.0 SP9

    Hi all:
        I can use R/3(46c) plus content server(6.3) to store
    Documents by KPRO.I've installed EP(6.0 sp9) plus Trex(6.1sp9).I want use this Trex to implement full text search,I can see the index id in the trex_xx\index directory.when I use tcode skpr07,I can find no problem,But when I use tcode cv04n,I can not find any document,the system does not display any error.
        What's wrong?

    hi there
    can anyone help me with this...
    How to integrate TREX in SAP R/3 System.
    I found that u r discussing abt TREX in SAP R/3. Can u people help me with the basics required for that....
    I have tried TREX in SAP Enterprise Portal and its working.
    Now i would like to incorporate TREx in R/3 system.
    How do we do that... Is it necessary that we need to install SAP Gateway in TREX host. Or is it possible without that.
    Can anyone brief me on what are the important settings to be made for that.
    Also i came across the RFC destination creation for connecting TREX with the R/3 system.
    I would like to know what kind of data is commonly indexed in R/3 and that too how. What is it that provides an interface for the user.
    In the case of portal we  define a a KM repository as the datasource likewise in R/3 system what do we define as datasource.
    I know these questions may sound very silly... pls do help
    regards
    Sasha

  • Installing Full-Text Search in SQL Server 2008 Standard

    Hello,
     We have a SQL Server 2008 Standard server, and I need to install full-text search in order to take advantage of some features with Autodesk Vault.  I believe that I understand the procedure to do so, but, does the installation of the setup tools
    and full-text search component cause any interruption to the database instances (or require a reboot)?
    Thanks

    Hi Indiana Grumpycooter,
    Full text search feature is supported by the SQL Server 2008 standard version, so you can install this feature in
    installation page of the SQL Server Installation Wizard. There is an similar example about adding SQL Full-Text Search to an existing SQL Server, you can review the following steps.http://www.techrepublic.com/blog/data-center/adding-sql-full-text-search-to-an-existing-sql-server/
    In addition, you can also install this feature via command line as follows. For more information, see:
    http://msdn.microsoft.com/en-us/library/ms144259(v=sql.100).aspx
    Setup.exe /q /ACTION=Install /FEATURES= Full-Text /INSTANCENAME=MSSQLSERVER /SQLSVCACCOUNT="<DomainName\UserName>" /SQLSVCPASSWORD="<StrongPassword>" /SQLSYSADMINACCOUNTS
    As other post, it will not cause interruption, and you require a reboot after installing Full-Text feature.
    Regards,
    Sofiya Li
    Sofiya Li
    TechNet Community Support

Maybe you are looking for

  • To Convert GIF to BMP

    Hello, Plz can anyone tell me how do i programatically convert GIF image to BITMAP image. Thanks, Rathish Moderator message: not related to ABAP development. locked by: Thomas Zloch on Aug 12, 2010 12:04 AM

  • Unable to rename folders and files on SharePoint mapped drive.

    I just installed a fresh copy of Windows 7 and have mapped a drive to my SharePoint "Shared Documents" folder.  I am able to open, save, and delete files and folders.  However, I am unable to rename files and folders.  No matter how long of short of

  • Problem in contract distribution

    Hi  All,   We are working on SRM 4.0 classic scenario.  We are getting an error message while disributing the GOA in application monitor as "<b>Processing of IDOCs of type BLAORD03 im system BRD302 canceled</b> " We have checked all the customization

  • How to compare the performance of a R model vs a native Azure ML model

    Hi I am working on building a churn prediction model, and am using the Survival package in R. I managed to train my model and also scored a Test set....now I want to compare the ROC curve with the ML studio's Logistic regression model. However, I am

  • Subcontract Process:Transport/Freight Cost should not be added to Inventory

    Hi, I am following subcontract process; the involvement of transport/freight cost should not be added to the inventory account during Goods Receipt (MIG0). Regards, Biju K