Best Method For Keyword Search (Full Text Search)

I have some cataloged columns I am searching for Keywords.
This table is getting huge over 6.7 million records and it is
becoming slow. What is the best method to optimize the DB for this
Search.
Do I need to create a column that
will have a keyword associated to a description of each record
or.... and search this particular column for the Records?. My
clients records at time are store like "Bolt, Flange" and some are
stored as "Bolt, Flange 1/4inch....." . Any one with any idea of
the best methodology of getting this Keyword Search Optimized and
returning faster query results?
Thanks

Consider creating a Verity collection on the appropriate
columns in your database. The frequency of database update will
help in determining if this is the appropriate thing to do.

Similar Messages

Full Text Search Enhancements in 2012 / 2014

We are currently using SQL IFTS 2008 but are considering upgrading to either SQL 2012 or SQL 2014 (leaning towards SQL 2012 as it has a longer track record and more service packs). What are the sql full text enhancements from:
2008 to 2012?
2012 to 2014?
thanks

Hi scott_m,
Please refer to the following articles:
SQL Server 2012 - Full Text Search Enhancements - Ability to search and filter within document properties:
http://beyondrelational.com/modules/4/whatisnew/361/features/7090/sql-server-2012-full-text-search-enhancements-ability-to-search-and-filter-within-document-propertie.aspx
Programmability Enhancements:
http://technet.microsoft.com/en-us/library/cc645577.aspx
If you have any feedback on our support, please click
here.
Regards,
Elvis Long
TechNet Community Support
Elvis, thanks for the info on SQL 2012 full text enhancements. I didn't see any info for SQL 2014 Full-Text Search. Do you have any info on SQL 2014 full text enhancements?
thanks
scott_m

Full text search across books in iBooks for Mavericks

Is there a way to do full text search of all documents under iBooks for Mavericks?
I have quite a few books in categories and collections that are not mutually exclusive. It is becoming quite tedious to find the book I need when I need it. I have tried search in iBooks but it only seems to hit titles, maybe some keywords, and perhaps other fields, but not the full text of the documents.
I cannot find any way in Spotlight preferences or in iBook preferences to specify that the body of documents under iBooks should be indexed/searched.
Best regards,
Tom

Just to register that I have fixed the problem.
I tried reinstalling RH, but that didn't work. I was about to
give up when I noticed that an error was coming up when I compiled
the project: the infamous "HHC6003: The file itircl.dll has not
been registered correctly". I found out that you only fix that
problem by registering another dll: itcc.dll
Once you fix this, the compilation is perfect and the
full-text Search works properly again.
Thanks anyway for the interest.
Paulo.

"Filter/partition key" for full-text searching

Hi there,
We have a challenge whereby we have a table of products by store, each store having say 200,000 products. Basically, for each store, we want to allow searching by product name. The best solution for this is to have full-text searching, but there
is no way to have a "filter" or "partition" key on the store ID.
So in essence what happens, the full-text search scans the entire full-text catalog for the products, then it uses the primary key to match to the table and then filters out the other stores. Considering we have hundreds of stores in the table, this
is not a good solution.
We contemplated adding separate indexed views and full-text catalogs for every store, but this would be a nightmare to manage.
I was expecting to see some sort of a "partition by Column" in the full-text indexes, but it doesn't exist. This basically means we have to scrap full-text and look for a third party solution.
Does anyone have any idea how we could achieve this with just standard SQL full-text searching?

Hi Adam,
Thank you for your question. I am trying to involve someone more familiar with this topic for a further look at this issue. Sometime delay might be expected from the job transferring. Your patience is greatly appreciated.
Thank you for your understanding and support.
If you have any feedback on our support, please click
here.
Elvis Long
TechNet Community Support

When can oracle support full text search for Simplified Chinese?

When I create index using the create index clause,the following errors appears
"ORA-29855: error occurred in the execution of ODCIINDEXCREATE routine
ORA-20000: interMedia Text error:
DRG-11440: operation not supported for the SIMPLIFIED CHINESE language"
Maybe I have to use like to query words...
Did somebody encounter the same problem and have a good solutions?I am expecting your help!
null

Hi,
Full-text search capabilities is not currently not supported and Unfortunately, we do not have a timeline as to when it will be available.
You can post a feedback on the below link.
http://feedback.azure.com/forums/217321-sql-database
Regards,
Mekh.

I have been searching for best app for converting handwriting to text. Write pad seems great does the app allow direct entry into a template?

I have been searching for best app for converting handwriting to text on my ipad. Writepad by Phat seems great does the app allow direct entry into a template?

Writepad only works within the app itself - it does not allow you to write in another program. While it does allow you to save a document as a text or pdf file, it won't (I believe) let you open a file created outside of Writepad and work on it (except maybe text files - would have to investigate and see).

Full text search for web ? Yes or no ?

Hi,
I have a DB that has more then 1.8mil records in a single table .... and would like to implement full text search or some sort of caching for quicker Web search ....
Let me describe you what I have .... The table that holds 1.8mil records is made out of 30 clob columns ... each holding text .... actually these are alphabetic columns ... so words that start with char 'A' are in the first clob ... 'B' in second 'C' in third and so forth ....
Searching is always done first by customerID and CreateDate which are both indexed columns , and then clobs are searched using instr ...
Execution plan was good ... but searching times started to increase ....
So therefor I would like to improve the search ... by implementing some sort of caching mechanism ....
I read a lot about this and found an example where I would create a table containing unique words and table for occurrences of the words ... but this would then
make like 1.8mil articles containing approc 500 words , which would then repeat through articles ... so ok there would be less then 50.000 unique words (in our language ) , but the occurrences would dramatically increase cause every word inside article has to have a link in occurrences table ... so this would then be like 900mil records inside table ..
Is this at all possible to have so many records inside single table ? And still make it quick ?
Is the Oracle Full text search the only right way in this situation ?
Any suggestions ? Did anyone implement anything like this ?
Thanks,
Kris

Let's start with your Oracle version. Please specify which version you run because Text capabilities vary dramatically between releases.
>
I tried using Oracle Text as suggested ... now if I understand correctly ....
CTXCAT - would be great because when new records are added, index is updated automatically .... but doesn't support CLOBs ... so no go
>
CTXCAT is a concatenated transactional index that is supposed to optimize combined searches on text and other columns. No go for you as it indeed does not support CLOB columns.
>
CONTEXT - supports CLObs , but I need to explicitly synchronize index ....
There are like 4000 inserts per day ..... and they all need to be indexed in a real-time ...
>
Not true, at least since 10g: SYNC(ON COMMIT) parameter makes this index type transactional (it's synchronized automatically on commit with this parameter set.)
>
If CTX_DLL.SYNC_INDEX procedure synchronize the whole table which is now 1.8mil records, this can take a while ... so it can't be run after inserts ....
>
It does not, it only synchronizes changed data since last sync operation.
So CONTEXT is actually perfectly suited for your needs (just redesign those 30 columns into one document column and index it.) Note that you need to regularly maintain CONTEXT indexes by scheduling CTX_DDL.OPTIMIZE_INDEX to run at off-hours and purge stale/removed data and rebuild its own internal index bitmaps for better performance. Otherwise you will see performance degrade as changes to the indexed data accumulate. You might also want to tweak initial indexing parameters, especially MEMORY parameter, as it greatly affects resulting index fragmentation - the more memory you give for initial indexing or optimization, the less fragmented and the more performant the index will be all other things equal.

Clarifications needed for full text search

Hi,
I need some clarification regarding full text search.
1) Is japanese part of the standard Oracle full text search?
2) if it is not, how to install the japanese lexer?
3) how oracle is sorting international characters. If a column contains both english, japanese and french, how will be the output?
Thanks
Muneer

Follwoing is the sql statement and the result i got
select language, description,lengthb(description) bytes, length(description) length, vsize(description) vsize from t2;
LANGUAGE      DESCRIPTION      BYTES      LENGTH      VSIZE
English      abcdefghij      10      10      10
English      zyxwvutsrq      10      10      10
French      dÃ©signÃ©ess      16      12      16
French      rÃ©concilia      13      11      13
German      EinfuhrzÃ¶l      13      11      13
German      mÃ¼ÃtÃ¤mpfer      19      13      19
Greek      Î´Î·Î¼Î¿ÏÎ¹Î¿Î³ÏÎ±      40      20      40
Greek      Î±ÏÎ¿ÎºÎ»ÎµÎ¹ÏÏÎ¹      42      20      42
Russian      Ð¿ÑÐµÑÑÑÐ¿Ð½Ð¸Ðº      42      20      42
Russian      Ð¿ÑÐ¸Ð²ÐµÐ´ÐµÐ½Ð¸Ñ      41      20      41
Japanese      å¥éå¸ã®ä¼ç¤¾ã®éè¡å£      65      30      65
Japanese      ç¥æ¸å¸ä¸å¤®åºã®æ±éå      62      30      62
Korean      ì¶ë°ì ë¶í°ì¶ë°ì ë¶í°      64      30      64
Korean      ë³´ì¢ê´ìì¶ë°ì ë¶í°ê²½      64      30      64
Hindi      à¤à¤¤à¤à¤¨à¤¤à¤®à¤¨à¤à¤¤à¤¶à¥à¤°      73      36      73
Hindi      à¤¨à¥à¤à¥à¤¨à¥à¤à¥à¤¨à¥à¤à¥à¤¨à¥à¤à¥à¤¨à¥à¤à¥      130      60      130 I think it explains a lot. I am facing another problem in searching blob columns when it contains japanese or korean characters. I tried with multi lexer (adding japanese as sub lexer and making english as default lexer). But it is not searching the column. Do i have to set any other parameters (editing registry, changing enviornment setting etc). I used the following script to set the lexer.
begin
     ctx_ddl.create_preference('english_lexer','basic_lexer');
     ctx_ddl.set_attribute('english_lexer','index_themes','yes');
     ctx_ddl.set_attribute('english_lexer','theme_language','english');
     ctx_ddl.create_preference('german_lexer','basic_lexer');
     ctx_ddl.set_attribute('german_lexer','composite','german');
     ctx_ddl.set_attribute('german_lexer','mixed_case','yes');
     ctx_ddl.set_attribute('german_lexer','alternate_spelling','german');
     ctx_ddl.create_preference('japanese_lexer','japanese_vgram_lexer');
     ctx_ddl.create_preference('korean_lexer','KOREAN_MORPH_LEXER');
     ctx_ddl.set_attribute('korean_lexer','COMPOSITE','NGRAM');
     ctx_ddl.create_preference('global_lexer', 'multi_lexer');
     ctx_ddl.add_sub_lexer('global_lexer','default','english_lexer');
     ctx_ddl.add_sub_lexer('global_lexer','german','german_lexer','ger');
     ctx_ddl.add_sub_lexer('global_lexer','japanese','japanese_lexer','jpn');
     ctx_ddl.add_sub_lexer('global_lexer','korean','Korean_lexer');
end;Hope i presented enough details.

TREX Full-Text search on Solution Directory

Hi Experts,
I have a problem with Full-Text search on the Solution Directory. Basically it doesn't work at all.
In transaction SOLUTION_MANAGER I choose a solution and then ->Operation Setup -> Solution Settings. At that point from the top menu I choose Solution Directory -> Find Document...
When I trigger the search using normal attributes the process finds documents related to this Solution without any problem. However, when I search using the "Full-Text Search" feature, the process doesn't find any document at all even though they exist.
Why is this functionality not working? Is this problem related to TREX?
What should i do to fix it? How do I create an index for these documents?
I haven't been able to solve this issue as TREX seams to work fine... can anybody help me out?
Any idea?
Many thanks,
Aldo

David:
I want to know if Oracle Context Option to need run over Oracle Application Server for to work search over multiple tables???
Exist some method for this (Context) run without to use Oracle Application Server???
select * from table_name where
contains(column_name1, 'keywords')>0 AND
contains(column_name2, 'keywords')>0However, using the Concatenated Datastore to create one index that has all the columns to be searched as sections will get better performance, since your query then only needs to use one contains statement across one index.
select * from table_name where
contains(indexed_column_name,
'(keywords WITHIN section_name1) AND
(keywords WITHIN section_name2) AND
keyords')>0Note: The last keyword in this query is so you search the indexed column as well, which is not a section. You could also create a dummy column to create the index on, and make all columns to search sections of that.
Cheers
David<HR></BLOCKQUOTE>
null

Full text search in a dynamic table

Hi all,
Can any one tell me how to do a full text search in a dynamic(ie. always have INSERT or DELETE action) table? I created a context index on the column which data type is LONG. But I can't get search results for those records that I inserted new data after Creating index.
Thanks a lot!

David:
I want to know if Oracle Context Option to need run over Oracle Application Server for to work search over multiple tables???
Exist some method for this (Context) run without to use Oracle Application Server???
select * from table_name where
contains(column_name1, 'keywords')>0 AND
contains(column_name2, 'keywords')>0However, using the Concatenated Datastore to create one index that has all the columns to be searched as sections will get better performance, since your query then only needs to use one contains statement across one index.
select * from table_name where
contains(indexed_column_name,
'(keywords WITHIN section_name1) AND
(keywords WITHIN section_name2) AND
keyords')>0Note: The last keyword in this query is so you search the indexed column as well, which is not a section. You could also create a dummy column to create the index on, and make all columns to search sections of that.
Cheers
David<HR></BLOCKQUOTE>
null

Document Management / Full Text Search in Projects & SolMan Directory

Hello experts!
I want to implement Full Text Search in my SolMan and therefore need your help.
I have installed Trex 7.10 and am already able to search within my Solution Database (Problems/Solutions).
Now I want to be able to search within all documents in my SolMan Installation - e.g. Roadmaps, SAP Scenario Descriptions or my own uploaded documents.
In the IMG I already found the section Document Management but I cannot get the needed RFCs (IMSDEFAULT and IMSDEFAULT_REG) working.
There is already a RFC called IMSDEFAULT, which was created during the installation of Trex and runs the
Registered Server-Program: Trex_SOT_20080327090311
I tried to configure my RFCs according to the IMG but, as I said, cannot manage to get them working.
I hope anybody has an idea or an guide on how to implement Full Text Search!
Please be so kind and provide help - thanks in advance!
Best regards
Gerold

Gerold,
I am running into the same issues because we want to do full text search on project documentation within Solution Manager. The default RFC connections IMSDEFAULT_REG and IMSDEFAULT do not work with the standard settings.
We created one index for IWBSOLAR so maybe I also need to check IWBPROJ in SKPR06 for project documentation and create a new index for this one ?
The indexing for IWBSOLAR now fails although there seem to be over 6000 documents marked but none are put in the index. After indexing there is a list of the documents all with code 6401 but cannot find any where what this code means. It seems to be succesful as all entries are green.
Any help/suggestions on this topice would be greatly appreciated.

Full-text search not available after upgrade from SQL 2008 R2 Std to SQL 2012 Std

We upgraded our production SQL Server from 2008 R2 Std to 2012 Std last week, and the installation logs show everything was successful, but now we are unable to do any searches against our full-text indexes. The resulting error is as follows:
"Full-Text Search is not installed, or a full-text component cannot be loaded."
When executing the query "SELECT FULLTEXTSERVICEPROPERTY('ISFULLTEXTINSTALLED')", the result is "0". The "Full-Text Daemon Launcher service is also running. When running installation again to add the feature, it shows
"Full-Text and Semantic Extractions for Search" as being installed and unavailable for selection in the list of features to add. As a side note, we did the same upgrade in our identical QA environment before production and everything was successful
and full-text searches are working correctly. We have run the "Repair" routine in the SQL Installation Center and it did not correct the problem.
The full-text catalogs still appear when browsing through the GUI in SSMS or querying sys.fulltext_indexes and sys.fulltext_index_columns. It is not possible to view the properties of the catalog in SSMS, though, as the GUI throws an error and an empty
dialog box is shown. Any other thoughts?
Thanks,
AJ

I have no idea what is going, but assuming that it is a little pressing to get this fix, I think the best path in this case is to open a case with Microsoft.
Erland Sommarskog, SQL Server MVP, [email protected]

Can we enable full text search using TOAD ?

Hi, i m new to oracle, i come from sql server background
There is a server in israel where oracle 10 g is installed. I stay in india. i want to connect to that database(with valid credentials) and want to know if i can enable full text search feature or any other related feature so that i can search a few keywords as i dont know what tables contain what data.
Plz guide

WhiteHat wrote:
923860 wrote:
Hi, i m new to oracle, i come from sql server background
There is a server in israel where oracle 10 g is installed. I stay in india. i want to connect to that database(with valid credentials) and want to know if i can enable full text search feature or any other related feature so that i can search a few keywords as i dont know what tables contain what data.
Plz guideyou want to be able to search all fields in all tables?
I don't think this is possible to do in any RDMS! to be a developer you must know the schema. When I was working with Toad it had such an option. I guess it is still there. And that was one of the things that was really really useful.
Of cause TOAD knows the schema. And you could choose where you want to search (include trigger code or not, include data, etc.).
But I'm not sure if there are any requirements for this option. The question should be better asked in a quest-TOAD forum.
Edited by: Sven W. on Mar 28, 2012 9:31 AM

Executing a full-text search using KM APIs

Hello,
I'm doing a KM Folder search using KM APIs. The code looks similar to this
=====================================================
IGenericQueryFactory queryFactory = GenericQueryFactory.getInstance();
     IQueryBuilder queryBldr = queryFactory.getQueryBuilder();
     IPropertyName ipn = new PropertyName("http://sapportals.com/xmlns/cm", "lang");
     IQueryExpression queryExpr =
          queryBldr.like(ipn, language.toLowerCase());
     IGenericQuery query = queryFactory.toGenericQuery(queryExpr);
     IResourceList result = query.execute(
     collection, Integer.MAX_VALUE,7,false);
======================================================
Issue: How can I execute a full-text search using these APIs.
i.e. If the keyword exists in the body of the document, the search should return that document.
Any help on this would be much appreciated.
Thanks,
Harman

Thanks for your helpful answers.
So, which APIs should I use to accomplish my goal? I need to search for custom KM attributes, AND the body of the document.
We are currently running EP6 SP2.
Should I use the IFederatedSearch API.
Thanks,
Harman

Preparing Full Text Search(TREX)

Dear Guru.
We have installed a search engine such as TREX and RFC Connection is completed. I have entered the document class DMS_PCD1 in T. code (SKPR07) and click the button in “Test search” but no result found.
I have also checked the full text search through cv04n but I found the error (Technical error with document full text search, contact system admin).
Kindly also send me the creating index step by step for DMS.
Need your help in urgent basis.
Best Regards,
Umar Farooq

I'm sorry to recheck but I have to be sure about this.
What you are telling me is that, if a user doesn't have read permissions for a given document in SAP ECC Document Management System (documents stored in transactions such as CV01N) results won't show up in the TREX search?

Best Method For Keyword Search (Full Text Search)

Similar Messages

Maybe you are looking for