Kazehakase with full-text search in history using Hyper Estraier

A guide for Kazehakase with full-text history search using Hyper Estraier
I adopted qdbm and submitted hyperestraier in AUR, so you can enable full-text search frature by installing Hyper Estraier from AUR and rebuilding Kazehakase using srcpac or yaourt.
1. Install QDBM and Hyper Estraier from AUR. The easiest way is using yaourt. (If you prefer not to use yaourt, download tarball and do makepkg && pacman -U manually.)
yaourt -S qdbm hyperestraier
2. Rebuild Kazehakase using srcpac.
srcpac -Sb kazehakase
Of cource you can rebuild Kazehakase using yaourt.
yaourt -Sb kazehakase
You don't have to modify configure option in PKGBUILD of Kazehakase, because "--enable-hyper-estraier" is implied by default. If Hyper Estraier is installed successfully, you'll get "Hyper Estraier: yes" in configure messages.
3. Configure Kazehakase. To enable full-text search in history, run Kazehakase and go Edit>Preference>General and change UI Level to "Expert" and apply settings. Next, go Edit>Preference>History and set Search engine name to "hyper-estraier" and restart Kazehakase. Then you'll see "History Search" box next to "Internet Search" box.
Sorry for my poor English.

"ctxsrv" is no longer supported at version 10.1.
Instead PARAMETERS clause has SYNC option, and you can specify ON COMMIT for this.
If you created the database with DBCA and chose Oracle Text option, then you have no need to perform any further operations to configure Oracle Text.

Similar Messages

Problem with full-text search in RH8

Hi All,
I've just upgraded from RH6 to RH8 (laptop running Windows XP SP3; RH6 still present on the computer but the RH8 setup program did not seem to have a problem with that: identified an earlier version was present, asked for its serial number, and then proceeded).
RH8 is working just fine, except for one thing: in the WebHelp output I generate, the Search tab displays: "Error: Failed to initialize database".
As a matter of fact, the generation details in RH8 output view state:
Processing Full-text-search data...
Finished processing Full-Text-Search data in 0 sec(s)
This is the case for legacy projects that RH8 upgraded from RH6, but also when I create a project from scratch in RH8.
Now, to add to my confusion, before buying RH8, I had downloaded RH8 trial version and installed it on a spare computer (so it would not interfere with my RH6 installation and projects). The tests with this version were OK (hence the decision to buy the upgrade), and guess what: there was no problem whatsoever with full-text search, neither on legacy projects nor on new projects.
So before I go into the pains of uninstalling / reinstalling (hello registry, it's me again, trying to clean things up ;-), I'd like to know if anyone has any idea why this is happening.
Just to be clear: The RH8 version I bought and installed was a new download, distinct from the initial trial download.
The 3 differences between the trial version and the current working version are:
Trial was on a Vista computer (working version is on XP SP3)
Trial did not have RH6 present on the computer
Trial was version 8.0.0.203, whereas the working version is 8.0.2.208 (immediately after it was installed, RH prompted me to install the updates)
Thanks in advance for any help or advice.

Hi All,
Just for the record, IT people here were eventually able to have RH8 full-text search feature working on my laptop by:
1/ Installing an XP virtual machine from scratch, and then installing RH8 on it (we created a small project and generated the webhelp output, just to make sure the search feature did work in that environment).
2/ Using a software virtualization application to capture that RH8 install and deploy it on my laptop.
The problem is not solved, because we still don't know what caused it (conflicting DLLs?), but it looks like we have a workaround - although certainly not a quick and easy one ;-)

Is it possible to ignore noise words conditionally in working with Full text search containstable

I have a question on stoplist file. I need to search for exact phrase string("this is the incident") which contains noise words. As part of the FT search engine, during parsing it eliminates noise word and search on remaining string in
the given phrase.
let us say there are 10 rows which contains the term "incident" in the FT table . and 1 row which has the exact phrase.i.e."this is the incident".
if we use containstable() to search for "this is the incident", we are getting 10 rows instead of 1 row.
To resolve the issue, we have 3 solutions
1.either stoplist file needs to be modified to remove the words (this,is,the)
2. set stoplist = OFF.
3.empty stoplist.
Apart from the above solutions, is there any better solution with out touching noise words file list.
If any solution that provides flexibility to ignore noise words conditionally at one time and not to ignore them.
Please provide your suggestion.
kkprasad

One question that I ask is: Why would I want to exclude noise words?
Noise words were created to limit the size of the full text indexes and avoid processing the many 'this', 'is', and 'the' common words. But the disadvantage of doing so is that you cannot find some things as you would like.
My feeling is that computers are more powerful and have more storage and it is often better to just index everything. As long as your search does not include 'the', then the large number of 'the's in the system will pretty much be ignored.
NOTE: If you change the noise words, including SET STOPLIST = OFF, you have to rebuild the index in order for it to implement your decision.
Of course, for very, very large full text indexes you would need to test.
Is your full text search on relation database columns, e.g. Description NVARCHAR(1000) or are you searching Word, Excel, and other more complex data?
If your full text is relational columns, it might be that you could:
1. Select only the fulltextkey into a temp table (e.g. #FTSfulltextkey) from the full text index using noise words. That would give you 10 rows.
2. Then directly query the table to find the string as you define above. (But remember that punctuation and symbols are generally ignored by Full Text Indexing, but would still be there in the string of text.)
SELECT *
FROM MyTextTable T
JOIN #FTSfulltextkey K
ON T.fulltextkey = k.fulltextkey
WHERE T.Description like '%this is the incident%'
Full text search is powerful, but it has limits. And the behaviour changes depending on the Language of the search.
RLF

Full-Text search is not working with PDF files - SQL Server 2012 64 bit

Hi,
We are in the process of storing PDF files in SQL Server 2012 with Full-Text search capability.
I followed the steps as below and it works fine with word document but not for PDF files. I tried with PDF ifiler 11 & 9 and both are unsuccessful.
Server/DB Level Settings:
1)
Enable FileStream
2)
Install Full-Text
then restart
3)
Use [specific db]
alter
database [db name]
add
filegroup Files
contains filestream;
alter
database [db name]
add
file (
name = N'Files',
filename =
N'D:\SQL\DATA') to
filegroup [Files];
3)
Database level
Settings:
FileStream:
FileStream
Directory name:
[Set the name]
FileStream
non-transacted
Access: [set Appropriate]
3a)
Add a
datafile to DB
with filestreamdata
filetype.
4)
Share D:\SQL\DATA
directory and
add specific accounts
with read/write
access
5)
Give bulkadmin
access to those
specific accounts
at server
level
6)
From the
page (link)
download and
install the *.pdf
IFilter for
FTS. Link:
http://www.adobe.com/support/downloads/detail.jsp?ftpID=5542
7)
To the
PATH global system
variable add
path to the
catalog,
where you installed
the plugin.
Default for
this version is:
C:\Program
Files\Adobe\Adobe
PDF iFilter 9
for 64-bit
platforms\bin
8)
From the
page (link)
download a
FilterPackx64.exe
and install
it. Link:
http://www.microsoft.com/en-us/download/confirmation.aspx?id=20109
9)
Now from
SSMS execute the following
procedures:
-sp_fulltext_service
'load_os_resources',1
-sp_fulltext_service
'verify_signature', 0
EXEC
sp_fulltext_service
'update_languages';
-- update language list
EXEC
sp_fulltext_service
'restart_all_fdhosts';
-- restart daemon
reconfigure
with override;
10)
Restart the
server
11)
select document_type,
path from
sys.fulltext_document_types
where document_type
= '.pdf'
-select
document_type,
path from sys.fulltext_document_types
where document_type
= '.docx'
12) Results are OK.
Following is my Table /Index/ catalog script:
CREATE
TABLE dbo.DocumentFilesTest
DocumentId INT
IDENTITY(1,1)
NOT NULL
PRIMARY KEY,
AddDate datetime
NOT NULL,
Name nvarchar(50)
NOT NULL,
Extension nvarchar(10)
NOT NULL,
Description nvarchar(1000)
NULL,
FileStream_Id UNIQUEIDENTIFIER
ROWGUIDCOL NOT
NULL UNIQUE DEFAULT
NEWSEQUENTIALID(),
FileSource varbinary(MAX)
FILESTREAM DEFAULT(0x)
go
--Add default add date for document
ALTER
TABLE dbo.DocumentFilesTest
ADD CONSTRAINT
DF_DocumentFilesTest_AddDate
DEFAULT sysdatetime()
FOR AddDate
EXEC
sp_fulltext_database
'enable'
GO
IF
NOT EXISTS
(SELECT
TOP 1 1 FROM sys.fulltext_catalogs
WHERE name
= 'Ducuments_Catalog_test')
BEGIN
EXEC sp_fulltext_catalog
'Ducuments_Catalog_test',
'create',
'D:\SQL\PDFBlob';
END
--EXEC sp_fulltext_catalog 'Ducuments_Catalog_test', 'drop'
DECLARE
@indexName nvarchar(255)
= (SELECT
Top 1 i.Name
from sys.indexes
i
Join sys.tables
t on
i.object_id
= t.object_id
WHERE t.Name
= 'DocumentFilesTest'
AND i.type_desc
= 'CLUSTERED')
PRINT @indexName
EXEC
sp_fulltext_table
'DocumentFilesTest',
'create',
'Ducuments_Catalog_test',
@indexName
EXEC
sp_fulltext_column
'DocumentFilesTest',
'FileSource',
'add', 0,
'Extension'
EXEC
sp_fulltext_table
'DocumentFilesTest',
'activate'
EXEC
sp_fulltext_catalog
'Ducuments_Catalog_test',
'start_full'
ALTER
FULLTEXT INDEX
ON [dbo].[DocumentFilesTest]
ENABLE
ALTER
FULLTEXT INDEX
ON [dbo].[DocumentFilesTest]
SET CHANGE_TRACKING
= AUTO
ALTER
FULLTEXT CATALOG
Ducuments_Catalog_test REBUILD
WITH ACCENT_SENSITIVITY=OFF;
INSERT
INTO DocumentFilesTest(Extension,
Name,
FileSource)
SELECT
'pdf'
'BOL12006553.pdf'
* FROM
OPENROWSET(BULK
'd:\SQL\PDFBlob\BOL12006553.pdf',
SINGLE_BLOB)
AS BLOB;
GO
INSERT
INTO DocumentFilesTest(Extension,
Name,
FileSource)
SELECT
'docx'
'test.docx'
* FROM
OPENROWSET(BULK
'd:\SQL\PDFBlob\test.docx',
SINGLE_BLOB)
AS Document;
GO
SELECT
d.*
FROM dbo.DocumentFilesTest
d WHERE
Contains(d.FileSource,
'BILL')
Returns nothing. it should come from PDF file
SELECT
d.*
FROM dbo.DocumentFilesTest
d WHERE
Contains(d.FileSource,
'TEST')
Returns from word document as follows:
2           2014-06-04 10:11:41.393            test.docx docx
NULL   [BINARY Value] [Binary Value]
Any help is appreciated. Its been a long wait.
Thanks,
Vel
Vel Thavasi

Hello,
Did you check the fulltext log files for more details about the errors. If the filter isn’t working, there should be errors in the error log file.
The following thread is about similar issue, please refer to:
http://social.msdn.microsoft.com/forums/sqlserver/en-US/69535dbc-c7ef-402d-a347-d3d3e4860d72/sql-server-2008-64bit-fulltext-indexing-pdf-not-working-cant-find-ifilter
Regards,
Fanny Liu
If you have any feedback on our support, please click here.
Fanny Liu
TechNet Community Support

TREX Full-Text search on Solution Directory

Hi Experts,
I have a problem with Full-Text search on the Solution Directory. Basically it doesn't work at all.
In transaction SOLUTION_MANAGER I choose a solution and then ->Operation Setup -> Solution Settings. At that point from the top menu I choose Solution Directory -> Find Document...
When I trigger the search using normal attributes the process finds documents related to this Solution without any problem. However, when I search using the "Full-Text Search" feature, the process doesn't find any document at all even though they exist.
Why is this functionality not working? Is this problem related to TREX?
What should i do to fix it? How do I create an index for these documents?
I haven't been able to solve this issue as TREX seams to work fine... can anybody help me out?
Any idea?
Many thanks,
Aldo

David:
I want to know if Oracle Context Option to need run over Oracle Application Server for to work search over multiple tables???
Exist some method for this (Context) run without to use Oracle Application Server???
select * from table_name where
contains(column_name1, 'keywords')>0 AND
contains(column_name2, 'keywords')>0However, using the Concatenated Datastore to create one index that has all the columns to be searched as sections will get better performance, since your query then only needs to use one contains statement across one index.
select * from table_name where
contains(indexed_column_name,
'(keywords WITHIN section_name1) AND
(keywords WITHIN section_name2) AND
keyords')>0Note: The last keyword in this query is so you search the indexed column as well, which is not a section. You could also create a dummy column to create the index on, and make all columns to search sections of that.
Cheers
David<HR></BLOCKQUOTE>
null

AIR and full-text search in SQLite

Hi,
can I use full-text indexing capabilities of SQLite with my
AIR app?
I've created a virtual table in database using fts3 module
(via command line of sqlite.exe). But when I try to insert a row
into this table, I get an error message like
...SQLError: 'Error #3115: SQL Error.', details:'no such
module: fts3', operation:'execute', detailID:'2501'...
Does AIR Data library support FTS in SQLite?

Yes, Adobe has disabled loadable modules but that does not
prevent them from including FTS3 in AIR's SQLite.
PLEASE, statically compile in both the FTS3 module and the
R*Tree Spatial Index module.
The beauty of AIR is that you can have an application that
works offline (duh!, right?). When it's online, you can do a full
text search in it, using the powerful server-side database's
functionality. Now when you go offline, you're completely crippled!
... Because Adobe didn't put FTS3 in SQLite.
' Same with Spatial functionality.
I'd sure like to know how companies make these decisions.
>sigh< It is EXTREMELY frustrating to be limited by
apparently arbitrary decisions like these. I sure hope this was not
motivated by a desire to "encourage" people to use their commercial
productions such as BlazeDS. I'd like to think better of Adobe than
that.
Again, PLEASE include these modules in the next release.
Scott

Disable Full Text Search in Records Management

Hi Everyone,
This is Shiva, we implemented SAP Records management & i am came in middle of this project. Right now client want to do some customizations in Records.
Actually i need to disable Full Text Search under Records. Under Cross Query i disabled the Full text by the following process
(Two sample element types are delivered with the service provider
SRM_SP_QUERY:
SRM_SPS_QUERY
Search for records, documents, cases, record models and file plans
SRM_SPS_QUERY_REC_DOC)
Under(SPRO) Cross SP search based on Property Unification; you can able to disable the FullText search field(this will be effects only for Cross Query), but under Records, when you right click there will be one option called FIND in which i am unable to disable the FULL TEXT search.
I used DMWB T-code under LOIO, i search for Standard/free/instance attributes, but i didn't find any Full Text Search Field in that one.
Can anyone please help me in this. I really appreciate your inputs & help.
Thanks,
Shiva.
Edited by: Shivasap on Aug 2, 2010 6:01 PM
Edited by: Shivasap on Aug 3, 2010 4:01 PM

Dear Shiva,
Full text search needs to be deactivated at content model level for attributes. You will find a document class in the element type of the record. In transaction DMWB, you will find LOIO & PHIO classes for the document class. For each attribute, you will find a checkbox "index-relevant" which needs to be unticked if you dont want to use TREX. For deactivating full-text search for which a field is given in the FIND popup, TREX needs to be deactivated. There is no option to deactivate just for a record element type in RM. Unfortunately, the field itself cannot be hidden. This is programmed in the logic.
Best Regards,
Pragya

Full text search

recently I found a problem with full text search. e.g. I search according to "AAA". I get some documents in result list with highlighted "AAA". Some highlighted "AAA" is with "#" at beginning (#AAA) and
in this case I cannot find this word neither in content of document nor in metadata of document. Why those documents will be displayed in result list? Where is the "AAA" coming from? What is the meaning with "#" ?

What type of document is appearing with "#AAA"?
The search results typically show some context with surrounding text, can you gather where in the file it sees #AAA?
If you open the file up in a text editor can you find "#AAA"?
Are you actually searching for "AAA" or something else and you're saying "AAA" here as a placeholder?
Jason Warren
@jaspnwarren
jasonwarren.ca
habaneroconsulting.com/Insights

Full Text Searching

I have one user who has issues with full text searching. We're running GW7.0.2 on OES2 - with approximately 140 users - one of which experiences extreme slowness with full text searching. We utilize the DMS - so he's attempting searches thru docs and emails. He does have a rather large mailbox - but his problem started middle of last week. We've run GWChecks (Structure/Content/Rebuild) on his user and message databases - still slow. We've archived mail out (reducing the size of his mailbox) - still slow.
Any ideas?
Thanks!
Sue

Hey Dave!
It does appear to affect his email and not the documents, so much. He gets fairly quick results in the library section.....but searching emails takes longer than he has patience for. Can you clue me on how to redo his email indexes - and nothing else? Or isn't that possible? (hate to mess up someone else trying to fix this guy! lol)
Thanks!
Sue

QUESTION OF FULL TEXT SEARCH IN R/3 4.6C USING TREX IN EP 6.0 SP9

Hi all:
I can use R/3(46c) plus content server(6.3) to store
Documents by KPRO.I've installed EP(6.0 sp9) plus Trex(6.1sp9).I want use this Trex to implement full text search,I can see the index id in the trex_xx\index directory.when I use tcode skpr07,I can find no problem,But when I use tcode cv04n,I can not find any document,the system does not display any error.
What's wrong?

hi there
can anyone help me with this...
How to integrate TREX in SAP R/3 System.
I found that u r discussing abt TREX in SAP R/3. Can u people help me with the basics required for that....
I have tried TREX in SAP Enterprise Portal and its working.
Now i would like to incorporate TREx in R/3 system.
How do we do that... Is it necessary that we need to install SAP Gateway in TREX host. Or is it possible without that.
Can anyone brief me on what are the important settings to be made for that.
Also i came across the RFC destination creation for connecting TREX with the R/3 system.
I would like to know what kind of data is commonly indexed in R/3 and that too how. What is it that provides an interface for the user.
In the case of portal we define a a KM repository as the datasource likewise in R/3 system what do we define as datasource.
I know these questions may sound very silly... pls do help
regards
Sasha

Can we enable full text search using TOAD ?

Hi, i m new to oracle, i come from sql server background
There is a server in israel where oracle 10 g is installed. I stay in india. i want to connect to that database(with valid credentials) and want to know if i can enable full text search feature or any other related feature so that i can search a few keywords as i dont know what tables contain what data.
Plz guide

WhiteHat wrote:
923860 wrote:
Hi, i m new to oracle, i come from sql server background
There is a server in israel where oracle 10 g is installed. I stay in india. i want to connect to that database(with valid credentials) and want to know if i can enable full text search feature or any other related feature so that i can search a few keywords as i dont know what tables contain what data.
Plz guideyou want to be able to search all fields in all tables?
I don't think this is possible to do in any RDMS! to be a developer you must know the schema. When I was working with Toad it had such an option. I guess it is still there. And that was one of the things that was really really useful.
Of cause TOAD knows the schema. And you could choose where you want to search (include trigger code or not, include data, etc.).
But I'm not sure if there are any requirements for this option. The question should be better asked in a quest-TOAD forum.
Edited by: Sven W. on Mar 28, 2012 9:31 AM

Full-text search in ucm10g with wc search taskflow

hi all,
I am using wc11.1.13 plus ucm10gr3.
I checked in a content with both Primary File and Alternate File , I used webcenter search taskflow to search word in alternate file, but search result show me the Primary File, how to resolve this issue?
I also opened a case in ucm forum.
Best regards

Hi Atrsams,
According to your description, you want to implement Full Text Search in Analysis Services Cube, right? Base on my research, there is no such a functionally to achieve Full Text Search in Analysis Services currently. And it seems that there is no any
solution or workaround for it. I recommend you to submit this at
https://connect.microsoft.com/SQLServer/ So that the product team can consider to solve it in the next SQL Server version. Your feedback is valuable for us to improve our products and increase the level
of service provided.
Thanks for your understanding.
Regards,
Charlie Liao
TechNet Community Support

Problems using and configuring Oracle 10gR2 database full-text search

I am having problems trying to set up full-text indexing and search with Universal Content Management (UCM). I followed the Oracle Content Server Installation Guide for windows at [http://download-west.oracle.com/docs/cd/E10316_01/cs/cs_doc_10/documentation/integrator/install_cserver_win_10en.pdf].
What I did was:
1. Modify E:\oracle\ucm\server\config\config.cfg by adding SearchIndexerEngineName=DATABASE.FULLTEXT to the end of the file.
2. Restart the content server.
3. Rebuild the search indexing using Repository Manager.
However, I keep seeing the following error when I query by entering words in the "Full-Text Search" box.
Unable to retrieve search results. Unable to retrieve search results. Unable to create result set for query 'SELECT IdcColl1.dID, dDocName, dDocTitle, dDocType, dRevisionID, dSecurityGroup, dDocAuthor, dDocAccount, dRevLabel, dFormat, dOriginalName, dExtension, dWebExtension, dInDate, dOutDate, dCreateDate, dPublishType, dRendition1, dRendition2, VaultFileSize, WebFileSize, URL, dFullTextFormat, dFullTextCharset, DocMeta.*
FROM IdcColl1, DocMeta
WHERE IdcColl1.dID=DocMeta.dID AND (((CONTAINS(dDocFullText,'test') > 0 ))) ORDER BY dInDate Desc'. ORA-20000: Oracle Text error:
DRG-10599: column is not indexed
Some web searches suggested the following (all of which I have tried but not resolved this problem).
1. Publish the schema using Configuration Manager (applet) and then rebuild index
2. Set the dDocFullText as a "zone field". This is not possible, because dDocFullText does not show up under the list of fields under "Database" or "DatabaseFullText" for the Search Engine drop down (when using Zone Fields Configuration).
3. Reboot the server (did not work either).
I logged onto the Oracle database and checked the IdcColl1 table. There is indeed, no index for the field, dDocFullText. There is only 1 index for the field, did. The field, dDocFullText, is a BLOB. The question is, if I am supposed to create an index manually for this field, how would I do it? A web search has not been fruitful in answering this question.
Here are my server settings.
For UCM:
Operating System: Windows 2003 Enterprise
UCM : 10gR3
Memory: 1 GB
Web Server: Apache 2.2.11
For Oracle:
Operating System: Windows 2003 Enterprise
Oracle: 10gR2
Memory: 1 GB
Thanks.

I found out what the problem was. The problem was that I had to create the role, stellent_role, as described in the installation manual. After I created this role and assigned the database user to this role, a restart of the Content Server services and collection rebuild of the index fixed the problem.
However, I did notice one thing. I checked in 3 PDF files, and when I used Repository Manager to do a collection rebuild, I noticed that for Indexer Counters, the count for Full Text was 0 and the count for Meta Only was 3.
Anyone have any ideas? Is there something else that I missed? From reading the installation manual, it was not clear how database full-text indexing/searching would handle PDF files.

Executing a full-text search using KM APIs

Hello,
I'm doing a KM Folder search using KM APIs. The code looks similar to this
=====================================================
IGenericQueryFactory queryFactory = GenericQueryFactory.getInstance();
     IQueryBuilder queryBldr = queryFactory.getQueryBuilder();
     IPropertyName ipn = new PropertyName("http://sapportals.com/xmlns/cm", "lang");
     IQueryExpression queryExpr =
          queryBldr.like(ipn, language.toLowerCase());
     IGenericQuery query = queryFactory.toGenericQuery(queryExpr);
     IResourceList result = query.execute(
     collection, Integer.MAX_VALUE,7,false);
======================================================
Issue: How can I execute a full-text search using these APIs.
i.e. If the keyword exists in the body of the document, the search should return that document.
Any help on this would be much appreciated.
Thanks,
Harman

Thanks for your helpful answers.
So, which APIs should I use to accomplish my goal? I need to search for custom KM attributes, AND the body of the document.
We are currently running EP6 SP2.
Should I use the IFederatedSearch API.
Thanks,
Harman

Using Punctuations in Full Text Searches

Hi, I'm having a bit of trouble implementing full text search effectively in regards to punctuations.
In my thesaurus file I have something along the lines of
<expansion>
intl
int'l
international
</expansion>
and when I run the query
select * from sys.dm_fts_parser('Formsof(freetext,"international")',1033,null,0)
it show's that it is included
international's
internationals
internationals'
international
intl
int'l
However when I do end up running the query using Contains, it ignores everything that contains int'l and only returns the results of the other matches.

I am moving it to Search.
Kalman Toth Database & OLAP Architect
SQL Server 2014 Design & Programming
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

Kazehakase with full-text search in history using Hyper Estraier

Similar Messages

Maybe you are looking for