Full Text Indexing for Arabic using NVARCHAR and NCLOB?

We have an Arabic database that uses UTF-16 and NVARCHAR and NCLOB column types.
The full text indexing of Oracle gives an error saying that it does not support these column types.
Can you please help by telling us what is the workaround for this?

The only workarounds are:
1) Store data in VARCHAR2 and CLOB in a AL32UTF8 database, or
2) Use BLOB for document storage - unfortunately, this may be expensive for a lot of short text
-- Sergiusz

Similar Messages

Is a Full Text Index search case sensitive or not in SQL Server 2012?

I setup full text index on my contact table and am attempting to run a search on it using the following query:
SELECT *
FROM sysdba.Contact C
WHERE CONTAINS(C.FirstName, 'Test')
OR CONTAINS(C.LastName, 'Test')
The problem is it's clearly running a case sensitive search. I did a quick search to find out how to change it to be case in-sensitive and found two pages (both for SQL Server 2012) with conflicting answers:
1 - MSDN - "Query with Full-Text Search" - http://msdn.microsoft.com/en-us/library/ms142583(v=sql.110).aspx
Case sensitivity
Full-text search queries are case-insensitive. However, in Japanese, there are multiple phonetic orthographies in which the concept of orthographic normalization is akin to case insensitivity (for example, kana = insensitivity). This type of orthographic normalization
is not supported.
1 - TechNet - "Full-Text Search (SQL Server)" - http://technet.microsoft.com/en-us/library/ms142571(v=sql.110).aspx
Full-text queries are
not case-sensitive. For example, searching for "Aluminum" or "aluminum" returns the same results.
Can someone please explain this? Is it possible to do it without it being case sensitive? If yes, how?
(Sorry, I couldn't make those links b/c TechNet hasn't verified my account)
Thank you for your time and help,
Hanan

Whats the collation setting for the columns? try using a case insensitive collation as below
SELECT *
FROM sysdba.Contact C
WHERE CONTAINS(C.FirstName COLLATE SQL_Latin1_General_CP1_CI_AS, 'Test')
OR CONTAINS(C.LastName COLLATE SQL_Latin1_General_CP1_CI_AS, 'Test')
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

SQL Server 2008 R2 Express Edition and Full Text Indexing

Hello, we have recently upgraded our web front end server from SQL Server 2005 (Standard Edition) to SQL Server 2008 R2 Express Edition (in conjuction with upgrading our main production servers to SQL 2008 R2 Standard). We have 12 Databases on our production
SQL Server that are replicated to our web frontend server to the SQL Express instance. One of these databases has a FULL TEXT INDEX. The production database is running the Adobe iFilter version 9 64Bit. The FULL TEXT CATALOG has been created and populated
and performs searches as intended. However, upon replication, when using the search option on our web page based on that PDF iFilter, it no longer works. After examining the properties of the FULL TEXT CATALOG, we note that the Catalog size on the subscriber
end is 0MB in size (whereas it is 3MB on the Publication side). Also the Unique Key Count on the subscriber side is '1' whereas on the publisher side it is 30,000+. After examining the FT Indexing logs on the subscriber side shows an error: "Warning: No appropriate
filter was found during full-text index population" On the subscriber side which is running Windows Server 2003 and SQL Server 2008 R2 Express Edition, Adobe Reader 10.1.1 is installed (all 32Bit) with the Adobe iFilter AcroRdIF.dll. When running the SELECT
* from sys.fulltext_document_types T-Sql statement, the list returned shows the PDF filter to be installed and shows the correct path. Under the System Environment Variables, that path has also been installed (from previous recommendations in researching this
problem). After numerous reboots, service restarts and re-attempts to get the FT Daemon to crawl - no success. Can anyone please help with this problem? Is there something I am missing? In an attempt to work around this problem thinking there might be a version
conflict between the 64Bit version on the publisher and the 32Bit version on the subscriber, I disabled the replication of the FULL TEXT CATALOG and tried to create a new catalog on the subscriber with the same results. Thank you for your answers in advance
- Fustrated! Sorry, somehow this got posted originally under Server Design

Hello Jeff hope your still out there. I wrote this question 2 years ago and upgraded to SQL Express with advanced services. Full Text replication worked until last week. We are operating in a virtual environment. My publisher box
is a Windows Server 2008 R2 (64bit) with SQL Server Standard Edition. My Web front subscriber is a Windows 2003 R2 (32bit) Server with SQL Server 2008 R2 Express SP1 with Advanced Services. Now the exact same thing is happening after 2+ years.
We are looking for possible updates that might have broken this but I am stretching that. Any clues please? 32bit vs. 64bit?

Large text with national caracters and full text index

Hello,
I have some large portion of string to index. So of these strings contains national characters so I have stored it into a NCLOB column. I would like to put a full text index of this column but I see that it is not possible for NCLOB column.
Does anybody have the problem as me? If yes, how did you proceed? Could the XMLType be a solution ?
Thanks for your help.
Kind regards,
Fred

Hi Fred,
"I do not think that I can manage all these characters with only one character set."
Sure you can. The main reason for using the NLS characterset has nothing to do with whether you can/cannot support multiple languages with your database charset. It is there primarily in case your db characterset is not some unicode/multibyte charset and you need to add support for it while maintaining your original db charset. A secondary reason is for certain performance considerations, but that is for specific application architectures and doesn't seem to be the case here. One of my apps supports virtually every language on Earth - not using the 'N''s'. I'm using AL32UTF8 - it is up to Unicode 4.0 in version 10gR2 of the db.
Choose a unicode character set for your db and you're fine unless you have some overwhelming reason why you are unable to do so. Any Text index will work for you and your problem is solved (and ctxxpath and context index will both work - just compare your requirements to the functionality provided by the index type).
Further reading:
Here's an OracleMag article from last Fall -
http://www.oracle.com/technology/oramag/oracle/05-sep/o55global.html
Here's a white paper -
http://www.oracle.com/technology/tech/globalization/pdf/TWP_AppDev_Unicode_10gR2.pdf
Thanks,
Ron

Availability groups and full-text indexes.

Hello,
I have created an availability group that contains a database. The database is working fine.
I get a request to create a full-text catalog and to add full-text indexes.
Is it possible to create full-text indexes on databases that have a primary replica and a number of secondary replicas?
Best regards,
Erik

Hi hcv,
Microsoft will support full-text search in a clustered environment in SQL Server, so you can create full-text indexes on databases which are in Always on environment. In
the AlwaysOn Availability Groups, two types of availability replicas exist: a single
primary and some secondary replicas. To add a database to an availability group, the corresponding secondary database will exist until backups of the new primary database are restored to the server instance that hosts the secondary replica (using
RESTORE WITH NORECOVERY). You can refer to
back up and restore Full-Text catalogs and indexes.
There is an article about Full-Text Indexing in SQL Server, you can review them.
https://www.simple-talk.com/sql/learn-sql-server/understanding-full-text-indexing-in-sql-server/
http://technet.microsoft.com/zh-cn/library/aa214780(v=sql.80).aspx
Regards,
Sofiya Li
Sofiya Li
TechNet Community Support

How do I drag an image or text box to the "workspace" off of my working file but where I can still see the image and text box for future use?

How do I drag an image or text box to the "workspace" off of my working file but where I can still see the image and text box for future use?
When I drag the item off of the trifold that I am creating, it just disappears but I still want to use it. I just need to move it out of the way to modify other portions of the document.
thanks,
C

Add another page below the current one to use as a storage area. You can't use the grey area around the page for storing items you want to use later.
Go to the Pages Menu>Provide Pages Feedback if you would like to request this feature be added in future versions.

What is Full-Text Indexing

Hi
Currently am working indexing method.I what to know what is mean by full-text indexing could please anyone explain with examples and links thanks

The
full-text index is the basis of iFTS (Integrated Full-Text Search). Starting with SQL Server 2005, Full-Text Search supports the creation of indexes on XML columns and allows you to do extremely very fast searches of textual contents
stored in columns of the char, nchar, varchar, nvarchar and so on.
So it basically creates an index similar to one you can find at the back of any book. It contains a list of words, with pointers to the tables and rows that contain the words. SQL Server calls
this index, called a full-text index, when you issue a full-text query; it returns a list of rows that contain the words in your search phrase as shown in here
SELECT
* FROM Person.Contact
WHERE
CONTAINS(*, ‘“peanut butter” NEAR “jam”’)
There are
two ways to create a full-text index, Using T-SQL commands, and
using the Full-Text Wizard.
You can find the Wizard here in SSMS
To build your full-text catalogs and indexes in using T-SQL, you need to use the
CREATE FULLTEXT commands.
There are three commands for full-text index creation and maintenance:
CREATE FULLTEXT CATALOG
CREATE FULLTEXT INDEX
ALTER FULLTEXT INDEX
I hope this helps too to clear up and gives you some hint in making do more research about it. If I were you I would buy this book and read if I need to have more knowledge about it. It's all about Full Text Search. Pro
Full-Text Search in SQL Server 2008 by Michael Coles with Hilary Cotter
Please remember to click “Mark as Answer” on the post that has answered your question as it is very relevant to other community members dealing with same problem in seeking the right answer

Embedding Full-text Index into PDF File

Hello Everyone,
I've tried to create and embed full-text index into PDF file, but with no luck. I've followed steps described at http://help.adobe.com/en_US/Acrobat/9.0/Standard/WSC28D4DBB-6A78-4027-9E04-F50FE411CFB9.w. html - there can be seen progress of collecting of data and at the end the button Update index is enabled. This is signal for me that Index was created. After clicking on Ok button, saving document as new one and then reopening "new created" document, there is info that no Index is embedded in the Manage Embedded Index dialog. Is there any other step necessary to do? Or is it bug? Adobe Acrobat Pro 9.1 on Windows Vista 32bit is used.
Jan
PS: Interesting is also comment at the bottom of above mentioned help page...

Thanks for the response. It is true that if I make changes and look at the embedded index status, it shows that it needs updating
However the problem I can't get around after extensive testing is that sometimes for no apparent reason the index is dropped on save. This can happen if I check the status of the index to make sure it is valid, save the file, and reopen it.
I've concluded that this must be a bug and am using other indexing options for the time being.

How to link a full text index with catalog in a PDF file ?

Good morning and thank you for your help.
I already create some PDF files on a folder (with hypertext links between us) and I use the command "Tools\Document processing\Full Text Index with Catalog" to create an index; at this time everything works properly.
Now I want to link this Index to my first PDF file in order to use automatically this index on an advance search in this file.
I hope that someone may answer me!
Thank you.

Now I want to link this Index to my first PDF file in order to use automatically this index on an advance search in this file.
In the properties of the document:

Embedding full-text index via Script

Hello Everyone,
is there possibility to create and embed full-text index into my very long document via scripting Acrobat Pro? I've searched scripting API and there are objects like catalog or index, but both have only several methods and no embeding is mentioned there. Any help is appreciated. Thank you in advance.
Jan

try67 wrote:
You're better off using a real authoring application like InDesign or Word.
Thanks, but from this statement I am not sure if we are talking about the same thing. I mean index for full-text search - allowing to get immediate results after entering the search phrase, without any delay and (often quite slow) processing of the whole content. Now it is possible to embed it via Acrobat menu. I am asking whether this action has any equivalent in scripting API. I'd like to automate this process as now I have to do it manually via GUI (but luckily for the limited number of documents only).

"A severe error occurred on the current command. The results, if any, should be discarded." + Full-text-index Sql Server 2008 R2 SP1

Hello.
I have a problem with SQL Server 2008 R2 SP1:
I have a table with the full-text index-activated on 3 fields of type nvarchar.
When I try to open a transaction (ex: BEGIN TRAN {inserts} COMMIT) to insert multiple rows, I get the following error: "A severe error occurred on the current command ...".
I checked the Sql Server Logs and the Event Viewer on the machine, but nothing was logged.
I found a workaround: disable full-text-index => Do stuff => enable full-text-index, but this is very annoying (especially when i use the Data Compare to update that table on the Development Environment).
Help!!!

I concur with Tom. Upgrade to SP3. This may resolve the issue.
Since you say that there is nothing in the SQL Server errorlog, this may be an API issue. Try running the same commands through the command-line tools SQLCMD or OSQL to see how this turns out.
Erland Sommarskog, SQL Server MVP, [email protected]

Unable to full text index the contents in Oracle 11g UCM

Hi,
I am new to the Oracle UCM 11g.
i am unable to full text index the content files that are check-in into the Oracle UCM.
I have added the below entries in config.cfg file:
SearchIndexerEngineName=OracleTextSearch
IndexerDatabaseProviderName= SystemDatabase
AdditionalEscapeChars=-;#
While performing the indexing operation using Repository Manager only, metadata of the content files are indexed, but full text is not getting indexed.
What is missing here in Oracle UCM for not fulltext indexing the contents? What configurations do i need to do for this so that i can search perform the full text search on the Contents in Oracle UCM?
Thanks in Advance
Dipesh

Hi Srinath,
Collection rebuild cycle runs perfectly fine. After enabling tracing for Indexer and systemdatabse, i got the below info in the log:
"Finished rebuilding the search index with a total of 123 files successfully indexed. A total of 0 files had a full text index."
The below is the details of the activeindex.hda:
<?hda version="11gR1-11.1.1.3.0-idcprod1-100505T121221" jcharset=UTF8 encoding=utf-8?>
@Properties LocalData
UseImplicitZonedSecurityField=true
blFieldTypes=
ActiveIndex=index1
blDateFormat=M/d{yy}{ h:mm[:ss]{ a}}!mAM,PM!tGMT+05:30
@end
@ResultSet SearchCollections
7
sCollectionID
sDescription
sVerityLocale
sProfile
sLocation
sFlag
sUrlScript
TestHost
!csSearchDefaultSearchCollection
English-US
local
index1
enabled
<$URL$>
@end
Is it possible that OracleTestSearch Component is missing in Oracle UCM?
Thanks
Dipesh

Full text index searching in large document sets

I have been placed in charge of a digital PDF document library for a small biotech company. The library consists of about 1000 100-300 page .pdf documents which have been scanned and OCRed. In order to facilitate the full text searching of the documents a PDX catalog has been created. In theory, the PDX catalog would seem to be an excellent means of quickly accessing the data, but due the sheer volume of text that is contained in the documents this does not seem to be the case.
Any given search may take hours to complete and many computers in the department have been known to lock up due to the load of running a search. Obviously, this has made using the PDX search more of a hassle than it is worth.
I do not know exactly how the index searches work, but from what I gather they somehow search within each document in turn and return to you all the instances in all the documents that contain a certain term. If this is the case, than it would make sense that the searches would take a long time because the search would have to search each of the 1000 documents in sequence.
The thing is: we really do not need to know the context and placement of every instance that a word appears in a document. All we need to know is IF it appears, and perhaps how many times. Is there a way to make an index that will simply give us this information without having to search the actual document?
Heres an example of what I am trying to achieve:
Note: I know almost nothing about full text indexes so please forgive me if any of this sounds insane
Lets say we have a document called "word count.pdf" which contained the following text:
"blah blah yadda yadda text Recombinant human insulin more text still texting and so on"
And another called "word count 2.pdf" with the following text
"Recombinant human insulin and la la la dee do"
The indexes for these files could be condensed and stored like this:
"Word count.pdf"
Blah 2
yadda 2
recombinant 1
human 1
insulin 1
text 2
texting 1
and 1
so 1
on 1
"Word count 2.pdf"
recombinant 1
human 1
insulin 1
and 1
la 3
dee 1
do 1
In this example, if we were to run a search on "text" the index would return "word count.pdf, 3 instances (2 of text and 1 of texting" whereas if we were to search for "recombinant" it would return both "word count.pdf, 1 instance" and "word count 2.pdf, 1 instance".
This way, I could quickly weed out all documents that do not have the word that I am looking for and get an idea about which documents should be searched more in depth without scanning every single instance of the term in every document.
Is there any way to accomplish something similar to this using acrobat? (Or anything else, for that matter)
My specifications: (similar to specs of all computers searching the pdx):
Windows XP,
intel celeron CPU 2.6GHz, 1G of ram
Adobe Acrobat 8 Professional

Look at dTSearch. We used the publisher version for a CD with large files sets (with hundreds of pages per file/thousands of PDF pages of multicolumn index data - text heavy), and it does a great job. The desktop version would provide the type of searching you are looking for. Indexing is also very fast. Our customer complained, like yourself, about the speed of searches in Acrobat 6 and higher - most of the delay is due to the population of the results window.
http://www.dtsearch.com/

Broken Full Text Index

I just created a portfolio with 78 pdf documents. Some 4000 pages. The portfolio was created to give away for free on CD's. The index was built on the portfolio. The index was imbedded into the portfolio. When opened in Reader, the Full Text Index works fine on the build computer before the creating the CD master. The Index partially works on the CD. The part that does not work is searching itself. The search only takes 6 seconds with 16497 instances in 75 documents. (But the link to the portfolio page is broken. The names of the document found are displayed properly, but the Error Message-'There was an error retrieving text' is displayed. The cd's are made (Since everything else is working and the CD is at the duplicators) I have to go with what I have for this round. I am looking for a fix for the next batch and I am looking for a temporary fix to distribute through dropbox where I can download a new Full Text Index, an updated portfolio or both to those who received the CD at the conference. I thought I had a fix by going to 'Select Index...' and removing the indexes present and adding the correct index. That worked on the build computer but does not work other computers. This is what I tried.
1. Copy the following files into a new folder on your computer. (You may name it.)
Kodak_Catalogues.pdf
Full_Text_Index.pdx
Full_Text_Index (folder)
(You may copy the other files and folders but you do not need them.)
2. Right Click 'Full_Text_Index.pdx' open with Adobe Reader
3. Select 'Show More Options' at the bottom of the box
4. Under 'Look in:" at the top of the box choose; 'Select Index…'
5. Remove all index choices that are checked in black. Remove all indexes that are grayed out. With the 'Remove' button.
6. Select the 'Add' button.
Navigate to the folder that the files are located in and select the file:
Full_Text_Index.pdx
7. Select the 'Open' button
8. Select the 'OK' button
9. Under 'Where would you like to search?'
Select the radio button: 'In the index named Full_Text_Index.pdx'
10. Type in a keyword, I used 'Kodak' for my test.
11. Results: should be 75 documents with 16497 instances.
12. On my computer the search takes 6 seconds.
13. Feel free to contact me at: if I can be of further assistance.
14. I apologize for not knowing about this issue.
This is my first portfolio. Because everything worked perfectly on the build, I missed this one. Thanks for any information that might help me solve the issue.

Hello Dileep,
How have you Setup "Track changes" for the full text catalog, is it set to "Automatically" or "manually" ?
Olaf Helper
[ Blog] [ Xing] [ MVP]

Disable "Full-Text indexing"

I've tested performance with and without Full-Text Indexing turned on. The performance is much better without this option.
My question is it Ok to turn this option off for ECC 6.0 / SQL 2005 ?
Thanks,
Ld
Edited by: Linwood Doty on Oct 4, 2010 8:00 PM
Edited by: Linwood Doty on Oct 4, 2010 8:01 PM

Hello Linwood,
Neither ECC (or BW) uses full-text indexing, so you can disable it.
You just need to enable it if you have this special requeriment.
Regards,
Eduardo

Full Text Indexing for Arabic using NVARCHAR and NCLOB?

Similar Messages

Maybe you are looking for