CFSEARCH, Verity and suggestedQuery
I have an issue with the "status" structure returned in
cfsearch. In the status structure, the suggestedQuery field is no
longer being populated. When I use CFDUMP to view the content of
the structure, the only values being returned is FOUND, SEARCHED,
and TIME. I had it working, but as soon as I showed a demo it
stopped returning any suggestions. I am running CFMX7 v7.0.0. The
code is below - it returns the expected search results, just not
any suggestions for misspelled words.
Any suggestions? Are there any server side configurations
that could prevent this from being returned? Has anyone else run
into this problem?
Thanks.
An update on my issue. Apparently the code works fine with a
collection of about 100 files that are indexed. The issue with
suggestedQuery happens with a larger collection of over 5000 files
that have been indexed.
Has anyone else had this issue and found a work around? I
know one solution is to make smaller collections, but I would like
that to be the last option rather than the first option.
Thanks,
Similar Messages
-
Hi All, Is there any way I can get verity to return the page
number's of the PDF's that cfsearch finds?I don't think so. Though I guess you could add something to a
search results page that reads the PDF and finds the matching text
and what page that occurs on. -
CF8 verity and acrobat 9.0 errors
we have an issue where the CF8 verity engine is not indexing
PDF files created with acrobat 9.0
the same PDF files generated with acrobat 8.1 work fine.
the acrobat 9.0 PDF files generate these errr messages in the
verity logs
Tue Jan 13 14:44:44 2009
msg(1): Warn E0-1514 (Drvr): TstrIOFilter:flt_kv: KV failed
on filtering document: error = 8
Tue Jan 13 14:44:44 2009
msg(1): Warn E2-0527 (Document Index): Document 3
(d:\developers\MRC\wesinfo\version2\admin\test\wespress_testing\docs\Stark4_acrobat_9_vie w_7.pdf):
Stream error (-140) - SKIPPING
are there a new set of filters available for verity, so that
it can index acrobat 9.0 files ?
also, we found that while cf8 verity can index word 2007
.docx files, it does not pickup the Title metatag.I have figured it out....
Adobe Acrobat v8 saves PDFs in v5 (1.4) format by default. Adobe Acrobat v9 saves PDFs in v7 (1.6) format by default.
ColdFusions CFINDEX doesn't like PFDs saved in v6 (1.5) or higher. So if you upgrade to Adobe Acrobat v9 and want to use the PDFs in a CF verity search you need to configure Distiller to save in v5 (or earlier) format so they can be indexed. (Or just resave the files to be optimised for v5 after they have been created.)
My solution was to configure the application to do a CFFILE READ on the PDF when a user uploads the document into the system. The first 8 characters of the file contents indicate the PDF version. v4 and v5 will work. v6+ won't work.
<cfif Mid(fileContents, 6, 3) lte 1.4>
<!--- This is PRE version 6 - it will be fine in the search --->
<cfelseif Mid(fileContents, 6, 3) gt 1.4>
<!--- This is version 6-9 or higher - it won't work in the search - ABORT --->
</cfif>
Hope this comes in handy for someone one day! -
Verity and WYSIWYG content return display
I have created a CMS using ColdFusion MX 7. I am having
issues with the returned display of the indexed database query. All
of the page styling and image code is contained in the in the
database so when the verity search is returned it returns all of
the html/css and image reference code that is contained in the
database field. Is there a way to strip all of the html/css and
image references out of the return results? Or is there a way to
strip them out before the database is ever indexed.Either before you index or before you display, do the
following:
<cfset cleanText -
REreplace(dirtyText,'<[^>]*?>','','ALL') />
This will strip out any HTML taqgs. -
I've searched the help files, KB, and forums and don't see an
answer to this question: Are there ever updates to the Verity
search functionality in ColdFusion to accomodate new file formats,
such as the newer versions of Word, PDF v7.0 and 8.0, etc? While
the search functionality of CF is great, it's somewhat limiting if
it can't be updated to index the latest file formats.
So does anyone know if it's possible to update Verity
(without waiting for major version upgrades in CF)?You are asking an excellent question, Jos!
Converting all of the videos to DV-AVIs before combining them in the same project is an excellent idea. Because you are using a Mac, however, you should use the DV-MOV as your common video format. To do this you should use Share/Computer/MOV using the PAL-DV preset. (There are many types of MOVs. A DV-MOV is a specific type of MOV that is used when shooting and editing video on a computer.)
IN DUTCH:
U vraagt een heel goede vraag, Jos!
Het omzetten van alle video's naar DV-AVI's voordat ze te combineren in hetzelfde project is een uitstekend idee. Omdat je een Mac gebruikt, echter, moet u gebruik maken van de DV-MOV als je gezond videoformaat. Om dit te doen moet je Share / Computer / MOV met de PAL-DV preset te gebruiken. (Er zijn vele soorten van MOV's. Een DV-MOV is een specifieke vorm van MOV dat wordt gebruikt bij het opnemen en bewerken van video op een computer.) -
Hi,
Has anyone encountered or know a fix/work around to trying to
index Office 2007 docs (this also includes PDF docs created using
MS' addon PDF creator)? When I use either VSpider or CFINDEX, it
only works on Office docs prior to Office 2007. CFINDEX will
actually create the key for Office 2007 docs, but Title and Context
are always blank. VSpider seems to ignore Office 2007 docs
altogether.
Thanks in advance,
KennyHi,
As soon as you restart your system office version is updated to latest version of office that you have installed(64 bit)
Go through the following link for supported platforms and versions :
http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/601b2c00-da68-2e10-7c81-af37a0a6d378.
Hope this link can clear all your doubts .
@Sri -
Verity and Clustered Coldfusion Servers
Hi All,
I am currently looking at using Verity with our clustered
coldfusion servers but seem to have an issue. We currently have
three coldfusion servers but the version of verity included with
coldfusion only allows a connection from one server.
Has anyone else been in the same situation where they need
more than one coldfusion server talking to the same verity server?
If so how did you solve this issue? ( We have looked at purchasing
the full version of verity but it is to expensive.)
Thanks
PaulI'll restate this in simpler fashion.
Can you retrieve MX 7 verity search results on a MX 6.1
server?
Can this be done via CFHTTP or any other similar method?
Thanks -
Problem with Verity and proximity operators
Whenever I try to use a proximity operator in my search, I
get no results. For example, when I use the proximity operator
<PARAGRAPH>, knowing that the terms I use are in the same
paragraph (I assume this is defined by the <p> tag?), I still
get 0 results. Same with <NEAR>, using the same terms. I
attached a code snippet. Any help?Whenever I try to use a proximity operator in my search, I
get no results. For example, when I use the proximity operator
<PARAGRAPH>, knowing that the terms I use are in the same
paragraph (I assume this is defined by the <p> tag?), I still
get 0 results. Same with <NEAR>, using the same terms. I
attached a code snippet. Any help? -
ColdFusion Verity Search Float Problem
I have a database full of products. One of the fields for each product in the database is a minimum price. I'm trying to create a search that says something like "find all products with a minimum price between X and Y." However, when it returns results, it includes numbers that are out of the range. For instance, if I say between 2 and 3 dollars, it will return the correct results but will include numbers like 25.00 and 245.00, and when I do something like "between 4 and 5 dollars" it returns the correct results with additional numbers like "40.00" and "434.00." So it seems to me that ColdFusion can't process the floating number correctly...It sees a number like "40.00" and assumes its in the range between 4 and 5. Here is my code for the indexing:
<cfquery name="v_qryProductInfo" datasource="#application.DSN#">
SELECT DISTINCT SP.pk_storeProductID,
P.productName,
C.categoryName,
P.prodTimeMin,
P.prodTimeMax,
PD.miniDesc,
PD.keywords,
CONVERT(float, (dbo.getMinPrice(pk_storeProductID))) AS minPrice
FROM tblProduct P
INNER JOIN tblProductDescription PD ON P.pk_productID = PD.fk_productID
INNER JOIN tblStoreProduct SP ON P.pk_productID = SP.fk_productID
INNER JOIN tblProductSubCategory PSC ON SP.pk_storeProductID = PSC.fk_productID
INNER JOIN tblSubCategory SC ON SC.pk_subCategoryID = PSC.fk_subCategoryID
INNER JOIN tblCategory C ON C.pk_categoryID = SC.fk_categoryID
WHERE (SP.blnStoreActive = 1)
AND (SP.fk_storeID = #application.storeID#)
</cfquery>
<cfdump var="#v_qryProductInfo#">
<h1>Indexing data...</h1>
<cfindex
action="refresh"
collection="#application.vcCollection#"
key="pk_storeProductID"
type="custom"
title="productName"
query="v_qryProductInfo"
body="miniDesc, keywords, pk_storeProductID, minPrice"
Custom1="minPrice"
Custom2="prodTimeMin"
Custom3="prodTimeMax"
Custom4="categoryName"
>
My cfsearch tag criteria looks like this:
<cfsearch
criteria="CF_CUSTOM1 >= #priceRangeMin# <AND> CF_CUSTOM1 <= #priceRangeMax#"
name="qryFoundProducts"
collection="#application.vcCollection#">
I've made the Custom1 column for the indexing the "minPrice" which is calculated as a function in my database. I've even tried making sure the number that is being entered in the Custom1 index is a float by using the CONVERT function in my SQL code. Any ideas why ColdFusion can't properly relate a float? It seems like it's trying to compare a string and a float, which isn't working too well.
Any info would be greatly apprecaited.Well, firstly: don't blame Adobe for Verity... Verity is (well: was) a separate product, and I don't think Verity as a company has even existed during Adobe's tenure at the helm (to mix metaphors awkwardly) of CF.
That said, one perhaps can blame Adobe for any disconnect between Verity and CF's support thereof, if Verity does actually support numeric processing, and CF mungs that somehow. I'm not saying this is the case, but who knows?
What Adobe perhaps didn't do is ditch or deprecate Verity earlier than it did. Lucene's been around for ages, and has been solid for ages, so I don't know why they didn't revise their search engine support earlier than they did. Oh well.
Now: your issue.
First thing, this won't work:
<cfset keyList = #Val(ValueList(qryFoundProducts.key))#>
val() returns the value of a number, whereas valueList() returns... a list. So it val() works at all, the result will just be the value of the first number in the list. You also don't need the pound-signs there, but either way, it won't affect your situation.
Second, as CF is loosely typed, it doesn't matter if you pass a numeric string or an actual number to a <cfqueryparam> tag, if you've said the value is supposed to be an integer (CF_SQL_INTEGER), then CF will automatically convert it to an integer if it can. So provided the values in your query column can be expressed as integers, they will convert with no intervention on your part.
So, in that light, I'm not sure your problem is necessarily what you think it is..?
But you say there's a problem in your WHERE clause, but you don't actually say what the problem actually is. Are you getting an error? Or just no records? The wrong records?
What do you see if you dump the query out? If you take the values output by valueList() and execute the query with those values in a different DB client (like MS SQL Studio or whatever), do you get the results you expect?
What sort of data is in the Verity collection btw? Are they documents, or DB data, or a mix, or what? If there are PKs coming out of the collection, it sounds like the data came from a DB in the first place. Can you not use full-text searching in your DB, and leave Verity out of the equation?
Adam -
I just started a Verity search engine for a very large site,
and have gotten the following error message a couple of times:
There was a problem while attmpting to perform a search.
Query has a parsing error. (-40)
at com.verity.k2.K2Search.receive(Unknown Source)
at com.verity.search.ProcessSearch.processNormal(Unknown
Source)
at com.verity.search.ProcessK2Operation.submit(Unknown
Source)
at com.verity.search.VSearch.getPSearch(Unknown Source)
at com.verity.search.VSearch.getResult(Unknown Source)
at
coldfusion.tagext.search.SearchTag.doSearch(SearchTag.java:260)
at
coldfusion.tagext.search.SearchTag.doStartTag(SearchTag.java:157)
at
coldfusion.runtime.CfJspPage._emptyTag(CfJspPage.java:1908)
at cfsearch2ecfm246570528._factor0(...\search.cfm:36)
at cfsearch2ecfm246570528._factor5(...\search.cfm:30)
at cfsearch2ecfm246570528.runPage(...\search.cfm:1)
at coldfusion.runtime.CfJspPage.invoke(CfJspPage.java:152)
at
coldfusion.tagext.lang.IncludeTag.doStartTag(IncludeTag.java:343)
at
coldfusion.filter.CfincludeFilter.invoke(CfincludeFilter.java:65)
at
coldfusion.filter.ApplicationFilter.invoke(ApplicationFilter.ja...
<br>The error occurred on line 36.
The tag for the search is as follows:
<cfsearch collection="#form.collect#" language="English"
type="SIMPLE" criteria="#Session.searchTerm#"
name="Session.results">
on line 36.
I have not been able to reproduce the error, and there isn't
anything strange about the search terms submitted.
This is the first time I've used Verity, and would appreciate
any words of wisdom as to what might be the cause of this error,
and how to eliminate it.ok the value is 0
but i am not sure what that means, i havnt used verity
before?
can you help
just to let you know what i need to do,
i have a results page which show 1 surname with all that
persons information, on the same page there is a search by surname
text box, when this is submited i need to move to the first recoed
that matches the text box, so then i can still use the next and
previous buttons to navigate through.
so really what i need to do is get all the records order them
by surname then give each of them a id number
so Abbot = 1, Adcock= 2 etc
then i should be able to use the next and previous to go
through them?
i am just not sure how i can do this?
hope you can usnderstand what i am trying to do.
many thanks -
Control the output order of a CFSearch
What is the proper procedure to take the return from a CFSearch and set the order based on one of the fields to be displayed in numerical, alphabetical, whatever?
I understand how to use the result of the CFSearch to index into another source but that's one record at a time. I want to re-order the cfsearch output to be in a defined order rather than the returned order based on ranking if I understand the process correctly.
What to do?Basically we want to search a large inventory database and the client would like the output in an Alpha format. I figured that the verity search would be the easiest way to parse through the data as well as allow for using wildcard chars.
Ah right. I probably would not use Verity to do that. I'd use your DB's free-text search capabilities for this sort of thing, and do the work on the DB rather than getting Verity to drag it all out, then use CF to re-order it.
I can get what I want except that I don't quite understand how to take the cfsearch return and then re-sort the data.
This has been covered in previous responses: query on query will effect this. However I don't think Verity & QoQ is the best approach to the requirement, now that I better understand what the requirement is.
Adam -
Hi,
I've been playing around with verity and was wondering if
there is a way to modify the way verity does its ranking.
Say I'm looking for Foo Bar, but I'd like to include those
with just Foo and those with just Bar, but those should be right at
the end (low score). How can I achieve this?
Using OR will give documents with Foo, documents with Bar,
and documents with both Foo and Bar the same score (0.7967). And if
I do an ANDed search I only get the last one (which I'd expect). Is
there a way express my request better, or configure verity to index
around my own personal taste.
Search Term:
Foo Bar
Order I'd like:
documents with both Foo and Bar (score ~1.0)
documents with just Foo (score ~0.5)
documents with just Bar (score ~0.5)
Thanks,
J_C_CIn my understanding enterprise can index 1 location. That can
either be the localhost or another server. Not both. If it is on
another server you must install verity from the Coldfusion disc.
Then in the admin look under "Data & Services" -> Verity K2
Server to set the server name.
I am unsure if this can be done with standard edition. -
Verity Search Server on Macintosh
I was intending to use the ColdFusion Verity Search Service but the service is unable in the ColdFusion Administrator. It would seem the server needs to be installed separately but the link in LiveDocs is unavailable, I’m using CF8 developer on a Macintosh, if anyone knows where I can find the installation software that would be appreciated. Thanks.
I don't know about that, pwizzard. Here's something else to consider. While there's no "Mac" installer, there is a Linux one. I think that will work for you. Note that you do need to have a license key for CF to get to it. (In other words, this won't work if you're using the Developer edition, because it has no license key.)
Short answer:
Go to the page, https://www.adobe.com/cfusion/entitlement/index.cfm?e=verity, enter your CF license key (standard or enterprise), and download the installer (for Linux) from there. Let us know if it works
It's also unfortunate that the /go/verity/ link fails. While we can't change the CF8 licvedocs page you found, I did change the corresponding CF9 page to offer the link above.
Long answer:
As for how I figured out that this may be what you need, here's what I did, in case any of it may help you or others in the future.
First, I recalled that there was a page of installers that went along with CF. I couldn't remember the link, but I trusted that the Adobe CF site would get me there.
- I went to the CF front page (can be found via google): http://www.adobe.com/products/coldfusion/
- choose link in lower right of right nav bar for CF8: http://www.adobe.com/products/coldfusion/coldfusion8/
- choose link to download trial
- log in (if you don't want to login, just keep reading).
- choose link for "related ColdFusion downloads": http://www.adobe.com/support/coldfusion/downloads.html
- and note that you could also just visit that link directly, now that you know it, without needing to log in
- there, it offers a section on "Verity (language packs and standalone installer)", and it has the link I offered above
Admittedly, that page says that the installer is meant for installing Verity on a machine separate from CF, so I wondered if it was what you really needed. I decided to search google for help (coldfusion install verity) and found this http://livedocs.adobe.com/coldfusion/8/htmldocs/help.html?content=othertechnologies_06.htm l. I guess that's the page you had found, because it offers a link to get to the installer, as http://www.adobe.com/go/verity, which fails (and because this is the CF8 docs, we can't even update it with a corrected link if we find one.)
But note that these help pages offer a popup box that offers a link to the CF9 docs: http://help.adobe.com/en_US/ColdFusion/9.0/CFMLRef/index.html. Unfortunately, that goes to the front page of the docs. You need to note where you were on the previous page (bummer). At the top of the CF8 doc page, we see that the page was within "Installing and Using ColdFusion / Installing Integrated Technologies". We can select that from the CF docs front page, which opens to http://help.adobe.com/en_US/ColdFusion/9.0/Installing/WSc3ff6d0ea77859461172e0811cdec18c28 -7ff1.html.
The link for the verity page itself is http://help.adobe.com/en_US/ColdFusion/9.0/Installing/WSc3ff6d0ea77859461172e0811cdec18969 -7ffd.html. Sadly, that page (almost identical to the CF8 one) also has that failing link, but at least we can update the page with the proper one.
I wasn't positive that it was the right link, until I did some more digging. (FWIW, I tried to find any old version of the go/verity page at archive.org, but no luck. Returning to the google search results list, I did find this, though: http://www.adobe.com/support/coldfusion/verity_reg/register/index.cgi. That looked just like the first link offered above, though only for CF7, so I was more confident that the first link I offered is indeed what you need.)
I thought to search google for the specific phrase "adobe.com/go/verity", and there it found a couple of other CF9 doc pages, and one of them (https://www.adobe.com/cfusion/entitlement/index.cfm?e=verity) did also have the bad /go/verity link, and someone offered in a comment a link to (again) the original download page I offered (https://www.adobe.com/cfusion/entitlement/index.cfm?e=verity). So that really seems the right page, and I have added a comment to http://help.adobe.com/en_US/ColdFusion/9.0/Installing/WSc3ff6d0ea77859461172e0811cdec18969 -7ffd.html.
One last thing: while the download page doesn’t have an OS X-specific installer, the help page does mention OS X and says getting this installer is the solution, and it does offer a Linux installer to look for, so I suppose that's what you are supposed to you. One thing that still has me a little suspect of things is that I did use a key to get to that download page, and I see the filename offered for the Linux installer is "coldfusion-search-lin.bin", not the "ColdFusion_9_Verity_linux.bin name offered". But maybe it's just a doc inconsistency.
Anyway let us know if it helps.
/charlie -
CF8 verity french reports wrong document count
I had to rebuild a number of collections that use the verity
language packs in migtrating to 8. All of the document counts
displayed in the cfadministrator and by calling #recordsSearched#
come out correctly EXCEPT for the french language one. I deleted
and rebuilt the collection 3 times, same results each time. As near
as I can tell, the collection is behaving correctly in terms of
finding items- no duplicates displayed, and the most I can find
with any search is 55 documents (expected total)
Since I am pulling from a database, I know exactly how many
records I have (76), 55 of which have electronic versions and get
indexed. I looped a query to index the documents and output the
title and action each time to visually verifiy that it looped 76
times, and did the indexing 55 times. Yet my document count is 133
with each build.
Has anyone else seen anything similar? It's not a fatal
problem by any means, but it is weird and I would love to know that
I can rely on the recordSearched returned. (Arabic, Spanish,
Russian, Portuguese, English were all fine.)CF_Ninja,
I get your point. What you discovered isn't new, and didn't start with Adobe. In fact, it is so common in commercial software, you can even call it a new Murphy's law. If version s is the latest version of a given software(say, Coldfusion 9), and there has been a switch from module m1 in version s-1 to module m2 in version s (say, the switch from Verity in CF8 to Solr in CF9), then the module m1 will invariably be crappy.
The developers of CF8, already with a euphoric eye on the future use of Solr, would inadvertently have ignored any further development of Verity. It's only human to think: Why waste all that effort on an end-of-life product?
I share your choice. The Coldfusion Jedi has a good comparison of Verity and Solr -
Hello,
I have also a problem with verity. I get it a error and have
been unable to work it out.
My collection name is mycollection19.
Unable to create collection mycollection19.
An error occurred while creating the collection:
com.verity.api.administration.ConfigurationException: Fail to
create the index. (-6220)
Does anyone ever has this problem with verity?Hello,
I have also a problem with verity. I'm running cfmx7 on
Centos4 (and install the compact c++ compilers) and plesk 8.0.1. I
try with the integrated verity and with the standalone version.
[root@serverx ]# /etc/rc.d/init.d/cfmx7search start
Waiting for response from k2admin
Waiting for response from k2admin ,..
I change in the verity-install.cfg the hostname from
localhost to 127.0.0.1 and first uninstall verity
(./verity-uninstall.sh)
VConfig - Verity Inc. Version 5.0 (Jun 27 2005)
about to uninstall K2...
about to uninstall K2Admin...
and then I reinstall verity (./verity-install.sh)
Configuring ColdFusion MX Search services...
Configuration failed, see
/opt/coldfusionmx7/verity/verity-install.out
this is the log from verity-install.out:
ssh: /opt/coldfusionmx7/verity/k2/_ilnx21/bin/vdiag.sh:
/bin/sh^M: bad interpreter: Onbekend bestand of map
VConfig - Verity Inc. Version 5.0 (Jun 27 2005)
about to configure K2Admin...
about to configure K2...
K2Config had warnings..
WARNING: The RCAdmin call failed. Command = styleset 1
"Def_FileSystem" 1 1
filesys
"default File System style files"
y exit
WARNING: The RCAdmin call failed. Command = styleset 1
"ColdFusionK2" 1 1
filesys
"ColdFusion K2 Style Files"
y exit
WARNING: The RCAdmin call failed. Command = styleset 1
"ColdFusionVspider" 1 1
filesys
"ColdFusion Vspider Style Files"
y exit
WARNING: The RCAdmin call failed. Command = indexerset 1
"ColdFusionK2_indexserver1" 9960 "ColdFusion K2 Index Server"
ColdFusionK2
4
1 y exit
WARNING: The RCAdmin call failed. Command = servicesignal
ColdFusionK2_indexserver1 1 y exit
tnx for help!
kind regards,
b
Maybe you are looking for
-
How to arrange page dropdowns in the Web Analysis report
Hello, Experts! I have created a Web Analysis document based on my Esssbase cube. This document contains just one grid with 7 dropdowns. All dropdowns are in one line above and they are narrowed so as they all fit into 1 line within the screen and I
-
Need suggestion on restore and recover
Hi, Need your suggestion on restore and recovery scenario. It is like: There is Server A on which there is database with SID= XYZ Server B on which there is database with SID= PQR I have taken backup of both databases. Then done cloning/refresh PQR d
-
HTML code for playing swf on the web
Hello All, Relative newbie to Flash CS3, although I have been using flash video files for a while with opensource software. I have upgraded to CS3 and one main reason I wanted to go with the Adobe software was for the purpose of providing progressive
-
Lumia 710 update to WP 7.8
Dear Nokia, I am Wessam Moffed from Egypt. I knew lately that there is an update available for my phone ( nokia lumia 710 ) to the new version of windows phone 7.8 . but my phone doesn't show any signs pf updates and when I connected to zun
-
Transcript Error when opening dreamweaver cs5.5 mac HELP!
i have tried renaming the configuration folder by going through application's/dreamweaver cs5.5/configurations and changing the folder to configurations old but it comes up with this message! Pleese help assignment due in dreamweaver tommorow and i n