Solr collections disappearing

Yesterday I created 7 solr collections. I loaded them up with data and started testing the multi-collection search against them using a webservice to access the search. I tested the searching from my local machine and was happy. This will finally resolve an issue we have had for 8 million years!!! This morning I came in and tested it again, still good. So I pushed the update to a semi-live state and allowed some traffic to it. Almost immediately I started getting "Cannot perform web service invocation search." errors. When I went to the CF administrator to see what was going on, none of the collections were listed. All the physical files still existed, but the collections were not longer registered. I restarted the Solr Service and they all came back. Again, I pushed a little traffic and they disappeared immediately.
There are no entries in the error logs for the server doing the search nor for the server trying to serve the search.
The server is running CF9.0 enterprise, 64-bit with 7GB of ram to the jvm.The largest collection is 554,000 documents.
Has anyone seen this behavior before?
Thanks,
Scott

for anyone else that runs into this issue, I found the solution in an article by Mark Kruger at http://www.coldfusionmuse.com/index.cfm/2010/4/4/solr-troubleshooting-coldfusion-9.
The error was that while CF had plenty of ram in the jvm, solr only allocates 256MB by default. By updating the solr.lax configuration file to allow more ram to solr, I now have stability and a great solution to our problem!
Scott

Similar Messages

Error while trying to create a Solr collection (java.io.IOException: The device is not ready)

Hello, everyone.
I'm trying to create a .cfm document that will erase a specific Solr collection and then re-create it, index it, and optimize it.
The delete works flawlessly.
Unfortunately, creating it isn't working, at all. I get the following message:
Unable to create collection publicsearch - An error occurred while creating the collection: java.io.IOException: The device is not ready.
This is a Windows 7 server running Apache and CFServer 9.0.1 (the version before Verity was cut.) I'm not getting any more details than the one error message. Any idea of what could be causing this? I've Googled this and I'm seeing a lot of issues similar, but not quite what I have happening.
Thanks,
^_^

Nevermind.. no one bothered to inform the developer that the path to the collection AND the path to the directory that the collection is for are different on this other server.
Fixed.

Odd QoQ issue when querying Solr collection

Hello, everyone.
I've got a query of query issue that has me stumped. Maybe I'm just missing something very simple, but this has got me really confuzzed.
I have a Solr collection that is indexing a few tables in an Oracle database. Let's call it "hdq", for this discussion.
I wrote a semi-complex query of related tables from which the CFINDEX is using to index the data. This is working just fine.
I created the Solr collection in the CF9 CFAdmin, and am using the following to index with:
<cfindex action="refresh" collection="hdq" key="QUESTION_ID" type="custom" title="QUESTION_TITLE" query="search_questions" body="QUESTION_TX,QUESTION_TITLE,CATEGORY_NM,TAG_NM,ANSWER_TITLE,ANSWER_TX"
custom1="QUESTION_STATUS" custom2="TAG_NM" custom3="QUESTION_STATUS" custom4="QUESTION_TYPE" category="CATEGORY_NM">
Then I do a CFSEARCH and name it "hd_questions". Again, so far, so good, no problems.
If I do a CFDUMP of "hd_questions", one of the columns is KEY (which is QUESTION_ID in the database.) If I CFOUTPUT the collection, KEY is there.
If I QoQ the CFSEARCH of the collection and use SELECT custom3, score, summary, context, key FROM hd_questions, I get an error message that
Encountered "key. Incorrect Select List, Incorrect select column,
.. then it gives the line number of the page that produced the error, and
<cfquery dbtype="query" name="hd_results">
Am I missing something simple, here? KEY is in the collection, I can see it in CFDUMP, I can see it in CFOUTPUT. But if I query the collection and try to select KEY, there is an error.
Any thoughts/ideas?
Thank you,
^_^

Key is a reserved word in Coldfusion, so can't be used directly in a QoQ without escaping it. Try wrapping it in [ ] instead, i.e. [key]
It may also help to give it an alias too, e.g. SELECT [key] AS someKey
See the list of reserved words here: http://help.adobe.com/en_US/ColdFusion/9.0/CFMLRef/WSc3ff6d0ea77859461172e0811cbec173d0-7f ff.html and the QoQ guide to using reserved words here: http://help.adobe.com/en_US/ColdFusion/9.0/Developing/WSc3ff6d0ea77859461172e0811cbec0e4fd -7ff0.html#WSc3ff6d0ea77859461172e0811cbec22c24-7008

Can a Solr collection index CLOB?

Hello, everyone,
Right now we are trying to figure a way to increase capacity for varchar2 beyond 4000 bytes. One option on the table is to convert the varchar2 to CLOB. But that makes me wonder if a Solr collection can index CLOB??
V/r,
^_^

Anyone?
^_^

CF9 - multiple Solr collections search, remove dupes

Hello, everyone.
I'm trying to search more than one Solr collection for a keyword (let's say "Item A"), but I want to remove any duplicates and keep the ranking.
Hypothetically, let's say each collection has "Item A" in it, each ranked slightly different in their respective collection (99.9, 92.7, and 89.5). How would I remove the two lower ranked "Item A"'s from the CFSEARCH?
Thank you,
^_^

I think I've got it.
For anyone else who has this same need, try QoQ.
<cfsearch name="cfSolrSearch" collection="collectionOne,collectionTwo,collectionThree" criteria="Item A">
<cfquery name="removeDupes" dbtype="query">
SELECT DISTINCT title, cast(score as decimal) as score
FROM cfSolrSearch
ORDER BY score DESC
</cfquery>
<cfdump var="#removeDupes#">
^_^
PS. In the first post, I mentioned "rank"; I meant "score".

CF9 - Solr collection of database - Summaries are prepended with PK UID of record

Hello, everyone.
I've got a CF9 server and created a few Solr collections from within CFAdmin, then used CFINDEX to update the collection with database records.
No matter what I do, when trying to access the Summary the data is prepended with the PK Unique ID of each record. Is there a way to prevent this behaviour?
Thank you,
^_^

The reason I ask is because the summary is limited in character length, and the UID is a 36 character long string that is pushing 36 characters of the actual summary off the end. I'd like to get as much of the actual summary as possible.
Thank you,
^_^

Solr Collection contains 0 documents

I am using CF Ver 9.0.0
I have created a Solr Collection via CF Admin
Once Indexed the Solr collection shows 65262 KB data but 0 documents. This is consistent with other Solr collections but not their verity counterparts.
Documents are located on a separate drive and I am indexing txt, pdf, doc, and xls
Am I doing something wrong?
Thanks

Is this Solr collection created through Verity collection document? If so then it can be due to incomplete migration from Verity to Solr..
As you mentioned, Documents are located on a separate drive. -> Hope you are referring it to local drive on that machine, not any remote machine.. Ideally, it would be able to index the document from local drive from same machine..

Font Collections Disappear after the Font Book is closed (OS X 10.4.3)

My font collections in Font Book 2 have been disappearing for awhile now and I can't seem to resolve this issue. So far I've reinstalled (archived) OS X 10.4.3, I've also tried throwing away the font book preferences (apple.com). I need help! I see that I'm not the only person who's having this problem. Is there something else I can do that doesn't involved reinstalling everything! Thanks Matt
mac mini 1.42 mhz 80 GB HD 512 RAM Mac OS X (10.4.3)
mac mini 1.42 mhz 80 GB HD 512 RAM Mac OS X (10.4.3)

Hi cmatt.
Make sure you are the Owner and have Access of Read & Write of your Home > Library > FontCollections folder. Font collections and font libraries you create are saved in this folder. You should be the Owner of
this folder and have Access of Read & Write on such.
Likewise, be sure you are the Owner and have Access of Read & Write of your Home > Library folder and your Home folder.
You can check this using the Details subpanel of the Ownership & Permissions Panel of the Get Info window of those folders.
Good luck!
Dr. Smoke
Author: Troubleshooting Mac® OS X

IBooks 3.1-all PDF books in my Collections disappear after updating to 3.1 on iPad 4 ios 6.1.2! How do I recover or revert to previous version? (Can one do selective restore of back on iTunes?)

Just updated iBooks app on my iPad 4 to ver 3.1. Upon launching iBooks 3.1 briefly saw my PDF books on my Collections bookshelves then they suddenly disappeared! (Purchased Books are still present)
How do I recover all my PDF titles in my Collections?
Can one revert to the previous version of iBooks?
How can one do a selective restore from iTunes backup of iPad on PC? (Don't have iBooks running on Mac/PC)

You've tried tapping on the Collections button at the top of the bookshelf to see if they are in a different collection ? If not then do you have a copy of them in the Books part of your computer's iTunes library (though PDFs aren't iTunes purchases, if you've done 'transfer purchases' whilst they were on the iPad then they should have copied over) ?
ibooks and PDFs aren't included in a device's backup, so if they aren't in your computer's iTunes library and/or you don't have your own backup copy of them then they won't be on your computer (for info there isn't an iBooks app/program for a Mac or PC).

Solr Collection PDF display problem

I am having problems getting the Search collection I created to display the PDF files. When I perform a search I am able to get the pdf file listing put when I select a PDF file to display it it does nothing. Please help, below is the Search Action page I did
<head>
   <title>Search Results</title>
</head>
<body>
<cfsearch
   name= "newspaperarchive_results"
   collection= "newspaperarchive"
   criteria= "#Form.Criteria#">
   ContextHighlightBegin="<b>"
   ContextHighlightEnd="</b>"
   ContextPassages="1"
   ContextBytes="500"
   maxrows= "100">
<h2>Search Results</h2>
<cfoutput>
Your search returned #newspaperarchive_results.RecordCount# file(s).
</cfoutput>
<cfoutput query="newspaperarchive_results">
<p>
File: <a href="#url#">#key#</a><br>
Document Title (if any): #Title#<br>
Summary: #Summary#<b>
Highlighted Summary: #context#</p>
</cfoutput>
</body>
</html>

Ah, ok. Your problem is the link you are showing to the user (file:///C:/inetpub/wwwroot/cfdocs/Newspaperfiles/Madison_County_Record/2013/05/18/Madiso n_County_Record_20130518.pdf).
That will not likely work in a browser. Not saying it can’t work, or will never work. But it’s not likely what you really should be using. Let me explain.
Look closely at it: a) it asks for a file:/// directive. Note that traditional browser URLs use http://. Now, it’s not that file:// is wrong. It’s that it’s not appropriate here. It would only work if the path pointed to existed on the user’s machinee. Do they have a folder called c:/inetpub/wwwroot? No. That’s on YOUR server. (And even if this was an intranet application, they would not see that file in that location, as it’s on the server. You’re not offering a path that would work from even other machines on the same network.)
I suspect what you need is to convert this URL into a “web accessible one”, and the good news (well, good and bad) is that the file you are naming is in fact in a web accessible directory, your inetpub\wwwroot. Assuming you can serve a test.cfm page from c:\inetpub\wwwroot using http://yourdomain/test.cfm, then you can serve these files as http://yourdomain/cfdocs/Newspaperfiles/Madison_County_Record/2013/05/18/Madison_County_Re cord_20130518.pdf.
Try that URL in your browser. If it works, then you just need to modify your code to provide THAT url to the user. To do that, you’d need to do some manipulation of the variable (you’re not showing us) which displays that link. If you’d share the line of code that outputs that link, we can provide code that will work. (Since you may be combining variables or functions to get the location you show now, I don’t want to just guess what might work.)
Hope that helps.
BTW, I said above that there was good news/bad news about this PDF being in a web accessible directory. It’s good for your need to just offer a link easily. It’s bad that if this is content that you may think you want to control in some way, such as to only show “some files” to “some people”, beware that anyone who sees one of these links (when we get it working) will be able to guess at other PDF file names. Just beware. (If you need to solve that, there are still other solutions, but they are way beyond the scope of this Solr forum.)
Indeed, as may be clear by now, your issue here (the problem you raised) isn’t really a Solr question at all. It’s more about fairly basic web and CF programming. Now, I don’t say that to embarrass you. Hey, we’ve all had a challenge like this some time in our coding lives. It’s just part of getting started with any particular challenge. My point though is that in asking for help here, in the Solr forum, you have limited your audience of help. Note that you’ve not gotten much (nor rapid) response. There are basic CFML forums and indeed several subforums for various aspects of working with CF. Just saying you may want to consider raising future questions there, if they really are of ongoing questions about basic application development. Hope that’s helpful.
/charlie

Contents of Collections Disappeared (files did NOT move)

I am running CS5, and I just spent a few hours adding files to a new collection. I had to reboot my computer, and when I reopened Bridge, the collection listed (0) files. The real locations of the files are on my harddrive, and were not moved or altered in any way.
I repeated a small test: added a few files to a new collection, closed Bridge, reopened Bridge, and the files were no longer listed in the collection. None of the help literature has suggested that you need to do anything special to save a collection once files have been added to it, but it appears that my collections are not being saved automatically when Bridge closes.
How can the contents of my collections not be emptied every time I close and reopen the program?

How can the contents of my collections not be emptied every time I close and reopen the program?
That should not happen, there where some problems with files not being kept in the collections when having 'strange' characters like ' and ".
A collection is nothing but a bunch of aliases pointing to the real location and should be reappear after you restarted Bridge or rebooted your computer.
Try first a reset of the preferences, restart Bridge holding down option (Mac) or cntrl (Win) and choose reset preferences, then try again.
And remember, collections in Bridge are usable but still not 100 % reliable. If you put in a lot of work in a certain collection first thing to do is add the collection name also as a keyword to all the containing files and let it finish writing those keywords completely.
That assures you from an extra (and saver, because this data is written in the file itself) option to always being able to recreate your collection using the find command.

Ipod Classic - collection disappeared, ITunes doesn't recognize Ipod

I haven't used my Ipod for a while. Today I wanted to listen to some music and switched on my jbl-station with the IPOD. Instead of Cover-Displays I saw the menu in the IPOD disöay. When trying to select music, there was none.
So I switched on my standard PC, where the Ipod has been synchronized often. ITunes started and got hung up.
The system was asking whether the IPOD-drive should be repaired. I clicked the ok-button, but it didn't work. Error messages without end.
On the Ipod itself it said "Connected". The Explorer itself has recognized the IPOD and I could see the usual folders.
Checking the Used Space via File system -> shows that the songs must still be on the IPOD.
On the apple site I found a hint to reset the Ipod - which I did. But it didn't help.
Now I got ITunes started again it didn't hang up again, but it does not show the Ipod, so I have noch chance of Checking, Update, .......
I ran the diagnostics:
Zuletzt angeschlossene, jetzt nicht verbundene Geräte:      -> formerly attached devices -> which is exactly said IPod
iPod classic mit Firmwareversion 2.0.1
Seriennummer:    8M841B0N2C7
**** Synchronisierungstests für Geräte ****
Kein iPhone, iPod touch oder iPad gefunden               -> no IPOD found
I tried my second PC with ITunes, same result.
Any idea what I can do?
Thanks in advance

Did yo do this?
Removing and Reinstalling iTunes, QuickTime, and other software components for Windows XP
or
Removing and reinstalling iTunes and other software components for Windows Vista, Windows 7, or Windows 8
Did it start after updating iTunes on the computer?

Sandbox security denying CFINDEX from indexing a collection (Solr/CF9)

Hello, everyone.
I did fix the last Sandbox security related issue with Solr collections - it was in the "Files/Dir" section, I had to put everything under C:\ColdFusion9\wwwroot.
Now, I'm facing yet another Sandbox related issue with collections.
I have one reindex script that has NO ISSUES when pulling data from a database and indexing a collection from that.
I have another reindex script that will not index a collection from a query, unless Sandbox is disabled. I will try to give some pseudo code.
<cfquery name="search_results" datasource="documents">
SELECT DOC_ID, DOC_NAME, DOC_DESCRIPTION
FROM DOC
WHERE DOC_ID in (<cfqueryparam value="#thisList#" cfsqltype="CF_SQL_VARCHAR" list="yes">)
</cfquery>
<cftry>
<cfindex action="refresh" collection="collection_name" key="DOC_DESCRIPTION" type="custom" title="DOC_DESCRIPTION" query="search_results" body="DOC_ID, DOC_NAME, DOC_DESCRIPTION" status="results" />
<cfcatch><cfdump var="#cfcatch#"></cfcatch>
</cftry>
The query will retrieve 15 records, with or without Sandbox. But the CFINDEX will not work if Sandbox is enabled.
The other reindex script is not affected, either way.
What could be causing the CFINDEX to fail?
Thank you,
^_^

I had a similar issue with CFSEARCH on CF10 with sandbox security that I resolved by adding the following to the neo-security.xml file:
<struct><var name='CLASS'><string>java.net.SocketPermission</string></var><var name='TARGET'><string>127.0.0.1:0</string></var><var name='ACTION'><string>listen,resolve</string></var></struct></array></var></struct></var> </struct>
That gives permission to listen on dynamic ports (the colon-zero part).

TS4124 My iTunes Match suddenly disappeared entirely

Then, all my collection disappeared, left only those I bought from iTunes. iTunes Match keys / buttons start to disappear across all my devices. My iPhone says that it cannot connect to iTunes Store. What is happening?

What is your specific question about iTunes Match? We can't help you with the beta of iOS; according to the NDA you agreed to when you signed up the developer account you aren't supposed to be talking about it either.

CF9 and SOLR indexing

We are using CF9 64-bit and setting up a SOLR collection for an HR application. The database contains several million records and includes resumes that we want to do full text searches on.
We started out by using cfindex to create the index but it would bomb out after just a few thousand records with an error about "warming threads" (I don't have the exact error handy but can get it later) and the indexing would have to be manually restarted. This wasn't a good solution for a multi-million record operation..
Next, we created a custom Data Import Handler (DIH) outside of CF using the instructions in the SOLR wiki. This index worked great and was very fast. However, the ColdFusion tags (cfsearch, etc.) would not work with this index. We even made sure to duplicate the required nodes (<custom1> <custom2>, etc.) that the cfindex tag would have created. Still cannot search that index.
We'd really rather not reinvent the wheel and have to write custom search code. Obviously, we like using CF and it would be great if we can use the built-in indexing and searching capability.
Any ideas on how we can either 1) make the <cfindex> work without stopping OR 2) go ahead and use the custom DIH and be able to make the <cfsearch> work properly?
Dana

I only have just over 500 records that I am trying to index, which they do consist of some large documents, and I try to loop through using the cfindex and I also get this error:
Error_opening_new_searcher_exceeded_limit_of_maxWarmingSearchers4_try_again_later
I found that if I put this in my loop
<cfscript>
thread = CreateObject("java", "java.lang.Thread");
thread.sleep(1000);
</cfscript>
then I no longer have the error, but it does take a long long time to index. I also would like a better solution.
The coldfusion debugger shows that it is erroring out on the custom4 field. I don't know if the custom fields are struggling more than the main body field. Anyway, I am continuing to research my options.

Solr collections disappearing

Similar Messages

Maybe you are looking for