Search Index hangs on large files

I am using the 6.1 SP4 Web Server on Windows XP. I have the default search application working. My problem is adding MS Word documents to the collection. Word documents of the size 25KB work, but when I add a large Word document 6934KB it just hangs with no CPU activity going on.
Is there a work around or a parameter that needs to changed to allow larger sized files to be indexed in the collection?

I'm not sure what's going wrong, but you may want to try increasing the amount of memory the search indexer is allowed to use. To do this, you'll need to modify the searchadmin.bat batch file. You can find it in your Web Server's bin\https\bin subdirectory.
First, make a backup copy of searchadmin.bat. Next, open searchadmin.bat in a text editor and replace "-Xmx128m" with "-Xmx1024m". This will allow the search indexer to use up to 8x more memory.
Please let us know whether this helps.

Similar Messages

P45 Neo2-FR hangs during large file moves

Hello all,
I have a newly built system that I moved my old XP install onto. ( Removed old Video and hardware drivers then did a repair install on the new hardware. ) That process appears to have been successful. The system runs normally most of the time, including resource heavy 3D apps like SecondLife. I have also accumulated over 32 hours running memtest86 with no errors found. ( a 24 hours session and an 8+ hour one. )
During the upgrade/rebuild I backed up almost 0.5TB of data onto an external drive and I'm not trying to move those files onto the new RAID array or a partition on the main hard drive. During any large copy operation, the system locks up. It's usually several minutes into the copy, and a hard reset is required to recover. The external drive is formatted to FAT32, so I've already addressed file size limitations as I copied the data to the external. The external drive is USB/Firewire/eSATA, but so far I've only used USB on the new hardware due to a lack of cables.
Anyone seen something like this before ? I'd really like to get the files back onto my internal drives. The external is a loaner from a friend, so there's a little time pressure. Any help will be appreciated.
Thanks
Todd

Update on this. I have not done a reinstall to date since I don't have a spare hard drive on which to do so.
However, I can eliminate a windows or driver problem from the list. I see exactly the same symptoms - random hangs of the machine - under Ubuntu 8 as well as windows. The Linux install is clean from a downloaded image and updated as recommended by the package manager.
It seems that the most likely time for the system to hang is during periods of intense IO activity. I had thought it was large file copies because that was what I was doing a lot of at the time of my original post.
I have tried moving my video card to the first PCI-X slot. No change.
I have removed 2 of the 4 memory modules, leaving 2x2Gb installed in bank 0. No change.
I have added extra fans - a large on on the side of the hard drive bay ( The case is an Antec Sonata III ) and a smaller fan aimed at the memory. No change.
I am using the J-micron Raid controller - is this still problematic ? I seem to recall some mentions of this.
Any suggestions to help isolate the problem would be appreciated.

TimeCapsule (and AirPort extreme too) hangs on large file transfers

Greetings,
I got a following problem. I had install AirPort connected to my router with copper and extend network with TimeCapsule. TimeCapsule have two USB drives attached, AirPort - one USB. When I am transferring a large file, in a magnitude 2-3Gb or multiple simultaneous transfers of smaller files to/from those USB drives, depending on which drive I am using the AirPort or TimeCapsule get crashed. For plain user it is looks like as of sudden, data transfer stops, led in a front keeps green, and I can not reconnect to the drives. If I powercycle TC or AES everything get back to normal. Are there anyone else experiencing the same issues and if yes, what would be solution ?
Thank you.

I think we have tried almost every combination of disabling Large Send Offload, TCP offload, IP SEC Offloading, VMQ and Receive Side Scaling possible - in the various places there are - although I will be quite honest - as there are 3 places to do this
for each Server (the related physical and virtual NICs on the HV Server, and also the NIC in the VM) it is possible we may have missed an iteration...
During our testing we have noticed that the symptoms of the problem gets worse the higher the transfer speed is. For example if you transfer to the VM from a desktop with a 100Mbs NIC, there will be subtle lag and a transfer speed of say 10 or so KBs ,
if you use a device with a 1Gbs NIC, you on average achieve 50-70 KBs transfer speeds and the higher the number, the worse the GUI / Server locks up (although the transfer completes just fine).
We also tried throttling the bandwidth via the 2012 GUI - to see if that helped, but none of the changes we made seemed to work, and we did not have time to try the powershell way of doing this.
We did replace one of the VM's NIC with a legacy one as part of our testing today, and now data transfers to the VM from a PC with a 1Gbs NIC run slower at around 30-35 KBs and the are no noticeable GUI freezes, although during the large transfer
it looks like 1 in every 30-40 packets is dropped in a continual ping that runs during the transfer period.
We have done a lot of cable replacing today (out of diligence) but there seems to be no noticeable issue. We also tried and older NC380T dual port NIC we had available and used the standard driver Windows offered instead of an HP one, but the problem
was identical no matter which NIC we used.

Search network drive for large files

Our network drives are getting full. I used to be able to use Find File to find files larger than a certain size. I hit command-F for finding the file, have it set to search the volume I want for files with size greater than 80 MB, but when I hit return to start the search nothing happens--no spinning arrow showing that it's "thinking". I don't want to specify anything in the window with the magnifying glass, since I don't know file names. Any suggestions, or is this just something that you can't do with 10.4.8 (the version on my machine at work)?

Never mind. I found out that if I add specific folders I want to search inside, it works. It just doesn't want to search the volume.

Search indexing not working in Outlook PST files

My boss recently got Office 2010 on his new laptop. I copied his PST's from his old laptop whihc had Office 2003 on it to the new one and added them to his profile. They are there and look to be workign fine, until you try any sort of search
on them.
If I am looking at the eMails in the PST and I see a whole lot from
[email protected] and then in the search box I type
[email protected] the emails are all firltered away and I am told that there are no items that match the criteria. This also happens when I try try to run an advanced search.
So according to this post,
http://social.technet.microsoft.com/Forums/en/outlook/thread/b1859770-dfb5-4224-995f-be828bd21333, I disabled Indexing of outlook, then search stops working on my default location, i.e. if I search my inbox or anything in that datafile, I get
no results returned, but if I search one of the archieve PST files for say
[email protected] the search runs for ages with out retunring any results, if I stop the search and then rerun it then I get results.
It just seems a bit strange that I have to choose iether or.
Please help ASAP as my boss leave tomorrrow on a trip to Australia and I would like to get this sorted out be fore he leave.
Regards
A user needs the admin password like nitro glycerine needs a good shake.

This seems to be an ongoing problem. The instant search feature in Outlook 2010 is not working correctly for a large number of users. I have read many, many posts here in TechNet and many more that come up with a Google search. None of the solutions provided
are permanently solving the problem.
I have tried every potential solution I have found:
Rebuilding the index did not work
The registry key(s) PrevenIndexingOutlook, PreventIndexingEmailAttachments, did not exist (the Search Key did not exist). I tried adding both keys in 2 different suggested locations (HKCU and HKLM) Search indexing did not work with or without those keys
added.
I have tried everything that I have found everwhere to resolve this problem. I found one solution that appeared to work a month or so ago. Unfortunately, I cannot find it again and no new emails have been added to the index since that day (09/15/2010).
I tried rebuilding the index (again). This process has removed all of the emails from the index that had been there after I applied the fix that seemed to work. I am continuing to research this problem in the hope that I will find that previous partial solution.
It would be nice to get some feedback from Microsoft to let us know if this problem is being looked into. All of the solutions provided from Microsoft on these forums have failed to correct this long term problem.
FYI: I am running Windows 7 Ultimate (64 bit) and Office Professional Plus 2010. These were fresh installs, not upgrades. After installation the instant search feature in Outlook was working, I do not know exactly when it stopped working.

Copying large file sets to external drives hangs copy process

Hi all,
Goal: to move large media file libraries for iTunes, iPhoto, and iMovie to external drives. Will move this drive as a media drive for a new iMac 2013. I am attempting to consolidate many old drives over the years and consolidate to newer and larger drives.
Hardware: moving from a Mac Pro 2010 to variety of USB and other drives for use with a 2013 iMac. The example below is from the boot drive of the Mac Pro. Today, the target drive was a 3 TB Seagate GoFlex ? USB 3 drive formatted as HFS+ Journaled. All drives are this format. I was using the Seagate drive on both the MacPro USB 2 and the iMac USB 3. I also use a NitroAV Firewire and USB hub to connect 3-4 USB and FW drives to the Mac Pro.
OS: Mac OS X 10.9.1 on Mac Pro 2010
Problem: Today--trying to copy large file sets such as iTunes, iPhoto libs, iMovie events from internal Mac drives to external drive(s) will hang the copy process (forever). This seems to mostly happen with very large batches of files: for example, an entire folder of iMovie events, the iTunes library; the iPhoto library. Symptom is that the process starts and then hangs at a variety of different points, never completing the copy. Requires a force quit of Finder and then a hard power reboot of the Mac. Recent examples today were (a) a hang at 3 Gb for a 72 Gb iTunes file; (b) hang at 13 Gb for same 72 Gb iTunes file; (c) hang at 61 Gb for a 290 Gb iPhoto file. In the past, I have had similar drive-copying issues from a variety of USB 2, USB 3 and FW drives (old and new) mostly on the Mac Pro 2010. The libraries and programs seem to run fine with no errors. Small folder copying is rarely an issue. Drives are not making weird noises. Drives were checked for permissions and repairs. Early trip to Genius Bar did not find any hardware issues on the internal drives.
I seem to get these "dropoff" of hard drives unmounting themselves and other drive-copy hangs more often than I should. These drives seem to be ok much of the time but they do drop off here and there.
Attempted solutions today: (1) Turned off all networking on Mac -- Ethernet and WiFi. This appeared to work and allowed the 72 Gb iTunes file to fully copy without an issue. However, on the next several attempts to copy the iPhoto and the hangs returned (at 16 and then 61 Gb) with no additional workarounds. (2) Restart changes the amount of copying per instance but still hangs. (3) Last line of a crash report said "Thunderbolt" but the Mac Pro had no Thunderbolt or Mini Display Port. I did format the Seagate drive on the new iMac that has Thunderbolt. ???
Related threads were slightly different. Any thoughts or solutions would be appreciated. Better copy software than Apple's Finder? I want the new Mac to be clean and thus did not do data migration. Should I do that only for the iPhoto library? I'm stumped.
It seems like more and more people will need to large media file sets to external drives as they load up more and more iPhone movies (my thing) and buy new Macs with smaller Flash storage. Why can't the copy process just "skip" the parts of the thing it can't copy and continue the process? Put an X on the photos/movies that didn't make it?
Thanks -- John

I'm having a similar problem. I'm using a MacBook Pro 2012 with a 500GB SSD as the main drive, 1TB internal drive (removed the optical drive), and also tried running from a Sandisk Ultra 64GB Micro SDXC card with the beta version of Mavericks.
I have a HUGE 1TB Final Cut Pro library that I need to get off my LaCie Thunderbolt drive and moved to a 3TB WD USB 3.0 drive. Every time I've tried to copy it the process would hang at some point, roughly 20% of the way through, then my MacBook would eventually restart on its own. No luck getting the file copied. Now I'm trying to create a disk image using disk utility to get the file from the Thunderbolt drive and saved to the 3TB WD drive. It's been running for half an hour so far and appears that it could take as long a 5 hours to complete.
Doing the copy via disk image was a shot in the dark and I'm not sure how well it will work if I need to actually use the files again. I'll post my results after I see what's happened.

ITunes hangs when syncing large files to network attached drives, ideas?

I've done a lot of research on my problem and have come up blank so far. This is my setup and situation. I use a macbook pro and iTunes 10, but since I use a small SSD, I do not have much room to keep iTunes media on my disk. So, I use an external USB drive, formatted HFS+ J, accessible over my AirPort Extreme as a networked drive and am trying to keep my media there by setting my iTunes Media folder location to my "/Volumes/<drive name>/iTunes/iTunes Media" under iTunes>Preferences>Advanced. For the most part this works, but there are a few gotchas that are making this setup unusable.
The biggest problem is if I try to sync a large file (for example a 250MB app) with iTunes to my networked storage, the culprit almost always being a large iOS app in Mobile Application folder, iTunes will hang with the spinning color wheel, and in the toolbar shows "Not Responding". This also hangs the Finder. After this situation, I pretty much have to force quit everything and reboot my machine to get the Finder and iTunes back to health.
So, I thought that I would try keeping the iOS apps on my local drive and just move my music out to a network drive. But iTunes doesn't allow any granular configuration of the sort (big FAIL on Apple's part), and I've read up that iTunes does not play nice with symbolic links or else I would keep the iTunes Media location set to my local drive and symlink the Music folder out to my network drive.
So, given that 1) I don't have enough space to keep everything local, 2) trying to keep everything on NAS causes my machine to fail when syncing my iPhone or trying to consolidate my iTunes library because of large file transfers over the network making thing go insane, and 3) iTunes doesn't easily let you manage your library with symlinks, any ideas on what I should do?

i assume you are connecting wirelessly to the AEBS, correct ?
as a test, run an ethernet cable from your Mac to one of the LAN ports of the AEBS (you might want to turn off airport on your machine), then try again.
does the problem persist ?

How to create search index files for Java Pet Store

Hi All,
As you may know, the java pet store application uses for the search function a search index object, which itself uses the following files '_36.cfs', 'deletable', 'segments'.
Now as I want to change the data of the database (delete some pets, and names, etc.), it does not have an effect on the search results. This is because the application uses the search index files and does not use the database for the search query.
So can anybody help me and tell me how I can create this three files from my *.sql file, so I can search in my own data?
Thank you very much for your help.
Regards,
Wolfgang

gonso777 wrote:
Solved:
I had the same problem. It seems that the installer does not unzip three files where it should.
With NetBeans (Using File Perspective) or just editing build.xml
Netbeans: select build.xml/Run Target/Other Targets/unzipindexes: Tough it should work it fails in resolving $javaee.domaindir$ at least in my system, but it does suscessfully create a new directory named ${jee.domaindir} that includes lib/petstore/searchindex and three files: _36.cfs , deletable, segments.
Copy those three files to your_glasshfish_path/domains/domain1/petstore/searchindex.
Now you are done. I hope that you had a nice time while waiting two years for it to be answered. How is it that it is not answered anywhere else?
Regards,
Ramon Talavera
www.sciencetechworks.comThanks. I didn't wait 2 years for this, but I just replied on a 2 year old post. I only recently tried the petstore app. I thought I needed to study lucene first to figure things out, it turns out there was an 'internal target' on the build file for this. Thanks a bunch!

Slow searches in large file ...

It is almost unusable to use the find function as is in my large file, as the program won't let me complete my text in the search field once it starts looking for the first string of text i type. I have enabled the whole words option, but this doesn't help much. I tried to use the "use selection for find" option in the menu, but this is always disabled, so I'm not sure of this is of any use...
Any ideas how to get search to wait until I type in the whole text field before it starts to bog down??
Thanks
jcm

Thanks for the reply.
File is 7 Megs, 1000 rows, columns to BB.
I don't mind that the search is slow, but e.g. when I want to search for "johnson", it stops me from typing after jo, then again after john, then again after johns etc etc, .... Best workaround so far is to type Johnson into a blank cell somewhere, then paste it into the search field...but if this is the answer, it's back to Excel.......

Search/index Word DOTM file content

We are unable to or locate body and header/footer contents on Word .DOTM files using Windows search. Assume that a new iFilter wold be required to do this. A few third party search/index tools exist, but none of them can open .DOTM
files.
We have adjusted all search/index options, no change in results. Does anyone have a suggestion?

do you use win7? see the thread, it maigt be helpful:
http://answers.microsoft.com/en-us/windows/forum/windows_7-files/trying-a-windows-7-search-on-all-normaldotm-file/d4283cb8-1468-4842-a1b4-d91a7b270a03
KR

Dreamweaver 8 hangs on opening large files

I have a Windows XP SP2 Dell Computer with 1 Gb RAM, and
everytime I try to open a fairly large PHP file to edit, the
Dreamweaver application hangs or freezes on me. When I open task
manager - the CPU resources being used are split nearly 50/50
between the hung Dreamweaver app, and "System Idle Process" - with
the Memory Usage on the hung Dreamweaver Application gradually
increasing.
Has anyone here experienced anything like this?? And if so,
did you find a solution short of reformating and reinstalling
everything.
I appreciate any and all help and/or suggestions!

I notice the problem with any files over 100 Kb,
unfortunately all of the files that I CAN open without problems,
are all under 10~15Kb. So, in all likelihood I
<u>may</u> be having the same issues with files smaller
than 100Kb, (but larger than 15Kb) as well. I'll try your
suggestions and see what happens.
The funny thing is, these same files open just fine with
Dreamweaver 7 (on a different but <u>identical</u>
machine). I'm thinking it may be time to "rebuild" the computer
that's running Dreamweaver 8. By "rebuild" I mean backup
everything, reformat the harddrive and then reinstall everything
again. I normally try to do that once a year or so - and it's
due....
quote:
Originally posted by:
Newsgroup User
G Evans,
How large is the file that you are having a problem with?
You may be seeing a combination of problems such as DW being
slow to
open very large files, and DW hanging on some markup that it
does not
recognize.
Try making a copy of your file with a .htm file extension and
see if
that opens to see if the translation of the PHP markup is
causing a problem.
Next, try breaking your file into smaller files to either fix
or isolate
the problem.
Hope this helps,
Randy
> I have a Windows XP SP2 Dell Computer with 1 Gb RAM, and
everytime I try to
> open a fairly large PHP file to edit, the Dreamweaver
application hangs or
> freezes on me. When I open task manager - the CPU
resources being used are
> split nearly 50/50 between the hung Dreamweaver app, and
"System Idle Process"
> - with the Memory Usage on the hung Dreamweaver
Application gradually
> increasing.
>
> Has anyone here experienced anything like this?? And if
so, did you find a
> solution short of reformating and reinstalling
everything.
>
> I appreciate any and all help and/or suggestions!

Large Search Index

Does anyone have experience implementing Coherence with a large search index. Presently the customer has a 16 blade frame that segments the index across each machine. When creates the splits the index into 16 segments on each blade. Queries are federated and compiled. Memory is maxed on each blade. They are looking for better scalability and management.

Hi,
I am still not sure that I understand correctly, let me ask a few questions:
1. What is cached in Coherence?
a. Are those unstructured document stored in Coherence cache(s) and the client has a problem with Coherence's index growing?
b. Or are those unstructured documents stored somewhere else and the client just wants to store the index of those search engines in Coherence caches?
c. Other?
2. What management functionality does your client require?
Best regards,
Robert

Copying large files hangs at "less than a minute"

hi,
When copying large files around my intel mac mini system the Finder appears to freeze just before the end - when the dialog window is telling me that there's "less than a minute" left. It doesn't happen ALL the time, just enough times to be a real nuisance.
Killing the finder doesn't help - I need to power off to regain control of the Finder.
This recently started to happen after I opened up the mac mini to add more memory. Not sure if this is related - everything else seems to be ok. I have a mixture of USB and Firewire external drives - the mac mini is used to hold all my HD camcorder files and process the iMovie rendering to disk.
I'm running the latest version of os x with all the updates.
Any suggestions?
P
Mac Intel Mini Mac OS X (10.4.8)

Hi,
Hello! It's likely a firmware issue with an external
drive. Check the ext drive's site to see if there's a
firmware upgrade. Tom
Thanks for the reply Tom. I've downloaded a firmware updater from the Lacie site, and I'm apparently uptodate. However, I also have a USB Seagate external drive, but the Seagate site seems to only provide support for Windows. grr.
Is this a known problem with certain drives/firmware?
thanks,
P
Mac Intel Mini Mac OS X (10.4.8)

Copying hangs when copying large files from DVD

I'm having trouble copying large files (>2GB) from DVDs to my built-in hard drive. When I drag the file icon from the DVD window to the desktop, the progress bar pops up almost immediately, and says "0 KB of 2.3 GB copied" and "Estimated time left: 1 minute" -- and then it just sits there, doing nothing. In some cases, after five minutes or so of inactivity, the copy finally begins... but most of the time it never does. Force-Quit doesn't help; the only way out is to do an emergency restart and try again.
This problem began when I upgraded to Tiger, and several members of my office group have been experiencing the same problem on their own computers as well.
I've poked around the forum looking for answers but the only thing I could find that looked related was a conflict between iSight and some third-party external hard drives... but none of us have iSight, and none of us are using third-party external drives, so clearly that's not the issue we'rehaving.
Any help out there?
iBook G4 Mac OS X (10.4.6)

Michael, I occasionally notice anomolous behaviour when files get dragged between volumes. Mostly the copying window shows an accurate and immediate indication of what's going on, but other times it just looks like nothing's happening, the display never changes, yet, it is in fact copying the files over. Now, if you're copying 2gb files from DVD to HD, it's gonna take some time, more than 5 minutes, so I'm wondering how long you've left it before forcing it to quit?

ColdFusion Builder 3 - Open a large file causing CF Builder 3 to Hang

When I try to open a large file having 2700 lines of code in CF Builder 3, it becomes completely unusable and in the task manager showing Not Responding.

Verified this with a few other guys to make sure this is not just my environment.
After a closer look, it looks like this file with 3000 lines of code is including (cfinclude) many other files and we think CF Builder 3 is trying to load them as well.
In Dreamweaver above scenario could be turned off. And I do not see any options in CF Builder 3 to do that.

Search Index hangs on large files

Similar Messages

Maybe you are looking for