Need help traversing through files

i have a folder with 99,999 xml files. i need to access each and everyone of these files to look for a certain value.my question is: is there any convenient way of traversing through these files?
File xmlfile = new File("");
File onefolder = new File("C:\\Documents and Settings\\drstempprojects\\Desktop\\Compiled\\NLB_Recam");
String[] arroffiles = onefolder.list();
for (int i=0;i<arroffiles.length;i++) {
xmlfile = new File("...\\NLB_Recam\\" + arroffiles);
this method is inefficient and takes a hell load of memory since we are creating an array of 99,999 strings and using each array slot only once. i'm pretty sure there are better solutions to this. suggestions pls anyone?thanks.

i'm pretty sure there are better solutions to this. suggestions pls anyoneDon't store 100k files in the same directory.

Similar Messages

Need help with connecting file inputs to arrays

In this assignment I have a program that will do the following: display a list of names inputed by the user in reverse order, display any names that begin with M or m, and display any names with 5 or more letters. This is all done with arrays.
That was the fun part. The next part requires me to take the names from a Notepad file, them through the arrays and then output them to a second Notepad file.
Here is the original program: (view in full screen so that the code doesn't get jumbled)
import java.io.*;       //Imports the Java library
class progB                    //Defines class
    public static void main (String[] arguments) throws IOException
        BufferedReader keyboard;                                  //<-
        InputStreamReader reader;                                 // Allows the program to
        reader = new InputStreamReader (System.in);               // read the the keyboard
        keyboard = new BufferedReader (reader);                  //<-
        String name;                 //Assigns the name variable which will be parsed into...
        int newnames;               //...the integer variable for the amount of names.
        int order = 0;              //The integer variable that will be used to set the array size
        String[] array;             //Dynamic array (empty)
        System.out.println (" How many names do you want to input?");   //This will get the number that will later define the array
        name = keyboard.readLine ();
        newnames = Integer.parseInt (name);                                         // Converts the String into the Integer variable
        array = new String [newnames];                                               //This defines the size of the array
        DataInput Imp = new DataInputStream (System.in);       //Allows data to be input into the array
        String temp;
        int length;                                                                  //Defines the length of the array for a loop later on
            for (order = 0 ; order < newnames ; order++)                                //<-
            {                                                                           // Takes the inputed names and
                System.out.println (" Please input name ");                            // gives them a number according to
                temp = keyboard.readLine ();                                           // the order they were inputed in
                array [order] = temp;                                                  //<-
            for (order = newnames - 1 ; order >= 0 ; order--)                                //<-
            {                                                                                // Outputs the names in the reverse
                System.out.print (" \n ");                                                   // order that they were inputed
                System.out.println (" Name " + order + " is " + array [order]);             //<-
            for (order = 0 ; order < newnames ; order++)                                  //<-
                if (array [order].startsWith ("M") || array [order].startsWith ("m"))     // Finds and outputs any and all
                {                                                                         // names that begin with M or m
                    System.out.print (" \n ");                                            //
                    System.out.println (array [order] + (" starts with M or m"));         //
                }                                                                         //<-
            for (order = 0 ; order < newnames ; order++)                                            //<-
                length = array [order].length ();                                                   //
                if (length >= 5)                                                                    // Finds and outputs names
                {                                                                                  // with 5 or more letters
                    System.out.print (" \n ");                                                      //
                    System.out.println ("Name " + array [order] + " have 5 or more letters ");      //<-
}The notepad file contains the following names:
jim
laruie
tim
timothy
manny
joseph
matty
amanda
I have tried various methods but the one thing that really gets me is the fact that i can't find a way to connect the names to the arrays. Opening the file with FileInputStream is easy enough but using the names and then outputing them is quite hard. (unless i'm thinking too hard and there really is a simple method)

By "connect", do you just mean you want to put the names into an array?
array[0] = "jim"
array[1] = "laruie"
and so on?
That shouldn't be difficult at all, provided you know how to open a file for reading, and how to read a line of text from it. You can just read the line of text, put it in the array position you want, until the file is exhausted. Then open a file for writing, loop through the array, and write a line.
What part of all that do you need help with?

I need help renaming a file using regular expressions in Bridge.

Hi,
I work at a university, and we are working through files for our Thesis and Dissertations. We have been renaming them to make them more consistent. I am just wondering if there is a regular expression that could help with this process?
Here is come examples of current file names;
THESIS 1981 H343G
Thesis 1981 g996e
THESIS-1981-A543G
I don't need to change the actual names of the files. just how they are formatted.
Proper case on Thesis.
Hyphens(-) in all white space.
First letter capital, last letter lowercase on the call no (H343g)
So the list above should look like;
Thesis-1981-H343g
Thesis-1981-G996e
Thesis-1981-A543g
I have seen people do some pretty cool things with regular expressions! Any help would be greatly appreciated. Thanks!

You would be better off using a script to do this as an example as I don't think it would be possible in the Bridge re-name.
Using ExtendScript Toolkit or a Plain text editor copy the code into either and save it out as Filename.jsx
This needs to be saved into the correct folder. this is found by going to the preferences in Bridge, selecting Startup Scripts, this will open the folder where the script is to be saved.
Once this is done close and re-start Bridge.
To Use: Goto the Tools Menu and select Rename PDFs
Make sure you test the code with a few copied files into a seperate folder first to make sure it does what you want.
The script will do all PDF files in the selected folder.
#target bridge
if( BridgeTalk.appName == "bridge" ) {
renamePDFs = MenuElement.create("command", "Rename PDFs", "at the end of Tools");
renamePDFs.onSelect = function () {
app.document.deselectAll();
var thumbs = app.document.getSelection("pdf");
for( var z in thumbs){
var Name = decodeURI(thumbs[z].spec.name);
var parts = Name.toLowerCase().replace(/\s/g,'-').match(/(.*)(-)(.*)(-)(.*)(\.pdf)/);
var NewName = parts[1].replace(/^[a-z]/, function(s){ return s.toUpperCase() });
NewName += parts[2]+parts[3]+parts[4]+parts[5].toUpperCase().replace(/[A-Z]$/, function(s){ return s.toLowerCase() });
NewName += parts[6];
thumbs[z].spec.rename(NewName);

Need Help-SOA 11g File Adapter unable to delete input file and its crashing

Hi All
Please find the details below:
1. We have created a simple SOA composite to Read file from an input directory, archive the file in an archive directory using Inbound File Adapter Read
and then use Outbound File Adapter Write to move the file to a output directory.
2. File Adapter needs to delete the file after successful read/retrieval.
3. We are using the "Use Trigger File" for invoking the file adapter. This is a new feature in SOA 11g
4. Also we are using the option of reading the file as an attachment as we are not doing any transformation in the composite
Issue Details_
1. When the trigger file is put in the input directory for the first time, the File Adapter reads the file, archives it and moves it to the output directory
2. However it does not delete the input file from the input directory and raises Fatal Exception mentioned below:
[*2011-01-12T16:55:48.639+05:30] [soa_server1] [WARNING] [] [oracle.soa.adapter] [tid: weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@19c243d]*
[userId: <anonymous>] [ecid: 0000IptyLrL9_aY5TrL6ic1DBOS_000009,0] [APP: soa-infra] File Adapter FileAdapterTriggerFilePOC PostProcessor::
Delete failed, the operation will be retried for max of [0] times
[2011-01-12T16:55:48.639+05:30] [soa_server1] [WARNING] [] [oracle.soa.adapter] [tid: weblogic.work.j2ee.J2EEWorkManager$WorkWithListener@19c243d]
[userId: <anonymous>] [ecid: 0000IptyLrL9_aY5TrL6ic1DBOS_000009,0] [APP: soa-infra] File Adapter FileAdapterTriggerFilePOC [[
BINDING.JCA-11042
File deletion failed.
File deletion failed.
File : C:\Dibya\AttachmentTest\InputDir\TestFile3.txt could not be deleted.
Delete the file and restart server. Contact oracle support if error is not fixable.
If any one has faced similar issues, kindly provide pointers on how to resolve it.
Regards,
Dibya

Hi,
Using the file adapter, you can poll from multilple locations...
Keep the following property in your .jca file
<property name="DirectorySeparator" value="," />
While giving the path in File Adapter configuration, keep comma and give the next location....then the file will be picked up from the locations you gave....
Hope this helps...
Thanks,
N

I need help with viewing files from the external hard drive on Mac

I own a 2010 mac pro 13' and using OS X 10.9.2(current version). The issue that I am in need of help is with my external hard drive.
I am a photographer so It's safe and convinent to store pictures in my external hard drive.
I have 1TB external hard drive and I've been using for about a year and never dropped it or didn't do any thing to harm the hardware.
Today as always I connected the ext-hard drive to my mac and click on the icon.
All of my pictures and files are gone accept one folder that has program.
So I pulled up the external hard drive's info it says the date is still there, but somehow i can not view them in the finder.
I really need help how to fix this issue!

you have a notebook, there is a different forum.
redundancy for files AND backups, and even cloud services
so a reboot with shift key and verify? Recovery mode
but two or more drives.
a backup, a new data drive, a drive for recovery using Data Rescue III
A drive can fail and usually not if, only when
and is it bus powered or not

Need help replacing a file in AE

Ok, here is my problem, I made a project on another computer and then I transfered to my computer. I dragged all of the images and sounds but ONE very important image. I downloaded that same image from online and I need help replacing the corrupted old image with the new one. Here is a picture with more detail.
I tried copy & pasting the layer properties and effects, but that didn't work. Any ideas?
Thanks,
Emal

For instructions on swapping out a footage item's source file, "Replace layer source with reference to another footage item".

Need Help with .nnlp File.............A.S.A.P.

I'm having a problem also with my JNLP file. I have downloaded the program onto one computer and that computer is using j2re1.4.2_04
The other computers I believe are all running j2re 1.4.2_05
I'm not sure if that's make a difference, but on the computer with j2re 1.4.2_05 when going to the site where the .jnlp file is located, the application comes up and says Starting Application. After it gets to that screen it just stays there. I really need help with this as soon as possible.
Here is my .jnlp file listed below:
<?xml version="1.0" encoding="utf-8"?>
<jnlp
spec="1.0+"
codebase="http://www.appliedsolutions.com/placewiz"
href="Placewiz.jnlp">
<information>
    <title>Placement Wizard 4.0</title>
    <vendor>Applied Solutions, Inc.</vendor>
    <homepage href="index.html"/>
    <description>Placement Wizard 4.0</description>
    <description kind="short">Short description goes here.</description>
    <offline-allowed/>
</information>
<resources>
    <j2se version="1.4+"/>
    <j2se version="1.3+"/>
     <j2se version="1.5+"/>
    <jar href="Placewiz.jar"/>
</resources>
<security>
      <all-permissions/>
</security>
<application-desc main-class="com/asisoftware/placewiz/loader/Exec">
</jnlp>

This was due to a change in 1.4.2_05
the main class attribute
main-class="com/asisoftware/placewiz/loader/Exec">is wrong - it should be:
main-class="com.asisoftware.placewiz.loader.Exec">this didnt seem to mater before 1.4.2_05, but some change in java since then caused this bad class specification to stop loading.
/Andy

Need help with copying files onto external drive

I need help! Trying to copy downloaded movie files from Vuze (which have downloaded successfully) and copy onto external hard drive to view them but it wont let me copy over to the external device. Any ideas how to fix this please???

Can you explain the steps you used, and the error message (or symptom), that says the copy did not work?

I need help retrieving Microsoft files lost when upgrading to OSX Mavericks

My daughter recently upgraded our Mac to the OSX Mavericks platform. Unfortunately, all of our Microsoft files, etc. are gone! I need to know how I can retrieve these files or if I can. I'm honestly not impressed with this new platform. I need help asap and your help is truly appreciated.

You have to make the backup yourself. That's your only protection against file loss whether accidental or catastrophic. In fact you should have at least two of them - each done differently and on separate drives.
If your files truly were "erased" then you can see if they can be recovered:
General File Recovery
If you stop using the drive it's possible to recover deleted files that have not been overwritten by using recovery software such as MAC Data Recovery, Data Rescue II, File Salvage or TechTool Pro. Each of the preceding come on bootable CDs to enable usage without risk of writing more data to the hard drive. Two free alternatives are Disk Drill and TestDisk. Look for them and demos at MacUpdate or CNET Downloads. Recovery software usually provide trial versions that enable you to determine if the software would help before actually paying for it. Beyond this or if the drive has completely failed, then you would need to send the drive to a recovery service which is very expensive.
The longer the hard drive remains in use and data are written to it, the greater the risk your deleted files will be overwritten.
Also visit The XLab FAQs and read the FAQ on Data Recovery.
Basic Backup
For some people Time Machine will be more than adequate. Time Machine is part of OS X. There are two components:
1. A Time Machine preferences panel as part of System Preferences;
2. A Time Machine application located in the Applications folder. It is
     used to manage backups and to restore backups. Time Machine
     requires a backup drive that is at least twice the capacity of the
     drive being backed up.
3. Time Machine requires a backup drive that is at least double the
     capacity of the drive(s) it backs up.
Alternatively, get an external drive at least equal in size to the internal hard drive and make (and maintain) a bootable clone/backup. You can make a bootable clone using the Restore option of Disk Utility. You can also make and maintain clones with good backup software. My personal recommendations are (order is not significant):
1. Carbon Copy Cloner
2. Get Backup
3. Deja Vu
4. SuperDuper!
5. Synk Pro
6. Tri-Backup
Visit The XLab FAQs and read the FAQ on backup and restore. Also read How to Back Up and Restore Your Files. For help with using Time Machine visit Pondini's Time Machine FAQ for help with all things Time Machine.
Although you can buy a complete external drive system, you can also put one together if you are so inclined. It's relatively easy and only requires a Phillips head screwdriver (typically.) You can purchase hard drives separately. This gives you an opportunity to shop for the best prices on a hard drive of your choice. Reliable brands include Seagate, Hitachi, Western Digital, Toshiba, and Fujitsu. You can find reviews and benchmarks on many drives at Storage Review.
Enclosures for FireWire and USB are readily available. You can find only FireWire enclosures, only USB enclosures, and enclosures that feature multiple ports. I would stress getting enclosures that use the Oxford chipsets especially for Firewire drives (911, 921, 922, for example.) You can find enclosures at places such as;
1. Cool Drives
2. OWC
3. WiebeTech
4. Firewire Direct
5. California Drives
6. NewEgg
All you need do is remove a case cover, mount the hard drive in the enclosure and connect the cables, then re-attach the case cover. Usually the only tool required is a small or medium Phillips screwdriver.

Need help to create file with name and current time stamp.

I need to create .xlsx file exporting data from sql database and file name would be 'FileName' and current yyyymmdd.
I'm trying to use following code but it's keep saying incorrect syntax near "+".
EXEC p_CreateExcel 'sql64', 'NewFile', '\\hrfile1\Shared\Buying Report\NewFile'
+ CAST(YEAR(CURRENT_TIMESTAMP) AS VARCHAR)
+ RIGHT('00'+CAST(MONTH(CURRENT_TIMESTAMP) AS VARCHAR),2)
+ RIGHT('00'+CAST(DAY(CURRENT_TIMESTAMP) AS VARCHAR),2)+'.xlsx'

This is what I have on EXEC p_CreateExcel
USE [XePro01]
GO
/****** Object: StoredProcedure [dbo].[p_CreateExcel] Script Date: 02/26/2015 11:27:35 ******/
SET ANSI_NULLS ON
GO
SET QUOTED_IDENTIFIER ON
GO
ALTER procedure [dbo].[p_CreateExcel]
@db_name varchar(100),
@table_name varchar(100),
@file_name varchar(100)
as
--Generate column names as a recordset
declare @columns varchar(8000), @sql varchar(8000), @data_file varchar(100)
select
@columns=coalesce(@columns+',','')+column_name+' as '+column_name
from
information_schema.columns
where
table_name=@table_name
select @columns=''''''+replace(replace(@columns,' as ',''''' as '),',',',''''')
--Create a dummy file to have actual data
select @data_file=substring(@file_name,1,len(@file_name)-charindex('\',reverse(@file_name)))+'\data_file.xls'
--Generate column names in the passed EXCEL file
set @sql='exec master..xp_cmdshell ''bcp "set fmtonly off select * from (select '+@columns+') as t" queryout "'+@file_name+'" -c -t, -T -S'''
exec(@sql)
--Generate data in the dummy file
set @sql='exec master..xp_cmdshell ''bcp "set fmtonly off select * from XeProgst01.dbo.'+@table_name+'" queryout "'+@data_file+'" -c -t, -T -S'''
exec(@sql)
--Copy dummy file to passed EXCEL file
set @sql= 'exec master..xp_cmdshell ''type '+@data_file+' >> '+@file_name+''''
exec(@sql)
--Delete dummy file
set @sql= 'exec master..xp_cmdshell ''del '+@data_file+''''
exec(@sql)
GO

Need help in setting file name with special characters in attachment

Hi
We have a requirement where we need to set the file name that contains special characters (like Russian) and send mauil using Java mail.
If we set the file name as such, the attachment in the email contains garbled filename
Can you pl let me know how to resolve this?
We should use the file name as attachment name and this will have say special characters. The receiver who gets the mail should get with the correct attachment name
One important point.. the attachments are opened from MS outlook.
Thanks and regards
Ram
Edited by: 884910 on 13 Sep, 2011 5:00 AM

Read the FAQ carefully. You don't need to call encodeText unless you're using a really
old version of JavaMail.
And, it depends on whether the mail reader you're using is handling encoded parameters
according to the (new) MIME standard, or according to the (old) non-standard hack.
Sadly, without knowing what mail reader the recipient is using, it's impossible to use
encoded filenames that will work everywhere.

Need help with backup files made by HP Recovery.

So in 2011 I had made a post about a DV9 series HP laptop I had that I felt needed a harddrive. Well the laptop has been sold to a friend of mine and he has since fixed the issue it had. My curent deboggle is trying to deal with the 36GB of data it backed up onto an external USB powered harddrive. The information was saved from a system that ran Windows VISTA, on that same DV9 Pavilion. I have a new laptop and it's a Pavilion DV6 running windows 7. Is there some sort of 3rd party application or an uncommon HP utility that can open, run or modify. Specificaly I need to some files but not all, but if my only option is to extract all then that would be fine also. There is an executible in the backup folder but it doesn't extract anything it just locks up.
For the TLR portion, need to access backup files made on an older HP laptop with windows vista to a newer HP latop running windows 7.

Terribly sorry for the post, I should have researched more before posting. I found the answer to my issue in another thread here on the HP forums! Thanks so much!!

Need help with fla.file

Hi!
I'm always having trouble with a fla.file in cs3 professional. Every time i try to reopen the file in flash i get this:
failed to open document/users.desktop/jason/social.fla
pls help reopen this file
jay

create a new directory and move your fla there and try and open. if that fails, change the file's name and try and reopen. if that fails and you created the fla, it's probably corrupt.

Need help writing a script to traverse through files in a directory

I want to go through a directory and sub directories and convert files into jpg ones
I have this code I've been using: mkdir jpegs; sips -s format jpeg *.png --out jpegs
This is great for one directory at a time
But, what I want is to apply this to all sub directories, create a jpeg directory in each of the sub directories and then create jpg's and put them in there
I'm not sure where to start
Should I be looking for 'scripting in linux'?
Thanks
Omar

Hello
You may also try something like this. Set DIR to the root directory to start the search.
#!/bin/bash
#     convert png to jpeg and put jpeg in jpegs sub-directory
DIR=~/Desktop/test
while read -d $'\0' f
do
    d=${f%/*}/jpegs
    [[ -d "$d" ]] || mkdir "$d"
    sips -s format jpeg "$f" --out "$d"
done < <(find "$DIR" -type f -iname '*.png' -print0)
In case, here's an AppleScript wrapper:
set f to (choose folder with prompt "Choose root folder to process")'s POSIX path
if f ends with "/" then set f to f's text 1 thru -2
do shell script "/bin/bash -s <<'EOF' -- " & f's quoted form & "
#     convert png to jpeg and put jpeg in jpegs sub-directory
DIR=\"$1\"
while read -d $'\\0' f
do
    d=${f%/*}/jpegs
    [[ -d \"$d\" ]] || mkdir \"$d\"
    sips -s format jpeg \"$f\" --out \"$d\"
done < <(find \"$DIR\" -type f -iname '*.png' -print0)
EOF"
Regards,
H

Hard drive recently failed and iPhoto brings a -36 error when copying need help accessing image files

I recently updated my computer to mountain lion and after doing so my computer would no longer boot up. I took it to the apple store and they told me that the hard drive was damaged and needed to be replaced. They were booting my computer with an external drive and in doing so could access my computers HDD. Upon starting to drag and drop files to a new hard drive I started to get a lot of -36 errors. I proceeded to go go,e and create my own bootable thumb drive and try doing the same process with more time to look through it. I have up till now been able to copy most of my files but have run into a problem with iPhoto.
I have been searching around for a while now and have yet to find a method that helps me in my particular situation so I am now asking for help myself. I will explain what my current system of file recovery is and see if anyone can help me out.
I have since then replaced the HDD in my computer and purchased a SATA external HDD enclosure for the original drive. This allows me to still access all files and folders from the original drive. I have managed to recover a majority of the files but have recently run into a problem with the iPhoto library. Every time I try to drag and drop the iPhoto library to my new HDD it fails after "transferring" 2.02GB and tells me it has encountered a -36 error because some files cannot be read or written. I believe I am using iPhoto '09, I will check and confirm that later.
I am looking for a way to open iPhoto's library and access the image files it seems to be hiding from me. Please understand that I cannot open the iPhoto library either, I have lost access to the library entirely and want to see if there are any image files that I can save. I dont have the computer backed up recently and want to save my photos. Thanks for looking and I'm hoping someone can help.

Download iPhoto Library Manager and use its rebuild function. (In Library Manager it's the FIle -> Rebuild command). Rebuild it to the Pictures Folder. This might overcome the -36 issue.
(This will create an entirely new library. It will then copy (or try to) your photos and all the associated metadata and versions to this new Library, and arrange it as close as it can to what you had in the damaged Library. It does this based on information it finds in the iPhoto sharing mechanism - but that means that things not shared won't be there, so no slideshows, books or calendars, for instance - but it should get all your events, albums and keywords, faces and places back.
Because this process creates an entirely new library and leaves your old one untouched, it is non-destructive, and if you're not happy with the results you can simply return to your old one.)
Failing that you're into recovering your Originals from the damaged Library and creating a new Library and starting over from scratch.
Regards
TD

Need help traversing through files

Similar Messages

Maybe you are looking for