How to batch load files

Hi,
I have a list of files to be read entirely into memory. Is there any better approach of reading those files, other than one-by-one approach.
Thanks

Hi,
I have this problem:
I have searched in google about Batch Load File. I understood like it should be have name value pairs of data and terminate with EOD & # sign.
I want to create a batch load file in java. So how should be the file? The file should be same as i mentioned above or else we can keep it as an xml file or what?
So how should i write the code in java i.e; what technologies i should use inorder to create a batch load file in java.
Can any one please give me a solution.
Thanks
in advance.

Similar Messages

Batch load file for folder

hi,
I am using ucm10.1.3.3.3, the question is can I use batch load file for folders?
There seems only primaryFile in loading definition file, this means I can only define loading files one by one, is there a way to define loading folders.
I have millions of files within about 100 folders, if no loading folder function is available, what's your suggestion on this case?
Thanks!
Best regards

Hi,
If you want to replicate the local folder-structure with documents into UCM, I don't think BatchLoader can do that!
Then either drag-n-drop or write some custom component that creates IdcCommand file for folder-creation as well as checking in documents into UCM folder.
Regards,
Prateek

Batch Loader File Name - Replace/Append?

We employ a custom/smart merge in FDM that automatically removes previously loaded intersections in HFM 11.1.2.1 by appending NODATA lines at the end of our load file based on the information included in the previous load file. In the FDM configurations, users are only able to use the MERGE option when loading data so that this functionality is not subject to override.
We have just purchased and developed a Batch Loader solution that we'd like to pair with this smart merge functionality and I want to be sure that we are requiring appropriate file name configuration based on a MERGE data load setting. If I understand the file name conventions for batch loader correctly, the "RA", "RR", "AR", "AA" suffix at the end of the loader determines whether batch loader runs through a replace or append.
If we want a location's file to replace the previous load file within FDM during the import step, but load all data files to HFM using a merge, should my filename end with "RA"? Also, if someone accidentally uses RR, does changing the Adapter Option (FM11X-G5-ELoadOptMethodVal) to only show Merge protect against a replace load?
Thanks in advance!
S

The Load Tags are as follows:
Load Method for FDM: R,A
Load method for Target System: R,A
That is correct, if you want to do a replace in FDM and a Merge in HFM you would use RA or RM.
RR would perform a replace in FDM and a Replace in HFM.
You would need to test removing the Replace from the option in the adapter and see if it would fail for load.

How do you "load files into photoshop layers" in bridge cc

I am having difficulty following on instruction in learning photoshop cc.
The book says to load files as layers select(in Bridge) tools/photoshop/Load files into photoshop Layers.
There is no Photoshop Option in the Tools Menu in my Bridge CC.
Is ther another way?
Dave

I run Windows 7 Ultimate, I have 2.00GB of RAM with 1.74 usable, and I selected 40 images, each about 2MB.

How to batch load multi data files to several tables

Hi,
One customer have such data structure and have large number of data(arround 10 Million). I think it's proper to convert them to data that SQL loader can recognize and then insert into Oracle 8 or 9. The question is how to convert?
Or maybe to insert them one by one is simpler?
1: Component of Data
The data file consists of nameplate and some records.
1.1 Structure of nameplate
ID datatype length(byte) comments
1 char 4
2 char 19
3 char 2
4 char 6 records in this file
5 char 8
1.2 structure of each record
ID datatype length(byte)
1 char 21
2 char 18
3 char 30
4 char 1
5 char 8
6 char 2
7 char 6
8 char 70
9 char 30
10 char 8
11 char 8
12 char 1
13 char 1
14 char 1
15 char 30
16 char 20
17 char 6
18 char 70
19 char 5
24 binï¼blobï¼ 1024
25 bin(blob) defined in ID19
2: data file and table spaces in database
dataID 1-13 of each record insert to table1,
14-18 to table2, and 19,24,25 to table3
Is there a method to convert them to some data that SQL loader can input and then at a whole load into Oracle 8 or 9?
I've check the Oracle Utilities docs, but did not find a way to load so many data files at a batch action.
In my view the solution consist in two ways:
1, Load each of them individualy individually to different tables by some programme. But the speed may be problem because the uninterrupted db connections and close.
2, Convert them to one or three files then use SQL loader.
But either isn't much easy, I wonder if there's a better method to handle.
Many thanks!

My coworker tried that, but it dragged down portal.
How about to update WWDOC_DOCUMENT$ table, then use WWSBR_API.add_item_post_upload to update folder information etc.?
If possible, is there any sample code?

How to batch load data to several tables

Hi,
One customer have such data structure and have large number of data(arround 10 Million). I think it's proper to convert them to data that SQL loader can recognize and then insert into Oracle 8 or 9. The question is how to convert?
Or maybe to insert them one by one is simpler?
1:     Component of Data
The data file consists of nameplate and some records.
1.1 Structure of nameplate
ID     datatype      length(byte)     comments
1     char     4
2     char      19
3     char      2
4     char      6     records in this file
5     char     8
1.2 structure of each record
ID     datatype     length(byte)
1     char     21
2     char     18
3     char     30
4     char      1
5     char 8
6     char      2
7     char      6
8     char      70
9     char      30
10     char      8
11     char      8
12     char      1
13     char      1
14     char      1
15     char      30
16     char      20
17     char      6
18     char      70
19     char      5
24     bin（blob）     1024
25     bin(blob)     defined in ID19
2: data file and table spaces in database
dataID 1-13 of each record insert to table1,
14-18 to table2, and 19,24,25 to table3
Is there a method to convert them to some data that SQL loader can input and then at a whole load into Oracle 8 or 9?
Thanks &Regards.

I've check the Oracle Utilities docs, but did not find a way to load so many data files at a batch action.
In my view the solution consist in two ways:
1, Load each of them individualy individually to different tables by some programme. But the speed may be problem because the uninterrupted db connections and close.
2, Convert them to one or three files then use SQL loader.
But either isn't much easy, I wonder if there's a better method to handle.
Many thanks!

How can i load file into database from client-side to server-side

i want to upload file from client-side to server-side, i use the following code to load blob into database.
if the file is in the server-side, it can work, but if it in the client-side, it said that the system cannot find the file. i think it only will search the file is in the server-side or not, it will not search the client-side.
how can i solve it without upload the file to the server first, then load it into database??
try
ResultSet rset = null;
PreparedStatement pstmt =
conn.prepareStatement ("insert into docs values (? , EMPTY_BLOB())");
pstmt.setInt (1, docId);
pstmt.execute ();
// Open the destination blob:
pstmt.setInt (1, docId);
rset = pstmt.executeQuery (
"SELECT content FROM docs WHERE id = ? FOR UPDATE");
BLOB dest_lob = null;
if (rset.next()) {
dest_lob = ((OracleResultSet)rset).getBLOB (1);
// Declare a file handler for the input file
File binaryFile = new File (fileName);
FileInputStream istream = new FileInputStream (binaryFile);
// Create an OutputStram object to write the BLOB as a stream
OutputStream ostream = dest_lob.getBinaryOutputStream();
// Create a tempory buffer
byte[] buffer = new byte[1024];
int length = 0;
// Use the read() method to read the file to the byte
// array buffer, then use the write() method to write it to
// the BLOB.
while ((length = istream.read(buffer)) != -1)
ostream.write(buffer, 0, length);
pstmt.close();
// Close all streams and file handles:
istream.close();
ostream.flush();
ostream.close();
//dest_lob.close();
// Commit the transaction:
conn.commit();
conn.close();
} catch (SQLException e) {

Hi,
Without some more details of the configuration, its difficult to know
what's happening here. For example, what do you mean by client side
and server side, and where are you running the upload Java application?
If you always run the application on the database server system, but can't
open the file on a different machine, then it sounds like a file protection
problem that isn't really connected with the database at all. That is to
say, if the new FileInputStream (binaryFile) statement fails, then its not
really a database problem, but a file protection issue. On the other hand,
I can't explain what's happening if you run the program on the same machine
as the document file (client machine), but you can't write the data to the
server, assuming the JDBC connection string is set correctly to connect to
the appropriate database server.
If you can provide some more information, we'll try to help.
Simon
null

How to batch change file permissions?

I posted this problem in another forum and think it belong here.
A client sent me a CD of data and graphical files. I copied them into a new folder on my desktop but I am unable to alter or change them because they are read only.
How can I change all the files in the directory over to read/write? Is there an easy way to do this?
John

BatChmod is a good GUI application for changing permissions.
Or you can try this in a Terminal window:
chmod -R u+rwX [spacebar, drag folder to Terminal window, press return]

LOAD FILE INTO GRAPHIC IMAGE ON CANV

How do I load file into graphic image on the canvas not the image item on the block?

With the Layout Editor open, select Edit > Import > Image.

Batch rename files on the server?

Can someone explain how to batch rename files on the server ?
I have 1000 rows each containing these fields
id (unique key)
productCode
filename1
filename2
For every row I need to rename the following fields:
Rename [filename1] to [productCode]_[id]_1
Rename [filename2] to [productCode]_[id]_2
also I need to rename the actual file on the server using the above scheme
Can someone show me the way ? I'm a little rusty with ColdFusion

So far I've got everything working apart from CFFILE which works only if it finds a corresponding jpeg file on the server. In other words it works perfectly until row 20 of the database because the filename contained in the field doesn't have a matching jpeg file on the server, so CFFILE fails like this...
Attribute validation error for tag CFFILE.
The value of the attribute source, which is currently C:\images\DSCN1293.JPG, is invalid.
The error occurred in C:\Inetpub\wwwroot\link\htdocs\old_apps\psp\updater.cfm: line 63
61 :                    action = "rename"
62 :                    source = #my_source1#
63 :                    destination = #my_destination1#>
is there a way to carry on looping through the remaining rows and ignore the above fail ?

Load File with wildcards?

Hello,
how could I load files with this pattern:
ausw_[name]_[date].xls (without the brackets)
Workbook workbook = Workbook.getWorkbook(new File("C:\\extracts/ausw_[name]_[date].xls"));
Could it be work with Regular Expressions?
Has anyone an idee?
Greetings
Marco

Check java.io.FilenameFilter and java.io.File.listFiles (FilenameFilter) or search the forum.

Batch Loader and Folders_g Question

I would like to use Batch Loader to load a large number of images into WCC. I am also using Folders_g in my implementation, and would like to instruct batch loader during asset loading run-time which folder in /Contribution Folders/ to place the asset. Does anyone know what the batch load file key / value pair is to make this happen?
Would I use something like this: (using dCollectionPath)
Action = insert
dDocTitle=Test Image
dDocAuthor=sysadmin
dSecurityGroup=Public
dDocType=Document
dInDate=10/25/10 9:58 AM
primaryFile=C:/Files/Test Image.doc
dCollectionPath=/Contribution Folders/images
<<EOD>>
Thank you,
Randy

Good Morning,
Thank you Anand and Srinath for helpful answers. Yes, the xCollectionID does work and I have it loading into the correct folder using that approach. However, I have several folders under the root /Contribution Folders hierarchy, and determining the xCollectionID of each or these subfolders prior to Batch Loader runtime and mapping the IDs to each of the nodes in the Batch Load File will be tedious. Furthermore, I will be building the Batch Load File on at least four different environments i.e. DEV, TEST, STAGING, and PRODUCTION, and determining xCollectionIDs for several folders across these environments will add even more complexity. I can do it, but was hoping for an easier path.
I am open to any more suggestions / ideas following your digestion of the previous information.
Let me throw one other question out there. Let's say I am able to load all my assets into the several folders in my folders_g hierarchy in my DEV environment using the mapping of xCollectionID. Am I able to migrate that folder structure with loaded assets downstream into TEST, STAGING, and PRODUCTION using some out of the box UCM utility? Does something like that exist?
Thank you,
Randy

Batch unlock files in Yosemite?

Anyone who knows how to batch unlock files in Yosemite?
Preferably unlocking all subfolders and files to a folder.
I've searched for methods, but only found older methods that doesn't seem to work anymore..

Back up all data before proceeding.
This procedure will unlock all your user files (not system files) and reset their ownership, permissions, and access controls to the default. If you've intentionally set special values for those attributes on any of your files, they will be reverted. In that case, either stop here, or be prepared to recreate the settings if necessary. Do so only after verifying that those settings didn't cause the problem. If none of this is meaningful to you, you don't need to worry about it, but you do need to follow the instructions below.
Step 1
If you have more than one user, and the one in question is not an administrator, then go to Step 2.
Triple-click anywhere in the following line on this page to select it:
sudo find ~ $TMPDIR.. -exec chflags -h nouchg,nouappnd,noschg,nosappnd {} + -exec chown -h $UID {} + -exec chmod +rw {} + -exec chmod -h -N {} + -type d -exec chmod -h +x {} + 2>&-
Copy the selected text to the Clipboard by pressing the key combination command-C.
Launch the built-in Terminal application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
Paste into the Terminal window by pressing command-V. I've tested these instructions only with the Safari web browser. If you use another browser, you may have to press the return key after pasting.
You'll be prompted for your login password, which won't be displayed when you type it. Type carefully and then press return. You may get a one-time warning to be careful. If you don’t have a login password, you’ll need to set one before you can run the command. If you see a message that your username "is not in the sudoers file," then you're not logged in as an administrator.
The command may take several minutes to run, depending on how many files you have. Wait for a new line ending in a dollar sign ($) to appear, then quit Terminal.
Step 2 (optional)
Take this step only if you have trouble with Step 1, if you prefer not to take it, or if it doesn't solve the problem.
Start up in Recovery mode. When the OS X Utilities screen appears, select
Utilities ▹ Terminal
from the menu bar. A Terminal window will open. In that window, type this:
resetp
Press the tab key. The partial command you typed will automatically be completed to this:
resetpassword
Press return. A Reset Password window will open. You’re not going to reset a password.
Select your startup volume ("Macintosh HD," unless you gave it a different name) if not already selected.
Select your username from the menu labeled Select the user account if not already selected.
Under Reset Home Directory Permissions and ACLs, click the Reset button.
Select
 ▹ Restart
from the menu bar.

How can I retrieve file name being processed in Batch

Hi All
I want to retrieve the current filename that is being processed by a batch, e.g. A1~Texas~Actual~Jan-2010~RR.txt
I can do this in various event scripts that have the strFile parameter but I need to do it in the BatchAction event script and cannot see how I go about it. I can see various objects in the API guide that should help me get at it but can't get it working.
Has anyone done this before or got any pointers for how I can do this?
Many thanks
Stuart

Hi Tony
I have been able to retrieve this using the PstrFileName property in various event scripts, particularly those where strFile is a parameter and then used API.DataWindow.Utilities.fParsePath to trim that and provide just the file name. However thsi does not work in the BatchAction event script.
I have found a property in the Batch Loader section of the supplementary API called PstrFileTitle but my VB is not strong enough to work out how to get at it. From what I can gather I would need to supply the BatchID (plus other parameters) to another function that would return this into a recordset and then read from the recordset (??) but I am not sure how to go about this.
To give you some background, what I am trying to achieve is writing to a log file pre and during batch processing where the log file name should use the source file's name, e.g. 'SourceFile.txt' will write to SourceFile.log. The issue is that for batch processing we have to rename 'SourceFile.txt' s 'A1~Texas~Actual~Jan-2010~RR.txt' and I previously tried to use the PvarTempNC variables to store the source file name only to find that I could use that in the BatchAction event script!
If you can point me in the right direction that would be great.
Thanks
Stuart

I have many photos with file extension of .PDD and that Photo Deluxe 4 no longer will operate in Win 7. How can I open? Next in Elements 11, how do I load and print different pictures and different sizes options on the same page?

I have many photos with file extension of .PDD and that Photo Deluxe 4 no longer will operate in Win 7. How can I open? Next in Elements 11, how do I load and print different pictures and different sizes options on the same page?
Thanks,
Shir

sbmgrams wrote:
I have many photos with file extension of .PDD and that Photo Deluxe 4 no longer will operate in Win 7. How can I open?
See here:
Reading PhotoDeluxe PDD Files

How to batch load files

Similar Messages

Maybe you are looking for