Batch Load Skip Files

I have a strange case of file being skipped when I am doing a batch load. We are loading historical data from Dec-2010 to Aug-2012. Data is split into one file per periode(month). What happens when I run the batch load script is that all files load perfectly, expect files containing data from May (2011 & 2012) and October (2011).
I have tried to run a batch with only the files from May and October and then batch process skips completly.
Is there any setting that might have been set that can cause this behavior or anything else that I should examine. Any help or clue will be much appreciated.

File name convention is kept and the content of the file are good, if I change May-2011 to Apr-2011 and thereby load May's data into April it works just fine. Have also tried renaming Apr-2011 file to May-2011 and then it is skipped as well. Manual import of the files that are skipped works wihtout problem.
When running just the files that are being skipped, I had the script write the count of files in the batch collection and that part of the process picks up the correct number of files, in this case 3, but then they are skipped in the batch execute step.
Can this have something to do with Metadata setting in HFM? Problem started after Metadata was changed in HFM and thus we had to load all historical data again. Before that it loaded fine to May and October. At least I don't remember having this problem before.

Similar Messages

Batch Loader File Name - Replace/Append?

We employ a custom/smart merge in FDM that automatically removes previously loaded intersections in HFM 11.1.2.1 by appending NODATA lines at the end of our load file based on the information included in the previous load file. In the FDM configurations, users are only able to use the MERGE option when loading data so that this functionality is not subject to override.
We have just purchased and developed a Batch Loader solution that we'd like to pair with this smart merge functionality and I want to be sure that we are requiring appropriate file name configuration based on a MERGE data load setting. If I understand the file name conventions for batch loader correctly, the "RA", "RR", "AR", "AA" suffix at the end of the loader determines whether batch loader runs through a replace or append.
If we want a location's file to replace the previous load file within FDM during the import step, but load all data files to HFM using a merge, should my filename end with "RA"? Also, if someone accidentally uses RR, does changing the Adapter Option (FM11X-G5-ELoadOptMethodVal) to only show Merge protect against a replace load?
Thanks in advance!
S

The Load Tags are as follows:
Load Method for FDM: R,A
Load method for Target System: R,A
That is correct, if you want to do a replace in FDM and a Merge in HFM you would use RA or RM.
RR would perform a replace in FDM and a Replace in HFM.
You would need to test removing the Replace from the option in the adapter and see if it would fail for load.

About Batch Loader and Multiload Journal files

Hi, may someone help me in 2 questions/
Can I use Batch Loader to automate process FDM journals and load it to HFM?
And second, is it possible to use multiload excel files for these journals?
Thx
Edited by: user10941958 on Jan 22, 2010 2:54 AM
Edited by: user10941958 on Jan 22, 2010 2:56 AM

You can use the Trial balance file for loading journals. Just select the location and set data value to entity currecy adjustments. The data will go as journal entry even if you use trial balance file but you wont have 2 columns debit and credit only one colum for amount.
Hope this is helpful.
If you find any post helpful or correct please mark it.
Nick

Loading file in Merge Mode through the batch loader in FDM

Hi,
I have multiple locations loading in replace mode and 1 location loading in merge. We are using the batch loader and following the naming convention specified in the admin guide. Is there a way to specify in the location name to load the file to HFM in merge mode, or does that location need a seperate adapter with the load rule set to merge?
Any assistance would be greatly appreciated

You dont need a spearate adaptor. You can achieve this by changing the naming of the files. I believe u currently use RR option for replacing the data. (seq_<Location>_<Category>_<Peiod>_RR.txt). You can use A or R appropriately in your load method.

Having multiple issues with automate batch - skipping files, misplacing watermarks etc

I record the action exactly how I want it: editing, placing the watermarks (place embedded) putting them where I want them and re-sizing, save as (with jpg details), etc before I stop recording. When I do the Automate Batch with this action, the watermark is placed nearly completely off the image, it will go from file 1 to file 10 (skipping files 2-9) This worked fine on a previous Batch with a similar action. Nothing is working correctly for this one. I have also tried using "Place Embedded" with the same result. The files are NEF files being saved to JPG. After the it finishes the action, the "Save As" menu opens.
Adobe Photoshop Version: 2014.2.2 20141204.r.310 2014/12/04:23:59:59 CL 994532 x64
Operating System: Windows 8.1 64-bit
Message was edited by: Adam Jordan

It is difficult to process different size image and add watermarks. You stated your currently processing RAW Nef files. RAW Files can have ACR setting saved for them which can size them differently. They can never have been processed with ACR so have not setting and will use your default setting for your camera. ACR also remembers your last used workflow setting which can change document size. In your Action I see you using Place which has some setting for the place transform. However I see no step before the the place to handle document size. So the place step will work differently on different size documents. The Place is followed by a move and then a second place and move. You then flatten and save which is not necessary Saving a jpeg from a layered document will save a flat jpeg. Quality 12 is also overkill.
This action may work well on a particular size document with the same aspect ratio and orientation but will fail on others.
Crafting Actions Package UPDATED Aug 10, 2014 Added Conditional Action steps to Action Palette Tips.
Action Actions Palette Tips.txt
Action Creation Guidelines.txt
Action Dealing with Image Size.txt
Action Enhanced via Scripted Photoshop Functions.txt
CraftedActions.atn Sample Action set includes an example Watermarking action
Sample Actions.txt Photoshop CraftedActions set saved as a text file.
More then a dozen Scripts for use in actions
Download

How to batch load files

Hi,
I have a list of files to be read entirely into memory. Is there any better approach of reading those files, other than one-by-one approach.
Thanks

Hi,
I have this problem:
I have searched in google about Batch Load File. I understood like it should be have name value pairs of data and terminate with EOD & # sign.
I want to create a batch load file in java. So how should be the file? The file should be same as i mentioned above or else we can keep it as an xml file or what?
So how should i write the code in java i.e; what technologies i should use inorder to create a batch load file in java.
Can any one please give me a solution.
Thanks
in advance.

Batch load file for folder

hi,
I am using ucm10.1.3.3.3, the question is can I use batch load file for folders?
There seems only primaryFile in loading definition file, this means I can only define loading files one by one, is there a way to define loading folders.
I have millions of files within about 100 folders, if no loading folder function is available, what's your suggestion on this case?
Thanks!
Best regards

Hi,
If you want to replicate the local folder-structure with documents into UCM, I don't think BatchLoader can do that!
Then either drag-n-drop or write some custom component that creates IdcCommand file for folder-creation as well as checking in documents into UCM folder.
Regards,
Prateek

Into which folder the files will be loaded in WebCenter Content by Batch loader utility

Hi,
For performing file operations like insert, update, delete etc in bulk, we use the batch loader utility in WebCenter Content.
However, what is the parameter to specify into which folder in repository the documents get uploaded or deleted etc.
Thanks in advance!

Hi ,
If using Contribution folders then the parameter xCollectionID .
If using Framework Folders then it would be fFolderGUID.
Thanks,
Srinath

Skipping fields in SQL*LOADER data file

I have a data file that has more fields than the target table does. How can I write a SQL*LOADER control file to skip some fields in the middle of the text line?
null

If you don't want to define input fields by position, the simplest way I think is to use FILLER fields.
Quoted from SQL*Loader doc:
"Specifying Filler Fields
Filler fields have names but they are not loaded into the table. However, filler fields can be used as arguments to init_specs (for example, NULLIF and DEFAULTIF) as well as to directives (for example, SID, OID, REF, BFILE). Also, filler fields can occur anyplace in the data file. They can be inside of the field list for an object or inside the definition of a VARRAY.
See SQL*Loader DDL Behavior and Restrictions for more information on filler fields and their use.
A sample filler field specification looks as follows:
field_1_count FILLER char,
Ex:
Regards,
Zoltan

Problem loading XML-file using SQL*Loader

Hello,
I'm using 9.2 and tryin to load a XML-file using SQL*Loader.
Loader control-file:
LOAD DATA
INFILE *
INTO TABLE BATCH_TABLE TRUNCATE
FIELDS TERMINATED BY ','
FILENAME char(255),
XML_DATA LOBFILE (FILENAME) TERMINATED BY EOF
BEGINDATA
data.xml
The BATCH_TABLE is created as:
CREATE TABLE BATCH_TABLE (
FILENAME VARCHAR2 (50),
XML_DATA SYS.XMLTYPE ) ;
And the data.xml contains the following lines:
<?xml version="2.0" encoding="UTF-8"?>
<!DOCTYPE databatch SYSTEM "databatch.dtd">
<batch>
<record>
<data>
<type>10</type>
</data>
</record>
<record>
<data>
<type>20</type>
</data>
</record>
</batch>
However, the sqlldr gives me an error:
Record 1: Rejected - Error on table BATCH_TABLE, column XML_DATA.
ORA-21700: object does not exist or is marked for delete
ORA-06512: at "SYS.XMLTYPE", line 0
ORA-06512: at line 1
If I remove the first two lines
"<?xml version="2.0" encoding="UTF-8"?>"
and
"<!DOCTYPE databatch SYSTEM "databatch.dtd">"
from data.xml everything works, and the contentents of data.xml are loaded into the table.
Any idea what I'm missing here? Likely the problem is with special characters.
Thanks in advance,

I'm able to load your file just by removing the second line <!DOCTYPE databatch SYSTEM "databatch.dtd">. I dont have your dtd file, so skipped that line. Can you check if it's problem with ur DTD?

Batch loading with sdordf.jar.

Hi Guys
I have just tried a batch load with sdordf.jar.
In my first attempt there was a mistake in the n3 file.
After correcting the file and re running I now get the error.
Connecting to jdbc:oracle:thin:...........
Append mode
Copy existing data out
Just load triples into one column
Temporary table already exists!
java.sql.SQLException: ORA-00955: name is already used by an existing object
ORA-06512: at "MDSYS.SDO_RDF_INTERNAL", line 3326
ORA-06512: at "MDSYS.SDO_RDF_INTERNAL", line 3362
ORA-06512: at "MDSYS.RDF_APIS", line 786
ORA-06512: at line 1
Can anyone tell me what the name of this temporary table is, so that I can get rid of it.
Cheers
Phil

Hi Mellie
After having a little break I have installed the jena patch during which I had to drop the network and model created before.
I tried running a batch load as before but I still get the error message saying the temporary table already exists.
I tried the clean up routine as suggested but get the error.
SQL> exec sdo_rdf.cleanup_batch_load('researchdata')
BEGIN sdo_rdf.cleanup_batch_load('researchdata'); END;
ERROR at line 1:
ORA-13199: Batch load cleanup failed. ORA-00942: table or view does not exist
ORA-06512: at "MDSYS.MD", line 1723
ORA-06512: at "MDSYS.MDERR", line 17
ORA-06512: at "MDSYS.SDO_RDF", line 1016
ORA-06512: at "MDSYS.SDO_RDF", line 1022
ORA-06512: at line 1
I run it as mdsys as you said.
Any other suggestions?
Cheers
Phil

How to batch upload PDF files into database BLOB

Hello.
I have a requirement to batch upload PDF files into BLOB column of an Oracle 8.1.7 table from Forms 6i Web. The content of the blob column (ie. the PDF content) MUST be displayable from all client software (eg. Oracle Web forms, HTML forms, etc.)
Our environment is
Middle-tier is 9iAS on Windows/2000
Database is Oracle 8.1.7.0.0 on VMS
Oracle Web Forms 6i Patch 10
Basically my Oracle web form program will display a list of PDF files to upload and then the user can click on the <Upload> button to do the batch upload. I have experimented the following approaches but with no luck.
1. READ_IMAGE_FILE forms built-in = does NOT work because it cannot read PDF file. I got error FRM-47100: Cannot read image file
2. OCX and OLE form item = cannot use this because it does NOT work on the Web. I got error FRM-41344 OLE object not defined
3. I cannot use DBMS_LOB to do the load because the PDF files are not in the database machine.
4. Metalink Note 1682771.1 (How to upload binary documents back to database blob column from forms). When I used this, I got ORA-6502 during the hextoraw conversion. In using this solution, I have downloaded a bin2hex.exe from the Google site. I've noticed that when I looked at the converted HEX file, each line has the character : (colon) at the beginning of each line. I know the PDF file has been converted correctly to HEX format because when I convert the HEX file back to BIN format using hex2bin.exe, I'm able to display the converted bin file in Acrobat Reader. When I removed the : (colon) in the HEX file, I did NOT get the ORA-6502 error but I CANNOT display the file in Acrobat Reader. It gives an error "corrupted file".
5. upload facility in PL/SQL Web toolkit - I tried to automatically submit the html form (with htp.p) but it does NOT load the contents of the file. I called the URL from Oracle forms using web.show_document. There seems to be issues with Oracle Web forms (JInitiator) and HTML (+ htp.p).
The other options I can think of at this point are:
1. Use SQL*Loader to do the batch upload via SQL*Net connection and use HOST() built-in from Oracle Webforms to execute SQL*Loader from the 9iAS.
2. Write a Visual Basic program that reads a binary file and output the contents of the file into a byte array. Then build a DLL that can be called from Oracle webforms 6i via ORA_FFI. I don't prefer this because it means the solution will only work for Windows.
3. Write a JSP program that streams the PDF file and insert the contents of the PDF file into blob column via JDBC. Call JSP from forms using web.show_document. With this I have to do another connection to the database when I load the file.
4. Maybe I can use dbms_lob by using network file system (NFS) between the application server and VMS. But this will be network resource hungry as far as I know because the network connection has to be kept open.
Please advise. Thank you.
Regards,
Armando

I have downloaded a bin2hex.exe from the Google site.
... each line has the character : (colon) at the
beginning of each line. I'm afraid it isn't a correct utility. I hope you'll find the source code of a correct one at metalink forum:
Doc ID: 368771.996
Type: Forum
Subject: Uploading Binary Files: bin2hex and hex2bin do not reproduce the same file
There is some links to metalink notes and some example about working with BLOB at http://www.tigralen.spb.ru/oracle/blob/index.htm. Maybe it helps. Sorry for my English. If there is any problem with code provided there, let me know by e-mail.

Changing the pdf profile of batch create multiple files in Acrobat?

Is it possible to load another pdf profile for batch create multiple files from Acrobat? I am batching indesign pages and I need to use a high resolution pdf profile with printer marks
The default seems to be low res rgb. Any idea if this can be done?

it is a custom Pdf Profile but basically an X1a with a few tweeks, When I try a watch folder with distiller it just errors out all the files.
Batch Processing using the "Create PDF, Batch Create Multiple Files " in Acrobat works but does not let me choose a pdf profile.
C

Sql and load rule file query

Currently loading the data with the script , which it contatins
Retreving data from oracle through SQL interface on to rules files
and loading the data.
just my question is , if i get 0 records from oracle , i dont want to proceed with the loading of data (which is no useful ).
Can i stop the loading if records are zero.

As far as I know there is nothing in MaxLIt that could tell that there were no rows.The MaxL statement would return a zero code saying that the process worked ok. It would be prossible in your batch script to have mutiple calls to MaxL and between them to do something like make a call to your sql DB getting the count of rows for your query. Investigate the result and if it is zero, then get out of your load and calc process (I guess you could do that even before you try to load).
Or how about scheduling a job that creates an output file with the count if it is greater than zero. If it is, then run the batch load process if it is not, then bypass it. There are multiple ways to do this outside of Essbase, just not in it.

How to load jar file in oracle 9i???

Hi Friends,
Can you help me, how to load jar file oracle 9i? I have to tried to load in 10g using loadjava command but it's not working in oracle 9i because the loadjava batch file itself is not there in oralce 9i.
Is there any other way then pls let me know.
- Hiren Modi

Hi,
I have oracle version : Release 2 (9.2.0.1.0) for Windows. I have tried to execute the loadjava command from SQL prompt but its giving as below.
H:\>loadjava
The system cannot find the path specified.
Do you know why its giving error like this. I have checked in dir : C:\oracle\ora92\bin but loadjava executable file is not there in it.
- Hiren Modi

Batch Load Skip Files

Similar Messages

Maybe you are looking for