Sqlloader and plsql file limit

there is a 2G limit for size of file to be open in sqlloader or plsql. is there any work around.
Thanks

Hi John,
The below mentioned are SAP provided details:
For Import file size all MDM applications have a limit of 2GB for file size(Automatic import). Beyond 2GB, various failures may occur.So it is advisable to limit your source files to a little less than 2GB (subtract a MB or so).
As a general recommendation, importing a file of up to 200MB is preferable and performs better.
For syndication fileThe limit of the total size of the syndication is 3.4GB in MDM 7.1 and 2GB in MDM 5.5
The entire result data is read in the memory as one giant BLOB. This BLOB cannot exceed the limit mentioned above.
Using different smaller maps helps syndication under such a case.
Please note a lot depends on sizing,concurrent users,design and network,so these parameters vary a bit.
Thanks,
Ravi

Similar Messages

EA4500 router and media server file limit

I purchased an EA4500 router yesterday and it arrived today. Set it up, copiued my media library over to a new Seagate Expansion drive (2 TB) and it currently is filled with 320GB of files. Music folder, Pictures folder and Video folder. Thing is only some of the files are showing up. Looks very much like some stupid limitation on file numbers. I specifically purchased this router because of the media server and now it is useless.
Is there a fix for this sillyness? I can't seem to find a way to turn the file limit off. I truly hope I haven't purchased another rubbish router. The TP Link router I replaced had no such file size limit and was 2/3 of the price, easily.
Yours, not amused

Yes, I checked that before I bought myself a Seagate Expansion drive 2TB. The router list shows 1.5 and 3TB drives in that range and I would say that the 2TB is veyr likely to be supported also.
The files are bog standard file types! Some files show up but not all of them.
FLAC (you missed that filetype off the supported audio types btw) and MP3 show up but not all of them.
MPEG2 files show and play..but not all are visible.
None of my images in my photo library show up and they are all JPEG. No esoteric file formats.
It seems though that the media server just doesn't show anything after it reaches a file limit. It really isn't up to anything much if that is the case and for the money that router should be better. Furthermore, the folders with audio albums in doesn't display the contects in the correct alphanumeric order. I was playing an album by Cassandra Wilson and immediately noticed that the songs were in the wrong order. Something totall wrong there...the server has to be displaying them like that.
I have Marantz CR603 all-in-one hif fis in 3 different rooms in the house (living room and two bedrooms). Sometimes 2 can connect simultatenously but 3 won't as the server falls over. Even with two units connected it will suddenly disconnect for no reason. My connection isn't slow It is fast anbd yet accessing the media server is very very slow and especially simultatenous access.
It seems to me that the media server element is a stripped down token effort but all the sales garb for the router doesn't mention aything about its silly limitations.
I think the best thing for me to do now is return this to Amazon for a full refund and find another brand of router. It was bad enough 'adjusting' to the cloud managment - a firmware download initiated on install and installed that. Some of the config pages don't work properly (that needs an urgent fix as well...IP address fields with only 3 fields that won't allow you to enter last 3 octets of address and you can't apply setting) and the dumbned down way of presentating the options makes it a pain to setup if you are used to the usual way of setting up a router. If I setup a router manually it takes a fraction of the time that the hand holding setup nonsense takes. I get the idea, and it looks pretty and all big buttony how everyhting is going these days but there should be a seriously 'normal' advanced mode for people that don't require their hands held through the setup and configuration.
Very dissappointed. It's a fast router as well.

How to use ODI tool (file move etc) and plsql in a ODI procdure step

Hi,
I need your help to uses both plsql code and ODI tolls in a ODI procedure step.
Req:
moving files to different directory Based on the variable value and previous step return code ,
BEGIN
IF #SEQ=1 AND <%=odiRef.getPrevStepLog("RC")%> =0
then OdiFileMove "-FILE=input/#FILE_NAME" "-TOFILE=processed/#V_FILE_NAME" "-OVERWRITE=YES" "-CASESENS=NO" "-RECURSE=YES"
ELSIF #SEQ=1 AND <%=odiRef.getPrevStepLog("RC")%> !=0
then OdiFileMove "-FILE=input/#FILE_NAME" "-TOFILE=reject/#V_FILE_NAME" "-OVERWRITE=YES" "-CASESENS=NO" "-RECURSE=YES"
END IF;
END ;
how do I do that ? which technology I have to use because for plsql I need oracle and ODI file move I need sunopsis
Please help me.
Thanks,

Hello User,
Use below code, it will work fine.
Technology: OdiTools
<@if((<%=odiRef.getPrevStepLog("RC")%>)>0 && #PROJ_FILE.SEQ==1){@>
OdiFileMove "-FILE=input/#FILE_NAME" "-TOFILE=processed/#V_FILE_NAME" "-OVERWRITE=YES" "-CASESENS=NO" "-RECURSE=YES"
<@}else if ((<%=odiRef.getPrevStepLog("RC")%>)>0 && #PROJ_FILE.SEQ==1){@>
OdiFileMove "-FILE=input/#FILE_NAME" "-TOFILE=reject/#V_FILE_NAME" "-OVERWRITE=YES" "-CASESENS=NO" "-RECURSE=YES"
<@}@>
Thank You.

Upload and Copy files using PLSQL.

Hi All,
Can UTL package can be used to upload any local data file to server?
Or is there any in-built package which can be used to upload files to servers and copy files to another directory?
Thanks in advance.

Avishek wrote:
Thanks.
But i've a requirement to upload and copy files from one directory to another.
How can i approach?Realize we only know what you post & so far you have posted NOTHING useful.
How exactly does end user interact with the DB?
3-tier application?
EndUser<=>browser<=>WebServer<=>ApplicationServer<=>DatabaseServer
What OS name & version for client system?
Handle:      Avishek
Email:      [email protected]
Status Level:      Newbie (5)
Registered:      Jun 3, 2008
Total Posts:      68
Total Questions:      27 (16 unresolved)

How can i make shorten systemlog files and joblog files on OS

Hello
How can i make shorten systemlog files and joblog files on OS

Hello Jan,
You can limit the size of system log.
The size of the application server's System Log is determined by the
following SAP profile parameters. Once the current System Log reaches
the maximum file size, it gets moved to the old_file and and a new
System Log file gets created. The number of past days messages in the
System Log depends on the amount/activity of System Log messages and the
max file size. Once messages get rolled off the current and old files,
they are no longer retrievable.
rslg/local/file /usr/sap/<SID>/D*/log/SLOG<SYSNO>
rslg/local/old_file /usr/sap/<SID>/D*/log/SLOGO<SYSNO>
rslg/max_diskspace/local 1000000
rslg/central/file /usr/sap/<SID>/SYS/global/SLOGJ
rslg/central/old_file /usr/sap/<SID>/SYS/global/SLOGJO
rslg/max_diskspace/central
Refer to http://help.sap.com/saphelp_nw70/helpdata/EN/c7/69bcbaf36611d3a6510000e835363f/content.htm
for explanation of profile parameters.you can reduce the size of system log using rslg/max_diskspace_local and rslg/max_diskspace_central
But you can't reduce the size of job log files on OS
Rohit

User I/O and db file parallel read is high in AWR report

Hi,
We have one performance issue during a job execution.
From the awr report we have identified one query with a table having millions of records causing problems and then we had also fine tuned that query by changing it's code and by using the optmizer hints. It is being executed in plsql batches. After fine tuning, On the first batch execution(first 5000 records) the query is taking only 5 mins, but on the consecutive batches it is consuming more time( more than 30 mins).
From the awr report I got the statistics as
Release : 11.2.0.2.0
Instance Efficiency Percentages (Target 100%)
Buffer Nowait %: 100.00 Redo NoWait %: 100.00
Buffer Hit %: 85.44 In-memory Sort %: 99.98
Library Hit %: 99.76 Soft Parse %: 99.15
Execute to Parse %: 88.91 Latch Hit %: 100.00
Parse CPU to Parse Elapsd %: 87.32 % Non-Parse CPU: 98.65
The buffer hit % is good. On each batch execution it is taking different set of records.
Top 5 Timed Foreground Events
Event Waits Time(s) Avg wait (ms) % DB time Wait Class
db file parallel read 120,485 42,540 353 89.60 User I/O
DB CPU 3,794 7.99
db file sequential read 145,074 606 4 1.28 User I/O
db file scattered read 70,030 556 8 1.17 User I/O
direct path write temp 12,423 21 2 0.04 User I/O
So the I/O is our main concern since that query contains one table with millions of records.
Host CPU (CPUs: 24 Cores: 24 Sockets: 4)
Load Average Begin Load Average End %User %System %WIO %Idle
1.40 1.45 0.6 0.3 3.7 99.0
Load is also normal.
From the Time model statistics , sql execute elapsed time is 98.27% of db time and only 7.99% is that of DB CPU.
Memory Statistics
Begin End
Host Mem (MB): 64,318.0 64,318.0
SGA use (MB): 30,720.0 30,720.0
PGA use (MB): 488.2 497.1
% Host Mem used for SGA+PGA: 48.52 48.54
Both the size of sga_max_size and sga_target are 32,212,254,720(32gb) bytes and that of
pga_aggregate target is 629,145,600(600mb)
from this it is evident that the memory is still available(so increase in memory size is not an option).
The sql statistics for that query shows like that
Elapsed Time (s) Executions Elapsed Time per Exec (s) %Total %CPU %IO SQL Id SQL Text
44,950.03 55 817.27 94.67 6.99 94.72 79dgmrxh4kv74 SELECT /*+ index(cdr_data cdr_...
I can't understand whether the problem is in the database side or with the query?
If the problem is with the query, then how it has been executed in 5 mins for the first batch ?
(all the batches are having 5000 records each).
And how can we reduce the db file parallel read ?
Your valuable advice will be greatly appreciated.
Thanks in advance
Manoj Kumar N

"db file parallel read" is likely to be associated with something like index prefetching.
See:
http://www.freelists.org/post/oracle-l/RE-Calculating-LIOs,11
http://aprakash.wordpress.com/2012/05/29/index-range-scan-and-db-file-scattered-read-as-session-wait-event/
http://jonathanlewis.wordpress.com/2006/12/15/index-operations/
Tune the SQL.
Review the execution plan.
Check whether the statistics are accurate.
Review whether the index hint (and others that we can't see) is appropriate.

4GB file Limit

I have an iPod classic with 30GB. My music takes up about 6GB. I want to use the rest of the drive as a backup for the important files on my PC, The backup is about 15GB in size. When I try to backup to a directory on my iPod the backup always fails at a few bytes short of 4GB. I have see various references to a 4GB file limit but didn't see any conformation that such a limit exists.
I'd like to know
1)Is there a limit to the size of individual files on an iPod?
2)Is there a way to remove this seemingly arbitrary limit?
Thanks,
Ron MacRae

Is there a limit to the size of individual files on an iPod?
Yes, 4GB. See:http://docs.info.apple.com/article.html?artnum=61131 (bottom of page)
Is there a way to remove this seemingly arbitrary limit?
It's a FAT32 file system limitation and cannot be removed.

Maximum number of lines in Al11 for csv and txt files

Hello Experts,
I need to extract millions of records to a file in AL11 from several DSO - based on fiscal period and year. Can anyone tell me about the maximun number of lines a csv and txt file can hold in AL11.
Points will be assigned.
Kevin.

Hi.
As per my knowledge there is no limit for text files but for csv file its 1048576 rows.
Hope this helps.
Regards
Sai

External table log and bad files

Hi, i have defined the following access parameters for my external table and set REJECT LIMIT to 0:
ACCESS PARAMETERS
RECORDS DELIMITED by NEWLINE
BADFILE BAD_DIR:'CARDS.bad'
LOGFILE LOG_DIR:'CARDS.log'
NODISCARDFILE
FIELDS TERMINATED BY ","
OPTIONALLY ENCLOSED BY '"'
READSIZE 1048576
LRTRIM
MISSING FIELD VALUES ARE NULL
REJECT ROWS WITH ALL NULL FIELDS
I want to know everytime i query the external table, my log file and bad file will be overwritten or appended? i want them to be overwritten.

Hi,
Yeah, well, be in for a surprise here:
"The external tables feature is a complement to existing SQL*Loader functionality."
http://download.oracle.com/docs/cd/B19306_01/server.102/b14220/utility.htm#sthref1800
http://www.oracle.com/pls/db102/search?remark=quick_search&word=external+table&tab_id=&format=ranked
Have you actually read/tried anything?
You can download an XE DB for free and play with that.

Open file limit in limits.conf not being enforced

So I am running a Arch installation without a graphical UI and Im running elasticsearch on it as its own user (elasticsearch). Since elasticsearch needs to be able to handle more than the 4066 files that seems to the be the default, I edit /etc/security/limits.conf
#* soft core 0
#* hard rss 10000
#@student hard nproc 20
#@faculty soft nproc 20
#@faculty hard nproc 50
#ftp hard nproc 0
#@student - maxlogins 4
elasticsearch soft nofile 65000
elasticsearch hard nofile 65000
* - rtprio 0
* - nice 0
@audio - rtprio 65
@audio - nice -10
@audio - memlock 40000
I restart the system, but the limit is seemingly still 4066. What gives? I read on the wiki that in order to enforce the values you need a pam enabled login. I dont have a graphical login manager and
grep pam_limits.so /etc/pam.d/*
Gives me this..
/etc/pam.d/crond:session required pam_limits.so
/etc/pam.d/polkit-1:session required pam_limits.so
/etc/pam.d/su:session required pam_limits.so
/etc/pam.d/system-auth:session required pam_limits.so
/etc/pam.d/system-services:session required pam_limits.so
Any ideas on what I have to do to raise the open file limit here?
Thanks

Seems like adding the LimitNOFILE parameter to the systemd service file did the trick, but still doesnt explain why limits.conf isnt being enforced.
Last edited by Zygote (2014-07-17 10:04:43)

Hidden and hiding files and folders

how do I hide or unhide hidden files or folders??
I have a directory that I want to hide so that other people can't see it or get access to it. (or at least limit the people who can see it and get access to it.) How do I set it up to protect that directory and any file that goes into it?
cuz...I have two separate accounts (lets say....x and y) and I want only x and y and root to be able to have access to (e.g.) /home/directory
What command do I use to make it a "hidden file/folder"? (well..the Solaris equilvalent to a Windows hidden file or folder)

The option of changing the permisions is a better solution for what you want to do.
For completeness sake, the way to hide/unhide directories,files etc. in UNIX is by starting the name with a ".".
This does however not restrict access to the resource in any way , it just hides it from directory listings etc. Most tools/file managers etc. have an option to "show hidden files/directories" which negates its use as a security mechanism.
You will find that a lot of applications store their configuration information in directories starting with "." as is the case with netscape which has a ".netscape" directory off your home directory. It does serve the purpose of keeping it out of the way as it is not generally visible while still easily accesable.
The same holds true for WinTel "hidden" directories/files, in explorer they just show up as a lighter shade ( grayed out) but are still accessable like any other directory.
Hein

VAR and Swap Files - Taking up 3 gigs of space!

My 60 gig HD has been getting close to its size limit so I ran DiskSweeper to see if there were some unneeded files etc. that I could throw away. I discovered that the VAR folder was using 1.95 gigs and in the VM folder, the swap files were taking up about 1 gig...
I guess these are essential system files and can’t be deleted or reduced in size, or can they?
Thanks in advance!

To clear the swap file(s) restart your computer. I've never had more than two swap files, but then I have enough RAM for what I do. If your system keeps creating large swap files then it is a sign you need more RAM. If you can't get more, you'll need to limit the number of RAM hungry programs you have running at the same time. Because of the things that get dynamically created as you work, such as swap files and temp files, you should have a minimum of 10% of your drive free, and 15 would be safer. If I were you I would make sure I always had 10GBs free. You might look into getting an external drive, and move some of your files over to it. For instance, you can move your iTunes music library to another drive--I've done that because my startup drive is also a "mere" 60GBs.
Francine
Schwieder

Database files limit

I work on Oracle database Version 10 R 10.2.0.4.0
My database has db_files = 200 specified as a part of Initialization parameter.
I have 200 database files already on my database, Today I tried to create 4 datatabase files for some reason my database allowed my creating those files even if it exceeded number of database files limit.
Will I be able to create database objects in these database files?
Any reply is truely appreciated.
Thanks in advance
J

J1604 wrote:
I work on Oracle database Version 10 R 10.2.0.4.0
My database has db_files = 200 specified as a part of Initialization parameter.
I have 200 database files already on my database, Today I tried to create 4 datatabase files for some reason my database allowed my creating those files even if it exceeded number of database files limit.
Will I be able to create database objects in these database files?
Any reply is truely appreciated.
Thanks in advance
J
From the fine Reference Manual:
DB_FILES specifies the maximum number of database files that can be opened for this database. (emphasis mine)
What does DBA_DATA_FILES say about the STATUS and ONLINE_STATUS of the files in question?
What does V$DATAFILE have to say?
Will you be able to create database objects in these database files? What does it cost to try it and see for yourself? With the proviso that you cannot directly specify what file an object goes in. You can only specify a tablespace. If that tablespace has only one data file the test is simple. If the tablespace contains more than one data file, it gets more complex because oracle will use data files within a TS as it sees fit.

Lightroom 3 export with file limit

Hi,
exporting to jpg with file limit set to 399KB sometimes produces larger files up to 450KB. Am I doing something wrong or is it a bug? Need this file limit to upload the files on a website with limitation to 400KB.
Thanks
Gerald

It's a bug. The file size limit seems to be fixed in 3.2RC but if you choose both file size limit and watermark, the watermark won't show up.

File limit with home sharing

Is there a file limit using home sharing?

Nevermind...went digging and found out that my wife had changed her home share settings to her itunes account and did not tell me.

Sqlloader and plsql file limit

Similar Messages

Maybe you are looking for