Unix admin question - file system is filling up

Oracle 9.2.0.1.0
UNIX AIX 5.2
The oracli3 filesystem was hitting the upper 90%s and I informaed the DBA. Learning from him is just leaning over his shoulder scribbling down as much as I can see while he thrashes through it.
I gleaned some things today that I wanted to check with tthe UNIX pros out there.
As I explained, that particular filesystem was filling up, and so he made some searches, first in the /patches directory. There were not too many there (in size), so he next went to /oracli1/oracle/iAS and did a search for logs like this:
sudo find . -name '*.log' -ls
He found one huge log file, and so had me do the cat /dev/null > command to send it to the black hole.
My question is this - when I next see that we are filling up as it were, should I automatically look for logs? Are they the culprits some of the time? Can offending logs be dealt with in this way (cat /dev/null >) ?
Is there something else I should be looking for ? (The oracli3 is now at 93% so I think we still have things to look at)
Many thanks.
DA
Sorry - one other thing - when I use the
find . -name '*.log' -ls command, how can I change it so that the output is more like that of the "more" suffix? The problem is that I would like to scroll through the output of .log files that this command throws back at me.
Message was edited by:
Dan A

It all depends.
When you assume there's nothing useful in those log files, you hire an Unix admin with zero knowledge of Oracle and have hem wipe those files away, 'because the file system fills up'. In the past we had similar administrators throwing away archived redo log files for exactly the same reason.
YOU on the other hand should set up proper administration procedures to move them away, tar them, and compress the tar file, so they take less space. After another 30 days you throw away the compressed tars.
What you have now is a very unprofessional method to 'administrate' a server.
Actually you are not administrating it all, because when disaster strikes, or disaster stroke in the past, and you need to explain and find out what happened and especially WHY, you will be yelling at the Unix 'admin' because he just has thrown away all log files, 'because the disk was getting full'
As to the second question:
There are a few fundamental concepts in Unix
1 ALL output can be redirected using > < and |, The latter symbol is called the pipe symbol and feeds the output into a filter. The filter is a command which reads the output from a previous command and processes. More, pg, and sort are filters, even sqlplus can be a filter
2 NO special switches should be implemented in any command if you can accomplish it using redirection or filters. So you won't find
TYPE/PAGE (VMS, Dos), but you will find cat <filename> | more
So the answer is you need to add | more to the command line
find . -name '*.log' -ls | more
You would also be advised to try to follow an Unix course, as your question is very fundamental. Alternatively buy the book Classic Shell scripting
Sybrand Bakker
Senior Oracle DBA

Similar Messages

  • Uploaded Files stored in Oracle 10G database or in Unix File system

    Hey All,
    I am trying to understand best practices on storing uploaded files. Should you store within the database itself (this is the current method we are using by leveraging BLOB storage) or use a BFILE locator to use the files system storage (we have our DB's on UNIX) . . .or is there another method I should be entertaining? I have read arguments on both sides of this question. I wanted to see what answers forum readers could provide!! I understand there are quite a few factors but the situation I am in is as follows:
    1) Storing text and pdf documents.
    2) File sizes range from a few Kb to up to 15MB in size
    3) uploaded files can be deleted and updated / replaced quite frequently
    Right now we have an Oracle stored procedure that is uploading the files binary data into a BLOB column on our table. We have no real "performance" problems with this method but are entertaining the idea of using the UNIX file system for storage instead of the database.
    Thanks for the insight!!
    Anthony Roeder

    Anthony,
    First word you must learn here in this forum is RESPECT.
    If you require any further explanation, just say so.
    BLOB compared with BFILE
    Security:
    BFILEs are inherently insecure, as insecure as your operating system (OS).
    Features:
    BFILEs are not writable from typical database APIs whereas BLOBs are.
    One of the most important features is that BLOBs can participate in transactions and are recoverable. Not so for BFILEs.
    Performance:
    Roughly the same.
    Upping the size of your buffer cache can make a BIG improvement in BLOB performance.
    BLOBs can be configured to exist in Oracle's cache which should make repeated/multiple reads faster.
    Piece wise/non-sequential access of a BLOB is known to be faster than a that of a BFILE.
    Manageability:
    Only the BFILE locator is stored in an Oracle BACKUP. One needs to do a separate backup to save the OS file that the BFILE locator points to. The BLOB data is backed up along with the rest of the database data.
    Storage:
    The amount of table space required to store file data in a BLOB will be larger than that of the file itself due to LOB index which is the reason for better BLOB performance for piece wise random access of the BLOB value.

  • CM Repository - Windows File System on EP(UNIX Platform)?

    Hi all,
    we have an EP6 SP2 on Unix. We want use CM repository manager to connect remote windows file system which contains all the content. In Global Services we wanted to use the fsmount Service-
    We get the following Message:" not supported for SUN OS to Win2000 System"
    Is it possible to integrate an Windows File System when you have installed the Portal on a UNIX Platform?
    Thanks!

    Hello Antonio,
    With EP6 SP2 Patch 5 KM on a Unix portal can access windows file systems including ACLs. Please have a look at the corresponing release notes
    http://help.sap.com/saphelp_ep60sp2patch5/helpdata/en/4d/8dec404303702ae10000000a155106/frameset.htm
    or in the documentation
    http://help.sap.com/saphelp_ep60sp2patch5/helpdata/en/ed/b334ea02a2704388d1d2fc3e4298ad/frameset.htm
    Kind regards,
    Roland

  • External Tables to Unix File System 10G R2

    Can anyone help with setting up an external table that reads a flat file from a Unix File system.
    I have sampled a file ok and created an external table and deployed it to the database ok but it can find the link through to the unix file system to read the file.
    I created the location as an FTP type and have referenced the path to the relevant directory /oracle02/app/OWB_files when creating the location. I have placed the relevant named file in the directory but when i try to look at the table in TOAD i get the following errors
    ORA-29913 error in executing ODCIEXTTABLEOPEN callout
    ORA-29400 data cartridge error
    KUP-04040 files 121123_PENS.txt in MLCC_FILES_LOCATION_0 not found
    Does anyone have a step by step guide for creating these and am i doing some thing wrong. Is choosing the FTP type in the location correct and is the path specified correctly. I can see much information on thisin the manual!
    Your assistance would be appreciated

    HI,
    You make sure that, the path should be shared one. We can do this using samba server.
    Regards,
    Gowtham Sen.

  • Question about a file system storage option for RAC on 10g

    Hello everyone,
    I am in the beginning of connecting our storage and switches, and building RAC on them but there is a little argument between our specialists.
    We have two database servers(10g with OEL 5) to be clustered and two visible disk groups to each of those nodes. So question is can we choose only one disk group as a shared storage leaving the rest one as the redundant copy during database a creation window while installing the database.  Because some of us argue that oracle database has a built-in capability to decide on what level of RAID we store our data.
    Thank you for your help.

    "some of us argue that oracle database has a built-in capability to decide on what level of RAID we store our data". 
    That statement is not true.  Oracle has optional multiplexing for control files, redo logs, and archive logs but this is not enabled by default and Oracle will not automatically enable it.  If you want redundancy of tables, indexes, temp, and undo you must provide this because Oracle does not offer it standard or as an option.  You can achieve redundancy with RAID at the array level, or host based mirroring (like ASM redundancy groups or Linux mdadm).  This can also depend on your file system because, I think, OCFS2 does not support host based mirroring (so you cannot use mdadm or lvm to mirror the storage if you are using OCFS2).
    Redundancy is not required, but it is recommended if you are using hard disks because they are prone to failures.  You can configure RAID 10 across all disks in the array and present this as one big LUN to the database server.  If you have two storage arrays and you want to mirror the data across the two arrays, then present all of the devices as JBOD and use Linux mdadm to create your RAID group.
    RAC requires shared storage.  Maybe you have a NAS or SAN device, and you will present LUNs to the Oracle database servers.  That is no problem.  The problem is making those LUNs usable by Oracle RAC.  When I used Oracle 10g RAC, I used the Linux raw device facility to manage these LUNs and make them ready for Oracle RAC.  However, raw has been desupported.  Today I would use either ASM or OCFS2.  This has nothing to do with redundancy, this is just because you are using RAC.

  • Hi There! I have a question on Kernel Task-Threat. How can I clean my computer? This is the message --Warning: SUID file "System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/MacOS/ARDAg ent" has been modified and will not be repaired.

    Hi There! I have a question on Kernel Task-Threat. How can I clean my computer? This is the message that persists when cleaning disc--Warning: SUID file “System/Library/CoreServices/RemoteManagement/ARDAgent.app/Contents/MacOS/ARDAg ent” has been modified and will not be repaired.

    That's a routine message and it means nothing. Don't waste your time repairing permissions unless you know you have a problem that can be solved that way, which you probably never will.

  • Required "/" (root) file system size on UNIX for Solution Manager.

    Hello SAP Gurus,
       I am setting up SAP Solution Manager 3.2 on HP-UX. It is asking me about 350MB free sapce on "/" file system for Central Instance installation and about 120MB free sapce on "/" file system for Database Instance installation.
       I am installaing everything on to shared disk which mounted under /usr/sap. Why it needs free sapce in "/" file system. Is there any workaround to get rid of this requirement, as I have very less free sapce on "/" file system and I don't want to take the risks involved in increasing this size.
       Are there any SAP recommended sizes for "/" file system?
       I stuck in the middle of setting up SAP landscape on HP-UX (11.23). I searched through the Installation documents but I couldn't find any thing helpful in this regard. It is urgent requirement to set up this so please let me know any solution or workaround ASAP.
       Any help is greatly appriciated.
    Thanks in advance.
    Regards,
    cvr/

    Hi Vaibhav.
    Normally "canonical path not available for (folder name)" means:
    1. Wrong username/password. Please double check you credentials.
    2. The resource cannot be linked from the portal server. Please be sure that you can connect to the next ports in windows server from the Unix Server:
    a. NetBIOS Session Service TCP 139 This port is used to connect file shares for example.
    b. TCP 445 The SMB (Server Message Block) protocol is used among other things for file sharing in Windows NT/2000/XP. In windows NT it ran on top of NetBT (NetBIOS over TCP/IP), which used the famous ports 137, 138 (UDP) and 139 (TCP). In Windows 2000/XP/2003, Microsoft added the possibility to run SMB directly over TCP/IP, without the extra layer of NetBT. For this they use TCP port 445.
    I hope these things help somebody.
    Best Regards,
    Jheison A. Urzola H.

  • Need utilities class for application server file system (i.e. unix etc)

    I need to do things to directories and files on the application server.
    Is there an SAP class with methods for the application server file system (i.e. unix or whatever) with functionality similiar to what is provided by the methods of CL_GUI_FRONTEND_SERVICES for the presentation server?
    Is there a group of SAP functions for this task?

    You may have a look at Thomas Jung article: [sdn contribution : ABAP Server Side File Access, by Thomas Jung|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/7a13f367-0401-0010-47ba-eab0b15cf31c]
    Moreover, in release 7.10, it could be possible that SAP introduced input and output stream classes (to mimic java classes), so I guess there could be the ones for application server file system.

  • Essbase unix file system best practice

    Is there such thing in essbase as storing files in different file system to avoid i/o contention? Like for example in Oracle, it is best practice to store index files and data files indifferent location to avoid i/o contention. If everything in essbase server is stored under one file directory structure as it is now, then the unix team is afraid that there may run into performance issue. Can you please share your thought?
    Thanks

    In an environment with many users (200+) or those with planning apps where users can run large long-running rules I would recommend you separate the application on separate volume groups if possible, each volume group having multiple spindles available.
    The alternative to planning for load up front would be to analyze the load during peak times -- although I've had mixed results in getting the server/disk SME's to assist in these kind of efforts.
    Some more advanced things to worry about is on journaling filesystems where they share a common cache for all disks within a VG.
    Regards,
    -John

  • IPod formatted to UNIX File System (UFS)

    Hello all, I had an old 15G iPod (the generation with the 4 button above the wheel) and I decided to reformat it and use it as a firewire drive, it's not used for music anymore. Anyway, I was about half way through the format and I noticed I had accidently sellected UNIX File System (UFS) instead of Mac OS Extended. Well I let lt finish and thought I'd just reformat it again to Mac OS Extended, only now the iPods not even being recognized by OSX? I looked in Disk Utility and nothing there either. iPod restore does nothing either, just says connect an iPod. There's an Apple on the screen and that's it? What gives? Will I be able to get this thing running again?

    Thanks but no thanks! I got it going using info at this link:
    http://ipodlinux.org/Installation
    Got it in Disk Mode!!!

  • OEL file system questions - XFS and encrypted file system

    Does anyone know if Oracle Enterprise Linux 64 bit can support / install the XFS file type ?
    Different question.
    Does anyone know if Oracle Enterprise Linux 64 bit can encrypt the whole file system?
    Steve

    Oracle Enterprise Linux (OEL), which is based on RHEL source, does not contain everything you need to create an XFS filesystem.
    Sergio

  • Open API App (Windows based) fails to open FMB on Unix file system

    My Open API, Windows based app, can successfully open and 'get' properties of FMBs stored in the Windows file system. However, it fails to load the FMB when the FMB resides on a networked Unix server. The same FMBs on Unix can be opened by the Windows based FormBuilder (over the network). I can copy the FMB down to Windows and without re-compiling the FMB, my Open API app can 'load' the FMB and 'get' all the properties. What suggestions can you give for debugging / resolving this? I need to be able to 'Load' the FMBs (through the Open API), that reside in the Unix file system, from Windows.
    JJ

    Generally, this is why we will tell you that accessing net shares is not supported and in places where it might even be supported, we would still suggest that it is not recommended. Accessing via net shares (especially through Windows) is often problematic. There are various performance and connectivity issues that, unfortunately fool you into believing that the product you are using is flawed when the problem is really a connection issue with the share.
    In your case, because you are not exactly using an Oracle product (initially), Oracle can't offer much anyway, but I would recommend against using shares whenever possible. If you need to access a file, copy it locally first, perform whatever task on it, then return the updated file to its origin. This method protects you from things like net failure and instability as well as the performance issues associated with accessing files remotely.

  • Download PDF spool to unix file system

    Does anyone know how to programatically download a PDF document spool to the unix file system?
    I am trying to find a method to send PDF documents that have gone to spool to a unix file system. If anyone had any ideas on how to do this, please let me know.
    Thanks.

    Hi,
    For this define a logical file while using transaction FILE.
    In your code you will get the complete path of the file while using FM FILE_GET_NAME.
    Then download your PDF while using instruction
    OPEN DATASET...
    TRANSFERT ...
    Hope this help you .
    Best regards

  • UNIX File System?

    I was able in the past to format a disk with UNIX File System and read and write to it using Disk Utility in OS X Tiger. Now, my new Leopard machine does not show that option. What happened to that? How do I get it back?
    Thanks,
    John

    I'm pretty sure UFS support is totally gonzo in leopard. you certainly [can not install Leopard|http://docs.info.apple.com/article.html?artnum=306516] on UFS formatted drives.

  • Shared file system and other questions

    Hi,
              Is shared file system common for all WL in the cluster or each WL has its
              own one.
              Next questin is connected with proxy server.
              I'm not sure if there should be one proxy server for two servers working in
              one cluster or each server should has own proxy server (I mean WL proxy
              server).???
              In my opinion there should be one proxy server which redirect requests to
              server in cluster using some balancing method. But when I read documentation
              about cluster's architectures I saw the picture where each WL cluster server
              had proxy own server. I'm not sure if this picture showed only outline of
              architecture or it was real solution???
              Is it better to install another proxy server (for example Apache) than WL
              proxy server?
              In previous questions I asked if it is possible to replic static classes,
              fields etc. Prasad Peddada told that it is not replicated. But I wonder if
              there exists some method to force replicating it.? Maybe we can implement
              some method and run it?
              Thanks,
              Best regards,
              Robert
              

    Mike.
              In WLS51 cluster, it is better to specify different workingDir for each
              server. You can create a weblogic.properties in your per-server directory
              and add jspc properties in that file.
              Cheers - Wei
              "Mike Reiche" <[email protected]> wrote in message
              news:[email protected]...
              >
              > If you share directories between instances -
              > what happens when two WL instances decide to compile
              > the same JSP at the same time?
              >
              > Mike
              >
              >
              > Viresh Garg <[email protected]> wrote:
              > >
              > >
              > >
              > >
              > >"Robert Zaczyñski" wrote:
              > >
              > >> Hi,
              > >> Is shared file system common for all WL in
              > >the cluster or each WL has its
              > >> own one.
              > >
              > >I am not sure I understand your question. We
              > >recommend using shared file system
              > >for ease of maintanence and to get rid of pain
              > >for versioning problems for
              > >application code. It is not a requirement of
              > >WLS cluster. I really don't
              > >understand what you mean by
              > >"Is shared file system common for all WL in
              > >the cluster or each WL has its
              > >own one
              > >"
              > >
              > >>
              > >>
              > >> Next questin is connected with proxy server.
              > >> I'm not sure if there should be one proxy
              > >server for two servers working in
              > >> one cluster or each server should has own
              > >proxy server (I mean WL proxy
              > >> server).???
              > >> In my opinion there should be one proxy server
              > >which redirect requests to
              > >> server in cluster using some balancing method.
              > >But when I read documentation
              > >> about cluster's architectures I saw the picture
              > >where each WL cluster server
              > >> had proxy own server. I'm not sure if this
              > >picture showed only outline of
              > >> architecture or it was real solution???
              > >
              > >One or more proxy servers can be used. One is
              > >just fine, however you **might**
              > >want to use multiple proxies for heavily loaded
              > >application to avoid contention.
              > >All proxy servers will load balance between
              > >all servers in clsuter. a proxy
              > >servers is not attached or bound to an instance
              > >in cluster.
              > >
              > >>
              > >>
              > >> Is it better to install another proxy server
              > >(for example Apache) than WL
              > >> proxy server?
              > >>
              > >> In previous questions I asked if it is possible
              > >to replic static classes,
              > >> fields etc. Prasad Peddada told that it is
              > >not replicated. But I wonder if
              > >> there exists some method to force replicating
              > >it.? Maybe we can implement
              > >> some method and run it?
              > >
              > >I would recommend that for static classes, you
              > >use context parameters of web
              > >application or something similar, why do you
              > >need to replicate them. WHy not
              > >each cluster instance have a local copy and
              > >use their own copy for such
              > >classes/fields?
              > >
              > >>
              > >>
              > >> Thanks,
              > >> Best regards,
              > >> Robert
              > >
              > >Viresh Garg
              > >Principal Developer Relations Engineer
              > >BEA Systems
              > >
              > >
              > >
              > ><!doctype html public "-//w3c//dtd html 4.0
              > >transitional//en">
              > ><html>
              > >
              > ><p>"Robert Zaczyñski" wrote:
              > ><blockquote TYPE=CITE>Hi,
              > ><br>Is shared file system common for all WL
              > >in the cluster or each WL has
              > >its
              > ><br>own one.</blockquote>
              > >
              > ><p><br>I am not sure I understand your question.
              > >We recommend using shared
              > >file system for ease of maintanence and to get
              > >rid of pain for versioning
              > >problems for application code. It is not a requirement
              > >of WLS cluster.
              > >I really don't understand what you mean by
              > ><br>"<i>Is shared file system common for all
              > >WL in the cluster or each
              > >WL has its</i>
              > ><br><i>own one</i>
              > ><br>"
              > ><blockquote TYPE=CITE>
              > ><p>Next questin is connected with proxy server.
              > ><br>I'm not sure if there should be one proxy
              > >server for two servers working
              > >in
              > ><br>one cluster or each server should has own
              > >proxy server (I mean WL proxy
              > ><br>server).???
              > ><br>In my opinion there should be one proxy
              > >server which redirect requests
              > >to
              > ><br>server in cluster using some balancing method.
              > >But when I read documentation
              > ><br>about cluster's architectures I saw the
              > >picture where each WL cluster
              > >server
              > ><br>had proxy own server. I'm not sure if this
              > >picture showed only outline
              > >of
              > ><br>architecture or it was real solution???</blockquote>
              > >
              > ><p><br>One or more proxy servers can be used.
              > >One is just fine, however
              > >you **might** want to use multiple proxies for
              > >heavily loaded application
              > >to avoid contention. All proxy servers will
              > >load balance between all servers
              > >in clsuter. a proxy servers is not attached
              > >or bound to an instance in
              > >cluster.
              > ><blockquote TYPE=CITE>
              > ><p>Is it better to install another proxy server
              > >(for example Apache) than
              > >WL
              > ><br>proxy server?
              > ><p>In previous questions I asked if it is possible
              > >to replic static classes,
              > ><br>fields etc. Prasad Peddada told that it
              > >is not replicated. But I wonder
              > >if
              > ><br>there exists some method to force replicating
              > >it.? Maybe we can implement
              > ><br>some method and run it?</blockquote>
              > >
              > ><p><br>I would recommend that for static classes,
              > >you use context parameters
              > >of web application or something similar, why
              > >do you need to replicate them.
              > >WHy not each cluster instance have a local copy
              > >and use their own copy
              > >for such classes/fields?
              > ><blockquote TYPE=CITE>
              > ><p>Thanks,
              > ><br>Best regards,
              > ><br>Robert</blockquote>
              > >
              > ><p>Viresh Garg
              > ><br>Principal Developer Relations Engineer
              > ><br>BEA Systems
              > ><br> </html>
              > >
              > >
              >
              

Maybe you are looking for