File system vs database

Can anyone tell me if there are any whitepapers that breakdown when you store a document in a filesystem vs a database? We have a need to store up to millions of documents and search them (just like a search engine) I am hesitate to put that load on a db. Is ifs a better answer?
null

Mike,
I don't have any numbers which I can give you only guidelines. What type of search are you doing are you doing content search or attribute search?
If doing attribute search it will depend on different parameters such as platform, number of files/folders, and depth of your tree.
If doing content search the database will be the best way to search.
For content search I would ask the question in the Intermedia forum as Oracle Internet File System are using the Intermedia option which is part of the database.
Hope this helps

Similar Messages

Procedure to Insert PDF from FIle System to Database

Hi ,
I have a requirement to put the pdf files from our Local Machine or File system into Database table ..
For that I have created a directory called "MY_PDF" with create and replace directory .
Also , I have created a database table to store the files from Local machine FIle System directory ( MY_PDF) .
I have created a procedure which takes 2 inputs ( ID and FIlename ) as parameters , this procedure when executes , it insert the file along with the ID in the database table .
Procedure is as follows :
CREATE OR REPLACE PROCEDURE proc_load_a_file( p_id IN NUMBER, p_filename IN VARCHAR2 )
AS
l_blob BLOB;
l_bfile BFILE;
x VARCHAR2(1000);
BEGIN
x:=p_filename;
INSERT INTO demo(id,theblob,filename) VALUES ( p_id, empty_blob() ,x)
RETURNING theBlob INTO l_blob;
UPDATE demo
SET locater =l_blob where id=p_id;
l_bfile := bfilename( 'MY_FILES', p_filename );
DBMS_LOB.FILEOPEN( l_bfile );
DBMS_LOB.LOADFROMFILE( l_blob, l_bfile,
DBMS_LOB.getlength( l_bfile ) );
DBMS_LOB.fileclose( l_bfile );
COMMIT;
END;
Now , my requirement is not to insert one one file each and every time when I execute the procedure .
My requirement is first to check the File system Directory (MY_PDF) . If
there is any pdf file in the directory then it will call that procedure and insert that file into the database untill no files found in the dorectory ( MY_PDF) .
I am not getting the idea how to do this ..
Please someone provide some valueable inputs .. so that I can finish it up .
Thanks
Prashant Dwivedi

Suggest using the FlowElement.setStyle method to attach additional information about the image to the InlineGraphicElement that gets created. Looking at the example code in the posted link you'll need to pass that data to the imageLoadComplete method. The InlineGraphicElement can be found by saving interactionManager.absoluteStart before the graphic is inserted and then calling textFlow.findLeaf(savedAbsoluteStart).
Hope that helps,
Richard

Note on applying patches to the file system and database

Dear all,
I am new to Oracle E-business suite. Anyone in the house that can give a note (either a step by step or oracle metalink note) on how to apply patches to a file system or database.
Kind Regards.

Hi,
Steps to apply an application patch:
- Stop all application services (keep the database and the database listener up and running)
- Download the patch from Metalink
- Copy the patch file to any directory (i.e. /u04/patches)
- As 'applmgr' do the following:
- Source the environment file
- $ cd /u04/patches
- Type 'unzip <patch_number>.zip'
- cd <patch_number>
- Type 'adpatch'
- When it prompts you to enter the patch driver, type 'u<patch_number>.drv'
Apply the patch on the database tier first then on the application tier.
Do not forget to 'Enable Maintenance Mode' from adadmin before applying the patch. Once you apply the patch successfully, 'Disable Maintenance Mode' from adadmin.
And, always follow the steps in the patch README file.
For database patches, follow the steps in the patch README file and apply the patch using opatch as oracle user.
For more details about applying patches, please refer to:
"Oracle Applications Maintenance Utilities" manual
http://download-uk.oracle.com/docs/cd/B25516_14/current/html/docset.html
How to apply EBS 12i pathces in both Linux and Windows
Re: How to apply EBS 12i pathces in both Linux and Windows
Need to apply patch!
Need to apply patch!
Regards,
Hussein

File System or Database

Hi, I'm new to KM and was posed a question about a situtation I'm not familiar with.
We are going live in BI and all of our users will be saving BI Links (also known as KM Bookmarks) to our Portal Favorites which are store in KM. With so many people possibly saving BI Links to our Portal Favorites in KM should the file system be a database or a filesystem? We have about 3000 people going live that may save BI Links. I am assuming only about half or so would use the functionality.
Can anyone add some insight to this situation?

Hi Kenneth,
I always prefer database repositories unless having a real good reason for file system reps.
The main cause is the easy way of doing backups. Just backup the database and all your meta data and your content is consistently saved.
I do not think that you will face performance issues with an amount of 3000 users storing - lets say - 10 bookmarks each.
A bookmark is just a reference - not containing too much data.
HTH,
Carsten

How to save a file into file system from database?

Hi!
I am using AppEx 2.2.1.I have created a report showing the filename and id of a table. The table has a blob column containing the file.I want to hyperlink filename, so that I can go ahead and save it into my file system. But I don't know what to give in the URL field of the filename column attributes. How to get the file id of a file already in the database to link it and use? Any ideas please.
Regards,
Deepa.

This is a reference for the file download:
http://download-uk.oracle.com/docs/cd/B31036_01/doc/appdev.22/b28839/up_dn_files.htm#CJAHDJDA
I have a demo page showing this as well:
http://htmldb.oracle.com/pls/otn/f?p=31517:15
Denes Kubicek

Database storage vs. File system

Hi,
We'll be setting up a new Oracle UCM 10g* environment in a production scenario - we have access to high-speed SAN for file storage, but we can also use an Oracle 11g database for file storage (using the File Store Provider) - the database's tablespace files will anyway be stored on the SAN. We're not quite sure which way to go - assuming we have complete ha/dr for both SAN and database solutions, which way is the best?
I'm also aware that if we don't select the webless option we'll anyway need a similar amount of storage on the file-system as the weblayout will contain a copy (or a web-rendition) of the checked in file - we could create a webless ucm, with inbound refinery only creating files in weblayout.
Any input on the matter would be appreciated.
*11g not chosen due to WebLogic licencing requirements for our client - anyone know if 11g will ever be released standalone?
EDIT - re: 11g licensing - sorry about that i misunderstood the licensing issue of our client.
Edited by: Etienne Azzopardi on 04-Feb-2011 13:44

Sorry, but I will start my reaction from the last point:
*11g not chosen due to WebLogic licencing requirements for our client - anyone know if 11g will ever be released standalone?What do you mean? UCM license contains a restricted license of Weblogic EE for the purpose of hosting UCM. In other words, WLS is there for free (only it cannot host anything else). 11g will never be standalone - it will only support other application servers, namely, Websphere and JBoss (it follows the logic for other non-Oracle middleware products).
File system vs. database - there's been a couple of posts on this topic.
In a nutshell:
- with regard to the speed: unless you have really a lot of items (millions a month at least, maybe even millions a day), file system will be slightly faster or equal
- in Oracle DB 11.2 or higher you can use SecureFiles, which can effectively work with unstructured content. It can squeeze the disk space needed for storage, speed up operations (checkins, but also e.g. backups)
- with DB you will effectively have one system to manage - well, UCM still requires file system (shared storage for clusters), because some operations like conversions cannot run on the content in the database
- DB gives you further options like partitioning, hierarchical storage management, advanced security, etc. Your SAN storage can have some of these too.

Difference between ASM Disk Group, ADVM Volume and ACFS File system

Q1. What is the difference between an ASM Disk Group and an ADVM Volume ?
To my mind, an ASM Disk Group is effectively a logical volume for Database files ( including FRA files ).
11gR2 seems to have introduced the concepts of ADVM volumes and ACFS File Systems.
An 11gR2 ASM Disk Group can contain :
ASM Disks
ADVM volumes
ACFS file systems
Q2. ADVM volumes appear to be dynamic volumes.
However is this therefore not effectively layering a logical volume ( the ADVM volume ) beneath an ASM Disk Group ( conceptually a logical volume as well ) ?
Worse still if you have left ASM Disk Group Redundancy to the hardware RAID / SAN level ( as Oracle recommend ), you could effectively have 3 layers of logical disk ? ( ASM on top of ADVM on top of RAID/SAN ) ?
Q3. if it is 2 layers of logical disk ( i.e. ASM on top of ADVM ), what makes this better than 2 layers using a 3rd party volume manager ( eg ASM on top of 3rd party LVM ) - something Oracle encourages against ?
Q4. ACFS File systems, seem to be clustered file systems for non database files including ORACLE_HOMEs, application exe's etc ( but NOT GRID_HOME, OS root, OCR's or Voting disks )
Can you create / modify ACFS file systems using ASM.
The oracle toplogy diagram for ASM in the 11gR2 ASM Admin guide, shows ACFS as part of ASM. I am not sure from this if ACFS is part of ASM or ASM sits on top of ACFS ?
Q5. Connected to Q4. there seems to be a number of different ways, ACFS file systems can be created ? Which of the below are valid methods ?
through ASM ?
through native OS file system creation ?
through OEM ?
through acfsutil ?
my head is exploding
Any help and clarification greatly appreciated
Jim

Q1 - ADVM volume is a type of special file created in the ASM DG. Once created, it creates a block device on the OS itself that can be used just like any other block device. http://docs.oracle.com/cd/E16655_01/server.121/e17612/asmfilesystem.htm#OSTMG30000
Q2 - the asm disk group is a disk group, not really a logical volume. It combines attributes of both when used for database purposes, as the database and certain other applications know how to talk "ASM" protocol. However, you won't find any general purpose applications that can do so. In addition, some customers prefer to deal directly with file systems and volume devices, which ADVM is made to do. In your way of thinking, you could have 3 layers of logical disk, but each of them provides different attributes and characteristics. This is not a bad thing though, as each has a slightly different focus - os file system\device, database specific, and storage centric.
Q3 - ADVM is specifically developed to extend the characteristics of ASM for use by general OS applications. It understands the database performance characteristics and is tuned to work well in that situation. Because it is developed in house, it takes advantage of the ASM design model. Additionally, rather than having to contact multiple vendors for support, your support is limited to calling Oracle, a one-stop shop.
Q4 - You can create and modify ACFS file systems using command line tools and ASMCA. Creating and modifying logical volumes happens through SQL(ASM), asmcmd, and ASMCA. EM can also be used for both items. ACFS sits on top of ADVM, which is a file in an ASM disk group. ACFS is aware of the characteristics of ASM\ADVM volumes, and tunes it's IO to make best use of those characteristics.
Q5 - several ways:
1) Connect to ASM with SQL, use 'alter diskgroup add volume' as Mihael points out. This creates an ADVM volume. Then, format the volume using 'mkfs' (*nix) or acfsformat (windows).
2) Use ASMCA - A gui to create a volume and format a file system. Probably the easiest if your head is exploding.
3) Use 'asmcmd' to create a volume, and 'mkfs' to format the ACFS file system.
Here is information on ASMCA, with examples:
http://docs.oracle.com/cd/E16655_01/server.121/e17612/asmca_acfs.htm#OSTMG94348
Information on command line tools, with examples:
Basic Steps to Manage Oracle ACFS Systems

Required "/" (root) file system size on UNIX for Solution Manager.

Hello SAP Gurus,
   I am setting up SAP Solution Manager 3.2 on HP-UX. It is asking me about 350MB free sapce on "/" file system for Central Instance installation and about 120MB free sapce on "/" file system for Database Instance installation.
   I am installaing everything on to shared disk which mounted under /usr/sap. Why it needs free sapce in "/" file system. Is there any workaround to get rid of this requirement, as I have very less free sapce on "/" file system and I don't want to take the risks involved in increasing this size.
   Are there any SAP recommended sizes for "/" file system?
   I stuck in the middle of setting up SAP landscape on HP-UX (11.23). I searched through the Installation documents but I couldn't find any thing helpful in this regard. It is urgent requirement to set up this so please let me know any solution or workaround ASAP.
   Any help is greatly appriciated.
Thanks in advance.
Regards,
cvr/

Hi Vaibhav.
Normally "canonical path not available for (folder name)" means:
1. Wrong username/password. Please double check you credentials.
2. The resource cannot be linked from the portal server. Please be sure that you can connect to the next ports in windows server from the Unix Server:
a. NetBIOS Session Service TCP 139 This port is used to connect file shares for example.
b. TCP 445 The SMB (Server Message Block) protocol is used among other things for file sharing in Windows NT/2000/XP. In windows NT it ran on top of NetBT (NetBIOS over TCP/IP), which used the famous ports 137, 138 (UDP) and 139 (TCP). In Windows 2000/XP/2003, Microsoft added the possibility to run SMB directly over TCP/IP, without the extra layer of NetBT. For this they use TCP port 445.
I hope these things help somebody.
Best Regards,
Jheison A. Urzola H.

UCM: file system or data base?

In our company (insurance industry) we will soon implement a Content Management solution, but until now, unfortunately in our country not much experience with this technology and I would like to know from the point of view of scalability, security, performance and high availability, what is storage recommendation UCM's : file system or database?

Take a look at this thread: Re: Database storage vs. File system
It has quite some useful info for you on this point.

Credential map file system location

Hello Every one,
Could you please tell me where UCM 11g credential maps are located? in File system or Database .
If it is file system, please let me know the location of the credential map.
What is the standard way to migrate credential map from one instance other instance (CMU doesn't have any option to make a bundle of credential map).
Thank you in advance

Hi,
Navigate to <domain_home>/ucm/cs/data/users/connections and here the following file is present :
ConnectionsSecurityData.hda
This holds all the details for Credential Maps .
It would be easier to put this file to the target server location and use it there.
Hoe this helps .
Thanks,
Srinath

Separating file system

Hi,
We are using 12.0.6, and in our environment we have both application file system and database+RDBMS file system under same mount point (/u01)
cd /u01
applprod oraprod
applprod contanis apps and inst directories
oraprod contains db directory
Now we have created two more file system on the server (sanapp and sandb)
we want to move applprod from /u01 to sanapp and oraprod to /sandb
Please suggest how to do it
Regards

Hi;
I belive easy way is
1. Run preclone on db and apps tier
2. Start postclone
3. Give new path during clone process
Regard
Helios

What is the best way to copy aperture library on to external hard drive? I am getting a message that say's "There was an error opening the database. The library could not be opened because the file system of the library's volume is unsupported".

What is the best way to copy aperture library on to external hard drive? I am getting a message that say's "There was an error opening the database. The library could not be opened because the file system of the library's volume is unsupported". What does that mean? I am trying to drag libraries (with metadata) to external HD...wondering what the best way to do that is?

Kirby Krieger wrote:
Hi Shane. Not much in the way of thoughts - - but fwiw:
How is the drive attached?
Can you open large files on the drive with other programs?
Are you running any drive compression or acceleration programs (some drives arrive with these installed)?
Can you reformat the drive and try again?
Hi Kirby,
I attached the UltraMax Plus with a USB cable. The UltraMax powers the cable so power is not an issue. I can open other files. Also, there is 500GB of files on the drive so I cannot re-format it. Although, I noted I could import the entire Aperture Library. However, I do not want to create a duplicate on my machine because that would be defeating the purpose of the external drive.
Thanks,
Shane

Uploaded Files stored in Oracle 10G database or in Unix File system

Hey All,
I am trying to understand best practices on storing uploaded files. Should you store within the database itself (this is the current method we are using by leveraging BLOB storage) or use a BFILE locator to use the files system storage (we have our DB's on UNIX) . . .or is there another method I should be entertaining? I have read arguments on both sides of this question. I wanted to see what answers forum readers could provide!! I understand there are quite a few factors but the situation I am in is as follows:
1) Storing text and pdf documents.
2) File sizes range from a few Kb to up to 15MB in size
3) uploaded files can be deleted and updated / replaced quite frequently
Right now we have an Oracle stored procedure that is uploading the files binary data into a BLOB column on our table. We have no real "performance" problems with this method but are entertaining the idea of using the UNIX file system for storage instead of the database.
Thanks for the insight!!
Anthony Roeder

Anthony,
First word you must learn here in this forum is RESPECT.
If you require any further explanation, just say so.
BLOB compared with BFILE
Security:
BFILEs are inherently insecure, as insecure as your operating system (OS).
Features:
BFILEs are not writable from typical database APIs whereas BLOBs are.
One of the most important features is that BLOBs can participate in transactions and are recoverable. Not so for BFILEs.
Performance:
Roughly the same.
Upping the size of your buffer cache can make a BIG improvement in BLOB performance.
BLOBs can be configured to exist in Oracle's cache which should make repeated/multiple reads faster.
Piece wise/non-sequential access of a BLOB is known to be faster than a that of a BFILE.
Manageability:
Only the BFILE locator is stored in an Oracle BACKUP. One needs to do a separate backup to save the OS file that the BFILE locator points to. The BLOB data is backed up along with the rest of the database data.
Storage:
The amount of table space required to store file data in a BLOB will be larger than that of the file itself due to LOB index which is the reason for better BLOB performance for piece wise random access of the BLOB value.

10G Database install on Linux 64bit File system Vs. Automatic Storage

Hi,
I'm installing Oracle 10G on a Dell 2950 server with an Intel 64 bit processor. The operating system is Red Hat Linux 4. It has a hardware RAID.
I've downloaded the Install Guide but I have a question about installing.
I'm confused about the File system vs. Automatic Storage management option. I will be installing on the local system, I will not be using a NAS or SAN.
Under Database Storage Options, the guide says that "Oracle recommends that the file system you choose be separate from the file systems used by the operating system or the Oracle software.".
1. Do I need to do that since I'm already using hardware RAID??
2. Which way is recommended / what do most people do: File system or Automatic Storage managment??
3. For Automatic Storage Management I read that I'd have to create an ASM Disk group that can consist of "a multiple disk device such as a RAID storage array or logical volume. However, in most cases disk groups consist of one or more individual physical disks". Do I need to reconfigure my partitions ??
I just need some input on what I should do since this is my first time installing Oracle on Linux.
Thank you.

Besides documentation there's a step-by-step guide :
http://www.oracle.com/technology/pub/articles/smiley_10gdb_install.html#asm
Many questions should be answered here.
Werner

STORE A COMPLETE FILE SYSTEM IN THE DATABASE 11GR2

Hi everyone
I have the following issue:
I tried to store in an oracle database TABLE the completre file structure
of a file system that includes the follwing:
-Name of the file
-Date of last modification
-Location
-The entire content of the phisical file BLOB datatype
I have the following piece of code to archieve this, but i still have a
problem...
When i tried to add the records to the database by implememting all
the connecttions stuffs, oracle and java classes required the program
inserts a FEW RECORDS and after that:
¡¡¡hangs up!!!.
The main problem is that i cant release the connection and get another new when i using
JDBC POOL so the server full their available connections.
Please tell me what is the best approach or programming practice on order to
meet this goal.
Thanks from Colombia - Latin America..
HERE IS THE CODE:
import java.io.* ;
* A simple class to demonstrate a recursive directory traversal
* in Java.
* Error handling was left out to make the code easier to understand.
* In production code, you should check if the arguments from the
* command line are really file files or directories.
public class RecursiveTraversal
* Works on a single file system entry and
* calls itself recursively if it turns out
* to be a directory.
* @param file A file or a directory to process
public void traverse( File file )
// Print the name of the entry
//System.out.println( file ) ;
// Check if it is a directory
if( file.isDirectory() )
// Get a list of all the entries in the directory
String entries[] = file.list() ;
// Ensure that the list is not null
if( entries != null )
// Loop over all the entries
for( String entry : entries )
// Recursive call to traverse
traverse( new File(file,entry) ) ;
else
if(file.isFile())
System.out.println( file.getParent() ) ;
System.out.println( file.getName() ) ;
else
System.out.println("*** WRONG VALUE ***");
* The program starts here.
* @param args The arguments from the command line
public static void main( String args[] )
// Create an object of this class
RecursiveTraversal rt = new RecursiveTraversal() ;
if( args.length == 0 )
// If there are no arguments, traverse the current directory
rt.traverse( new File(".") ) ;
else
// Else process every argument sequentially
for( String arg : args )
rt.traverse( new File(arg) ) ;
}

Thanks for the reply, the implementation that you refer is useful for another type of application i need to stored the file system in a TABLE of a database
in order to make a part of an information system integration and can use SQL statements to acomplish this.
I follow the recomendation and post it in the SQL/JDBC forum because when i try to release de active connection i can't acomplish this.
And i need to know how to use JDBC connection poolling to open a connection just once, release and use it again.

File system vs database

Similar Messages

Maybe you are looking for