Local persistent caching file system or RDBMS?

Hello,
I have a need to cache Oracle blob data locally on disk on the client machine. I am running a plain vanilla java app which connects to Oracle using Type 4 JDBC connectivity.
My problem , what should i use to cache data ? FileSystem or RDBMS? currently i see about 3 blob columns from the same table on server which need to be locally cached. Using a file system caching mechanism developing an file heirarchy strategy is simple enough and i do have the advantage of not increasing complexity on client application by not including a local RDBMS. But i got to do the plumbing for data retreival.
If i use a local RDBMS then i do understand that data reteival plumbing work is not my headache but i am not sure which lightweight Db would support KBs of column data. Any suggestions for lighweight dbs which are free and crossplatform would be useful
Also ar there any known patterns for local disk caching?
thank you
SAmeer

Look into http://hsqldb.org/. you can actually bundle it up with your app as a jar and run the db inprocess. or you can deploy it as a separate component on your desktop (or whatever it is you are deploying it on)

Similar Messages

Can a BIP report be deliveredto local or network file system

We have OBIEE 10.1.3.4 installed on Linux Redhat 5.2. We have some reports on BI Publisher and want to save the report to a local or network file system. Not sure if it is possible as save to file system is no list as an option in BIP Admin Delivery list.
Please help!

Thank you for help. But is it a way to save the whole report to one file instead split it according to a key.
One way I can think of is to create a dummy key of a single value. Is there a BIP built-in way doing this?

Store documents in local machine of file system not in sap dms

Hi,
Can i store documents in local machine not in sap Database . Client will not use content server for storing document.
so how to store document in local file system n how to configure ?
please help.
Dipak.

Hello Sir,
When I try to check in in storage as 'VAULT' it send error 'Attempt to set up connection to failed'
attaching screen shot of error
I customize in DC20 for Vault:
For: "Define data carrier type "vault""
Data carr. type = ZD
For: "Define vault"
Data carr.name = ZDC_TEST
Data carr. type= ZD
Desprition = Test
Vault path = \\10.181.210.10\_SAP Practice\SAP DMS\DMS_Data_carrier -> this is the network path.
For: "Define data carrier type "server, front end"
Type (data carr. type) = DC
Description = Frontend test
Path = c:\temp\
For: "Define mount ponts/logical drive"
Data carr. = Default/ZDC
Prefix for access path = c:\temp\
Please tell me if have configured any wrong configuration or need to add any additional configuration
Thanks.
Dipak.

Cluster File system local to Global

I need to convert a local High available file system to a global file system. The client needs to share data within the cluster and the solution i offered him was this.
Please let me know if there is a better way to do this. The servers are running 2 failover resource NFS resource groups sharing file systems to clients. Currently the filesystems are configured as HAStoragePlus file systems.
Thanks

Tim, thanks much for your reply. I will doing this as a global file system. Currently, the HA file systems are shared out from only one node and I intend to keep it that way. The only difference is i will make the local HA file systems as global.
I was referring the sun cluster concepts guide which mentions
http://docs.sun.com/app/docs/doc/820-2554/cachcgee?l=en&a=view
"A cluster file system to be highly available, the underlying disk storage must be connected to more than one node. Therefore, a local file system (a file system that is stored on a node's local disk) that is made into a cluster file system is not highly available"
I assume i need to remove the file systems from hastp and make them as global? Please let me know if the understanding is correct...
Thanks again.

Procedure to Insert PDF from FIle System to Database

Hi ,
I have a requirement to put the pdf files from our Local Machine or File system into Database table ..
For that I have created a directory called "MY_PDF" with create and replace directory .
Also , I have created a database table to store the files from Local machine FIle System directory ( MY_PDF) .
I have created a procedure which takes 2 inputs ( ID and FIlename ) as parameters , this procedure when executes , it insert the file along with the ID in the database table .
Procedure is as follows :
CREATE OR REPLACE PROCEDURE proc_load_a_file( p_id IN NUMBER, p_filename IN VARCHAR2 )
AS
l_blob BLOB;
l_bfile BFILE;
x VARCHAR2(1000);
BEGIN
x:=p_filename;
INSERT INTO demo(id,theblob,filename) VALUES ( p_id, empty_blob() ,x)
RETURNING theBlob INTO l_blob;
UPDATE demo
SET locater =l_blob where id=p_id;
l_bfile := bfilename( 'MY_FILES', p_filename );
DBMS_LOB.FILEOPEN( l_bfile );
DBMS_LOB.LOADFROMFILE( l_blob, l_bfile,
DBMS_LOB.getlength( l_bfile ) );
DBMS_LOB.fileclose( l_bfile );
COMMIT;
END;
Now , my requirement is not to insert one one file each and every time when I execute the procedure .
My requirement is first to check the File system Directory (MY_PDF) . If
there is any pdf file in the directory then it will call that procedure and insert that file into the database untill no files found in the dorectory ( MY_PDF) .
I am not getting the idea how to do this ..
Please someone provide some valueable inputs .. so that I can finish it up .
Thanks
Prashant Dwivedi

Suggest using the FlowElement.setStyle method to attach additional information about the image to the InlineGraphicElement that gets created. Looking at the example code in the posted link you'll need to pass that data to the imageLoadComplete method. The InlineGraphicElement can be found by saving interactionManager.absoluteStart before the graphic is inserted and then calling textFlow.findLeaf(savedAbsoluteStart).
Hope that helps,
Richard

Flash Player 9, Director MX, LocalConnection and the file system sandbox

I have a Director MX asset to which I have no source-code
access. Previously I could use LocalConnection in a Flash Player 8
projector to interact with the Director app, local to the
file-system. I seem unable to do the same thing with a Flash Player
9 projector. The director asset looks for and loads the relevant
Flash projector and unloads itself when it is no longer present,
and this functionality continues without a problem. However, when I
use the LocalConnection.send method, the Flash player does not
receive the expected responses.
I know that this is a rather general and abstract question:
put simply, does anyone know whether Flash Player 9 and Director MX
can't talk to each other using LocalConnection?
ps to pre-empt over-enthusiastic respondees, yes I am aware
of other technologies such as AIR, Zinc etc, and no they're not a
viable option for my particular project.

Hi,
the following sourcecode is compiled with Flexbuilder 2 and
runs in flashplayer 9.0.115 as expected.
How do you trigger the effect?
best regards,
kcell
<?xml version="1.0" encoding="utf-8"?>
<mx:Application xmlns:mx="
http://www.adobe.com/2006/mxml"
layout="absolute">
<mx:Button label="run"
click="{wr1.play();}"></mx:Button>
<mx:Label id="l1" top="20" text="this is label"
visible="false"/>
<mx:Image id="img1" source="@Embed('k.jpg')" top="40"
visible="false"/>
<mx:WipeRight id="wr1" target="{img1}" duration="1000"
effectStart="img1.visible=true" effectEnd="{wr2.play();}"/>
<mx:WipeRight id="wr2" target="{l1}" duration="1000"
effectStart="l1.visible=true"/>
</mx:Application>

Why would anyone want to use ASM Clustered File system?

DB Version: 11gR2
OS : Solaris, AIX, HP-UX
I've read about the new feature ACFS.
http://www.oracle-base.com/articles/11g/ACFS_11gR2.php
But why would anyone want to store database binaries in a separate Filesystem created by Oracle?

Hi Vitamind,
how do these binaries interact with the CPU when they want something to be done?
ACFS should work with Local OS (Solaris) to communicate with the CPU . Isn't this kind of double work?ACFS dont work with .... but provide filesystem to Local S.O
There may be extra work, but that's because there are more resources that a common filesystem.
Oracle ACFS executes on operating system platforms as a native file system technology supporting native operating system file system application programming interfaces (APIs).
ACFS is a general purpose POSIX compliant cluster file system. Being POSIX compliant, all operating system utilities we use with ext3 and other file systems can also be used with Oracle ACFS given it belongs to the same family of related standards.
ACFS Driver Model
An Oracle ACFS file system is installed as a dynamically loadable vendor operating system (OS) file system driver and tool set that is developed for each supported operating system platform. The driver is implemented as a Virtual File System (VFS) and processes all file and directory operations directed to a specific file system.
It makes sense you use the ACFS if you use some of the features below:
• Oracle RAC / RAC ONE NODE
• Oracle ACFS Snapshots
• Oracle ASM Dynamic Volume Manager
• Cluster Filesystem for regular files
ACFS Use Cases
• Shared Oracle DB home
• Other “file system” data
• External tables, data loads, data extracts
• BFILES and other data customer chooses not to store in db
• Log files (consolidates access)
• Test environments
• Copy back a previous snapshot after testing
• Backups
• Snapshot file system for point-intime backups
• General purpose local or cluster file system
• Leverage ASM manageability
Note : Oracle ACFS file systems cannot be used for an Oracle base directory or an Oracle grid infrastructure home that contains the software for Oracle Clusterware, Oracle ASM, Oracle ACFS, and Oracle ADVM components.
Regards,
Levi Pereira

In WL Cluster JMS Persistent Storefiles on local file system.

Hi Gurus,
We have Weblogic cluster 10.3.4.1 (3 nodes) on Linux 5 which is setup for Oracle Services Bus. Cluster has 3 machines configured. Currently JMS Persistent Storefiles are on shared file system but we are having some issue with the shared file system and wanna move JMS Persistent Storefiles on the local filesystem instead of shared file system. Is it possible in Clustered WL env or not.
Thanks All.

The data will be uploaded to the server and a PHP program will read the data and use it. I've already implemented it using JSON. I had to install a JSON stringifer and a JSON parser in a subfolder of configuration/shared/common/scripts. It's working well.
Thanks
mitzy_kitty

Warming up File System Cache for BDB Performance

Hi,
We are using BDB DPL - JE package for our application.
With our current machine configuration, we have
1) 64 GB RAM
2) 40-50 GB -- Berkley DB Data Size
To warm up File System Cache, we cat the .jdb files to /dev/null (To minimize the disk access)
e.g
// Read all jdb files in the directory
p = Runtime.getRuntime().exec("cat " + dirPath + "*.jdb >/dev/null 2>&1");
Our application checks if new data is available every 15 minutes, If new Data is available then it clears all old reference and loads new data along with Cat *.jdb > /dev/null
I would like to know that if something like this can be done to improve the BDB Read performance, if not is there any better method to Warm Up File System Cache ?
Thanks,

We've done a lot of performance testing with how to best utilize memory to maximize BDB performance.
You'll get the best and most predictable performance by having everything in the DB cache. If the on-disk size of 40-50GB that you mention includes the default 50% utilization, then it should be able to fit. I probably wouldn't use a JVM larger than 56GB and a database cache percentage larger than 80%. But this depends a lot on the size of the keys and values in the database. The larger the keys and values, the closer the DB cache size will be to the on disk size. The preload option that Charles points out can pull everything into the cache to get to peak performance as soon as possible, but depending on your disk subsystem this still might take 30+ minutes.
If everything does not fit in the DB cache, then your best bet is to devote as much memory as possible to the file system cache. You'll still need a large enough database cache to store the internal nodes of the btree databases. For our application and a dataset of this size, this would mean a JVM of about 5GB and a database cache percentage around 50%.
I would also experiment with using CacheMode.EVICT_LN or even CacheMode.EVICT_BIN to reduce the presure on the garbage collector. If you have something in the file system cache, you'll get reasonably fast access to it (maybe 25-50% as fast as if it's in the database cache whereas pulling it from disk is 1-5% as fast), so unless you have very high locality between requests you might not want to put it into the database cache. What we found was that data was pulled in from disk, put into the DB cache, stayed there long enough to be promoted during GC to the old generation, and then it was evicted from the DB cache. This long-lived garbage put a lot of strain on the garbage collector, and led to very high stop-the-world GC times. If your application doesn't have latency requirements, then this might not matter as much to you. By setting the cache mode for a database to CacheMode.EVICT_LN, you effectively tell BDB to not to put the value or (leaf node = LN) into the cache.
Relying on the file system cache is more unpredictable unless you control everything else that happens on the system since it's easy for parts of the BDB database to get evicted. To keep this from happening, I would recommend reading the files more frequently than every 15 minutes. If the files are in the file system cache, then cat'ing them should be fast. (During one test we ran, "cat *.jdb > /dev/null" took 1 minute when the files were on disk, but only 8 seconds when they were in the file system cache.) And if the files are not all in the file system cache, then you want to get them there sooner rather than later. By the way, if you're using Linux, then you can use "echo 1 > /proc/sys/vm/drop_caches" to clear out the file system cache. This might come in handy during testing. Something else to watch out for with ZFS on Solaris is that sequentially reading a large file might not pull it into the file system cache. To prevent the cache from being polluted, it assumes that sequentially reading through a large file doesn't imply that you're going to do a lot of random reads in that file later, so "cat *.jdb > /dev/null" might not pull the files into the ZFS cache.
That sums up our experience with using the file system cache for BDB data, but I don't know how much of it will translate to your application.

Sharing the local file system on another machine

Version : 5.10
We have an HP Proliant machine and a SunFire V40 machine. Both installed with solaris 5.10 (x86 AMD).
In HP proliant machine we have filesystem with 600gb . We would like to mount this file system in the SunFire V40 machine . Is this possible? If yes, could you guys point me an URL where steps are mentioned to do this.

Hope this is how one determines Filesystem type (got this from googling)Nope. There are several ways to determine the filesystem currently being used:
$ mount | grep filesystem (where 'filesystem' is all or part of the mount point)
/etc/vfstab will normally tell you (so long as it's not zfs)
$ fstyp {mountpoint}
sun.com links i get by Googling are taking me Oracle documentation homepage !We moved from docs.sun.com to the Oracle Documentation site last week and not all links have been updated. It's work in progress at this time. The Solaris 10 documentation can be found here - http://download.oracle.com/docs/cd/E19253-01/index.html
And this is the link to the start of the NFS section - http://download.oracle.com/docs/cd/E19253-01/816-4555/rfsintro-2/index.html
I wouldn't worry too much about getting the systems to auto-mount at boot until you've tested it manually. I'll assume this is a UFS/VxFS filesystem (ZFS requires a slightly different approach). If everything works, you can use the dfstab on the server and the vfstab on the client to automatically share and mount the filesystem so it persists across reboots.
You'll need to do something like this as a test:
On the HP System (the NFS Server) you'll need to enable the NFS Server SMF Service:
server> $ svcadm enable svc:/network/nfs/server:default
On the client enable the NFS Client SMF Service:
client> $ svcadm enable svc:/network/nfs/client:default
Back on the NFS Server you now need to share out the /foobar filesystem:
server> $ share -F nfs -o rw /foobar
Check the share using dfshares or mount
server> $ dfshares
server> $ mount
On the client you can then mount the filesystem:
client> $ mount -F nfs -o rw nfsserver:/foobar /foobar2
The above is saying mount the exported /foobar filesystem residing on 'nfsserver' host to a local mountpoint of /foobar2 on this client.
As a test you can also use the Automounter by simply cd'ing to the exported filesystem:
client> $ cd /net/nfsserver/foobar
Hopefully after reading the documentation you should get a working setup.
Regards,
Steve

How to get access to the local file system when running with Web Start

I'm trying to create a JavaFX app that reads and writes image files to the local file system. Unfortunately, when I run it using the JNLP file that NetBeans generates, I get access permission errors when I try to create an Image object from a .png file.
Is there any way to make this work in Netbeans? I assume I need to sign the jar or something? I tried turning "Enable Web Start" on in the application settings, and "self-sign by generated key", but that made it so the app wouldn't launch at all using the JNLP file.

Same as usual as with any other web start app : sign the app or modify the policies of the local JRE. Better sign the app with a temp certificate.
As for the 2nd error (signed app does not launch), I have no idea as I haven't tried using JWS with FX 2.0 yet. Try to activate console and loggin in Java's control panel options (in W7, JWS logs are in c:\users\<userid>\appdata\LocalLow\Sun\Java\Deployment\log) and see if anything appear here.
Anyway JWS errors are notoriously not easy to figure out and the whole technology in itself is temperamental. Find the tool named JaNeLA on the web it will help you analyze syntax error in your JNLP (though it is not aware of the new syntax introduced for FX 2.0 and may produce lots of errors on those) and head to the JWS forum (Java Web Start & JNLP Andrew Thompson who dwells over there is the author of JaNeLA).

ATS files in cache hang system at startup

We have this inconsistent problem happening on all our Mac's (10.4.10). The problem does not happen each day or consecutive days. Here is what happens. Start the Mac in the morning. When it get's past the startup screen and then starts the load the desktop and finder etc. It just hangs. What you see is the spotlight icon in top right but the rest of the menu bar does not show up. None of the desktop icons appear either. If you move the mouse towards spotlight you see it is the spinning ball. What we do then is hard shutdown the Mac then restart in safe boot mode. Once the Mac is running clean out the files in caches for ATS in library, then ATS caches in system/library. Restart the Mac and everything is normal.
Some how this hang up is related to the ATS cache files but not sure how it hangs the system?
Anyone else have this problem? It is causing us a growing frustration some of our operators are leaving the computer running overnight as to not have to deal with the issue when they turn on the Mac.
Thanks
Steve

Well, if it is working now...
You could check to see what the version of the Finder is as it is not reported in the crash log. The application is here:
/System/Library/CoreServices/Finder; the version should be 10.6.7. If you suspect a problem caused by updating to 10.6.6, then I suggest downloading and installing the Combo update.
bd

Deliver a report in XML format and save it to local file system on the server

We have OBIEE 10.1.3.4 on Redhat linux. We want to have generate a report in XML format and saved it to the server's file system. Did not realize this is s difficult task. Basically
1) How to create a XML report? It is not listed in the output items of a layout template.
2) How to deliver XML the report to local file system. Look into the Delivery section of Admin page. FTP should be the best choice, but does that means that one need to install and run ftp server on the BI server box?
Thanks

Hi,
Since I still have problems on this subject, I would like to share on how it progresses.
Currently I have a problem of timeout in step "Truncate XML Schema" with the URL that I mentioned above.
The exact error is the following : 7000 : null : com.sunopsis.sql.l: Oracle Data Integrator TimeOut : connection with URL [...]
The connection test is still OK.
I tried to increase the value in the user's pref but there's no change.

How to connect SharePoint Document Library with Local file system?

Hi
I have a SharePoint Document library and in my local system i have 3TB files. It is very difficult to upload 3TB files in SharePoint.
I want a file details in SharePoint Document Library but physical file would be in local.
While click the file in Document library. The document should open from local.
Anyone help me on it.
Thanks & Regards
Poomani Sankaran

Hi,
your requirement doesn't work out-of-the-box as all data uploaded to SharePoint needs to be stored in SQL database. Thus in your case 3 TB of fileshare would need to move to SQL.
In case you don't want to go this way, there are 3rd party vendors who offer Software like AvePoint Connector. Products like these use SQL RBS (Storage Externalization API) so that files remain in your file system but metadata is kept in SharePoint. If you
need more information on that, please let me know.
Regards,
Dennis

Hyperlink to pdf on the local file system

Hello,
I'm using Oracle Reports 6i. I'm trying to set hyperlinks in my report through the pl/sql command srw.set_hyperlink to another pdf document.
When I set the hyperlink to a URL, eg, http://localhost/document.pdf#dest, it works fine, the pdf opens in IE to the destination. Now when I specify the link to a file on the local file system, eg, file:///c|/document.pdf#dest, I get a file not found within IE. If I take out the destination, it works ok, that is, it opens up the document with IE.
What am I doing wrong here? Is there a way to link a report to another pdf to a named destination within the local file system?
Thanks,
Ricky

Ricky,
This is more of IE - PDF issue I guess. Also this problem is seen more specifically for IE + File protocol + PDF
Nothing related to the Reports PDF here. You can try by just referring a PDF section through file protocal in IE and you would see the same behaviour
Thanks
Rajesh

Local persistent caching file system or RDBMS?

Similar Messages

Maybe you are looking for