LocalCache - pre-load config set to true
Hi,
I have set the <pre-load> to true for local cache configuration. My CacheStore implements 'IterableCacheLoader'. When I make a call to, ---
(call 1) . NamedCache cache = CacheFactory.getCache("cacheName");
'loadAll()' of CacheStore is invoked. 'loadAll()' returns Map which has required key-value pairs.How do I put this returned Map into NamedCache? The reason I am asking this is call1 is made in different package from CacheStore.
Does not loadAll() implicitly update the NamedCache?
The requirement is to preload the data and this standalone local cache.
To use the Google's browse by name feature as used in Firefox 3.6, set keyword.URL to this link:
[http://www.google.com/search?ie=UTF-8&oe=UTF-8&sourceid=navclient&gfns=1&q= http://www.google.com/search?ie=UTF-8&oe=UTF-8&sourceid=navclient&gfns=1&q=]
Similar Messages
-
CP8 - White/blank screen during pre-load when the pre-loader is set to below 100%
My Captivate 8 project contains an hour of audio. When my pre-loader is set to 100% the course takes about 2.5 minutes to load. To reduce load time, I have experimented with reducing the pre-loader below 100%. However, when the pre-loader is set to anything less than 100%, my course shows a white/blank screen after the preloader and before the audio begins to play. The white screen is shown for about 10-20 seconds. The white screen gives the impression that the course has not loaded properly. Does anyone have any suggestions?
I am trying to reproduce the issue at my end, I used an audio which is about an hour long and broke it slide-by-slide as you mentioned. But I don't see any white screen before or after changing the pre-loader percentage. I even tried setting it as low as 10% but still no blank screen. I doubt this can be specific to the audio file or may some other element in project is causing the issue. Is it possible for you to share the project so we can debug the issue? My email address is [email protected]
-
CP5 pre-loader questions re: video
Forgive the long post..
I published a Cap 5 project in which the first 4 slides contain short videos. The pre-loader is set to 70%. When playing the course from a server or LMS the initial load ranges from 1 minute to 5 minutes depending on location and computer. After the initial load reaches 70% the first video shows its own loading screen for a few additional seconds and begins to play. Subsequent videos will also show a brief loader before they play. The video and project sizes are as follows:
- Course SWF is 12.5mb
Slide one video is 827kb
Slide two video is 1.2mb
Slide three video is 1.9mb
Slide four video is 950kb
- All videos are encoded F4V
- Project is published from CP5 on a Mac
- Latest Flash player is being used for all user machines
The Problems:
- On high performance machines with fast internet connections, the content loads and plays as expected, however on slightly older machines, or slow connections the playback is jerky and unpredictable
- Playback performance from a web server is generally better than from the SumTotal LMS regardless of the machine capabilities
- On several occasions the audio for the next slide plays simultaneous with the video from the current slide. Also bullets that are synched with the slide and video will fall out of synch. After reloading or using the nav bar to back up, the slide generally plays as expected.
My questions for the community:
1 - Will the pre-loader load F4V videos before playback? Can someone explain what the pre-loader will load what it will not?
2 - If the preloader does not load video, is there a downside to setting the preloader to a minimum number (say 10%) to at least reduce the initial load cycle?
3 - How do I ensure that audio from the next slide will not play on the current slide or video synchronized with timeline elements do not fall out of synch?
Thanks
JeffHi there,
Please find the answers for your questions.
1 - Will the pre-loader load F4V videos before playback? Can someone explain what the pre-loader will load what it will not?
<ashwin> No, preloader only loads the main Movie. Once the slide with video is encountered the Video load is initiated and this loads the video. FLV video and Animations (if they are externalised) are not loaded while preloading the movie.
</ashwin>
2 - If the preloader does not load video, is there a downside to setting the preloader to a minimum number (say 10%) to at least reduce the initial load cycle?
<ashwin> Yes you can do this but i am not sure if this reduces the project loading time. I will try to explain you the way preloader works. A 10% preloader percentage indicates to load 10% of the SWF size, For instance if the SWF size is 12 MB then the project starts to play once 1.2 MB of the project is loaded. So if the project has rich content in the first few slides then loading may take time as it has it has to load the first slide fully to show the first slide. So it all depends on how the project is created and how the content is distributed in the project.
</ashwin>
3 - How do I ensure that audio from the next slide will not play on the current slide or video synchronized with timeline elements do not fall out of synch?
<ashwin>Do you have the audio from first slide to n slides continuously, if thats the case then in the published output a single audio file will be created with the published SWF and is stored in the SWF (In this case we say audio is sitched). So if a preloader is set to 10%, even though only 10% of the movie will be preloaded the entire audio should be loaded which might create sync issues as the movie will have started to play while the audio is being loaded.
To overcome this you may choose to increase the slide time of the slides containing audio by around 0.1 second. This activity will split the audio in the published output and hence will have small audio fragments to load while the movie is loading.If around 20 slides have audio continuously then you can increase the slide time for around 6-7 slides and not all.
</ashwin>
Try them and let me know if this information helped.
Thanks
Ashwin Bharghav B
Adobe Captivate team -
In the about:config page the keyword.enabled value is set to "true". And the keyword.URL value is set to "default". When I type a phrase in the Address Bar, a page with a Yahoo! search result opens unlike intuitively loading the relevant page using Google. Why is this happening?
To use the Google's browse by name feature as used in Firefox 3.6, set keyword.URL to this link:
[http://www.google.com/search?ie=UTF-8&oe=UTF-8&sourceid=navclient&gfns=1&q= http://www.google.com/search?ie=UTF-8&oe=UTF-8&sourceid=navclient&gfns=1&q=] -
Can I set up an apple ID for my child that can only buy apps and music with pre-loaded funds
I want to set up a an apple ID for my son, but only allow him to buy things if there is funds pre-loaded in his account. Is this possible?
Sure. You can either set up an account using an iTunes gift card or gift certificate, or set up a monthly allowance. See:
http://support.apple.com/kb/HT2736
Regards. -
I want to set the mailto app for google apps gmail.
I tried editing the gecko...mailto.2.uritemplate as per instructions found on web (https://mail.google.com/a/MYDOMAIN/mail/?extsrc=mailto&url=%s.
Set 3 related config values to "true" as per instructions (network.protocol-handler.expose.mailto ; network.protocol-handler.warn-external.mailto ; AND, third, gecko.handlerService.allowRegisterFromDifferentHost.
Does not work, no Google Apps in the mailto app spot.
Tried javascript method in address bar without success:
javascript:window.navigator.registerProtocolHandler("mailto","https://mail.google.com/a/MYDOMAIN/mail/?extsrc=mailto&url=%s","Google Apps GMail")
Any light anyone can shed will be appreciated. Cheers, jlfGreat howto Steve! This further increased my understanding of the MVC patterns used by BC4J.
Some remarks:
[*]Select New Business Components...
This should be 'New Business Components Package', or you won't be able to add business components.
ename as "Name",
sal as "Salary"
from emp
where empno = ?That should be deptno.
[*]Select the EditEmpsInDepartment view objectThat should be EmpsInDepartment.
Greetings,
Ivo -
Hi i have bought premier elements 12 and have down loaded it to downloads. I am using windows 8 operating system. I am now faced with three option pre, 32, pre 64 and set up. not sure where to go. sorry to be daft but i keep going round in circles. is there a simple step by step idiots guide to take me through what to do next. Thank you
flora65
If you have just purchased and downloaded Premiere Elements 12, I suspect that you did not purchase it direct from Adobe since Adobe is no longer selling Premiere Elements 12.
If you were purchasing from Adobe direct, I would have expected a Adobe Premiere Elements 12 Folder on your desktop. In that folder would be a PRE12 Folder and a ReadMe Folder.
You would open the PRE12 Folder and use the setup.exe file inside it to start the Premiere Elements 12 installation. In that scenario, the computer 32 or 64 bit matter would be behind the scenes as it were.
I am assuming that you have Windows 8 64 bit computer. In that case, open the PRE 64 Folder, find the setup.exe inside, and double click the setup.exe to start the installation. Important. Have you received a purchased serial number for Premiere Elements 12 from the seller? If not, do not bother continuing with the installation until you get the purchased serial number.
Best do these downloads and installs with the antivirus and firewall(s) of your computer disabled.
Please let us know if you have any questions or need clarification.
Thank you.
ATR -
Is it possible to use Apple Configurator to pre-load a class set of iPads with books?
I have class set of iPads that I want to pre-load with books from the iBooks Store (all public domain/Project Gutenberg, so they're free). I've managed to get them on one device, but it was 60+ and I had to download each indiviually. In Apple Configurator, when I backed-up that iPad and tried to load it on the others, the books did not show up on the other devices.
Short of downloading all the books on each iPad, is there an easier way to do this?unfortunately I don't see a way to do it with configurator. You may be able to use iTunes in the cloud for it though. On each iPad, make sure they are connected to the network, then go to Settings.app -> Store. Make sure the Apple ID associated with the books is logged in, and then turn the automatic downloads for books on. You may then have to download the books on again on one of the devices, but they should appear on all the devices.
-
I am running 13.0.1 on windows 7 and i have adblock and download helper. Since the recent update to firefox the youtube suggestions that appear on the right side of the page do not load properly. WHen the page 1st opens the suggestions are there but seconds later only a clear white box appears. I conducted a google search and found that i should check aboutconfig and change a setting to true. Well the setting was already on true so thats not the issue and i made no other changes. Firefox is a great product and i have never had any issues. I must say however that this youtube thing is pretty annoying. Any suggestions on how to fix?
Thanks for your help. I restarted in safe mode and the suggestions loaded just fine on youtube. So I guess i will have to figure out which ext is causing the issue? Here is a list of the extensions that i have. I did not change appearance themes.
one click downloader
add block plus
avg do not track
avg safe search
avg security tool bar
codecv 1.0
cool previews
divx plus web player
donottrack plus
down load helper
fantaper
tabscope
free youtube download
Any idea on which of these may be causing the issue? Will i need to enable them one by one to see which one is the issue? Im thinking it might be the adblock but not sure. -
I'm attempting to pre-load the cache with data and have implemented controllable caches as per this document (http://wiki.tangosol.com/display/COH35UG/Sample+CacheStores). My cache stores are configured as write-behind with a 2s delay:
<cache-config>
<caching-scheme-mapping>
<cache-mapping>
<cache-name>PARTY_CACHE</cache-name>
<scheme-name>party_cache</scheme-name>
</cache-mapping>
</caching-scheme-mapping>
<caching-schemes>
<distributed-scheme>
<scheme-name>party_cache</scheme-name>
<service-name>partyCacheService</service-name>
<thread-count>5</thread-count>
<backing-map-scheme>
<read-write-backing-map-scheme>
<write-delay>2s</write-delay>
<internal-cache-scheme>
<local-scheme/>
</internal-cache-scheme>
<cachestore-scheme>
<class-scheme>
<class-name>spring-bean:partyCacheStore</class-name>
</class-scheme>
</cachestore-scheme>
</read-write-backing-map-scheme>
</backing-map-scheme>
<autostart>true</autostart>
</distributed-scheme>
</caching-schemes>
</cache-config>
public static void enable(String storeName) {
CacheFactory.getCache(CacheNameEnum.CONTROL_CACHE.name()).put(storeName, Boolean.TRUE);
public static void disable(String storeName) {
CacheFactory.getCache(CacheNameEnum.CONTROL_CACHE.name()).put(storeName, Boolean.FALSE);
public static boolean isEnabled(String storeName) {
return ((Boolean) CacheFactory.getCache(CacheNameEnum.CONTROL_CACHE.name()).get(storeName)).booleanValue();
public void store(Object key, Object value) {
if (isEnabled(getStoreName())) {
throw new UnsupportedOperationException("Store method not currently supported");
}The problem I have is that what seems to be happening is:
1) bulk loading process calls disable() on the cache store
2) cache is loaded with data
3) bulk loading process calls enable() on the cache store ready for normal operation
4) the service thread starts to attempt to store the data as the check to see if the store is enabled returns true because we set it to true in step 3
so is there a way of temporarily disabling the write-delay or changing it programatically so step 4 doesn't happen?Adding
Thread.sleep(10000);after loading the data seems to solve the problem but this seems dirty, any better solutions? -
My requirement is that I need data to survive a grid restart. I've implemented a write behind persistence layer, implementing CacheStore and IterableCacheLoader using an Oracle table to store objects. All appears to be working well. Rows are being inserted in the database in response to coherenced put()'s. But if I bounce the entire grid, I want coherence to become aware of the objects which are persisted in the store, by calling keys().
Do I have to do this myself, using an external "cache warmer" process, or is there a way to induce Coherence to populate it's cache from the backing store on grid start up?
I tried setting pre-load to true in the local-scheme in config xml file, but to no avail.
I read a tantalizing description of custom quorum policy which claim to be able to do this. But there was no example and not enough detail for me.
Leonard
Edited by: 792513 on Sep 2, 2010 1:02 PMHi Leonard,
I think the following document should help you out.
http://wiki.tangosol.com/display/COH35UG/Pre-Loading+the+Cache
The cache store should also be aware that this is a preload so that it does not write the data back into the database.
If you check out the section Sample Controllable CacheStore in the following document. It should help. Essentially there are two choices.
Either use a control cache or use something like CacheStoreAware interface
http://coherence.oracle.com/display/COH35UG/Sample+CacheStores
Thanks,
-Dave -
Junitreport 'redirect' is not allowed when the secure processing feature is set to true.
junitreport 'redirect' is not allowed when the secure processing feature is set to true.
Hello,
I'm running flexunit4.1.0-8 and I have an ant script running the test suite. I recently upgraded from FB 4 to 4.5 and now I'm getting
failures on junitreports. Here's the full error:
[junitreport] : Error! Use of the extension element 'redirect' is not allowed when the secure processing feature is set to true.
[junitreport] Failed to process C:\TDMSE_2_6\tdmse\flex-test\flex_unit_reports\TESTS-TestSuites.xml
BUILD FAILED
C:\TDMSE_2_6\tdmse\build\flexunitbuild.xml:116: Errors while applying transformations: javax.xml.transform.TransformerException: java.lang.RuntimeException: Use of the extension element 'redirect' is not allowed when the secure processing feature is set to true.
Here's the junitreport section:
[code]
<target name="flex-unit-execute-tdmse-test-runner"
description="executes the test runner app">
<flexunit swf="${FLEX_UNIT_TEST_HOME}/TDMSETestRunner.swf"
toDir="${FLEX_UNIT_REPORTS_HOME}"
haltonfailure="false"
localTrusted="true"
verbose="true"
headless="false"/>
<junitreport todir="${FLEX_UNIT_REPORTS_HOME}">
<fileset dir="${FLEX_UNIT_REPORTS_HOME}">
<include name="Test-*.xml"/>
</fileset>
<report format="frames" todir="${FLEX_UNIT_REPORTS_HOME}/html"/>
</junitreport>
</target>
[/code]
And here's the full ant build:
[code]
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE project>
<!--
TDMS flex unit test suite
$Author:: hermannee $
$Revision:: 10963 $
$Date:: 2011-11-15 13:38:46 -0500 (Tue, 15 Nov 2011) $
$URL:: svn://ehsntpvld03.niehs.nih.gov/dev/tdmse_test_suite/trunk/build/flexun#$
-->
<!-- **** ADD THIS TO tdmes/build/build.xml *************
<property name="FLEX_UNIT_HOME" value="${tdmsedir}/../tdmse_test_suite" />
<target name="run_flex_units">
<ant antfile="${FLEX_UNIT_HOME}/build/build.xml" />
</target>
********************************************************* -->
<project name="flexunitbuild" basedir="." default="flex-unit-start-test-runner">
<tstamp>
<format property="build.date" pattern="MMMMM dd, yyyy" />
<format property="build.time" pattern="HH:mm:ss" />
</tstamp>
<property name="tdmsedir" value="${basedir}/.." />
<property name="builddir" value="${tdmsedir}/../build" />
<property name="FLEX_HOME" value="${builddir}/tools/flex-4.5.0" />
<property name="PARSLEY_HOME" value="${builddir}/tools/parsley-2.4.0" />
<property name="FLEX_UNIT_HOME" value="${tdmsedir}/flex-test" />
<property name="FLEX_UNIT_LIBS_HOME" value="${builddir}/tools/flexunit-4.1.0-8" />
<property name="FLEX_UNIT_REPORTS_HOME" value="${FLEX_UNIT_HOME}/flex_unit_reports" />
<property name="FLEX_UNIT_TEST_HOME" value="${FLEX_UNIT_HOME}/flex_unit_tests" />
<!-- ==== tasks ============================ -->
<taskdef resource="flexTasks.tasks" classpath="${FLEX_HOME}/ant/lib/flexTasks.jar"/>
<taskdef resource="flexUnitTasks.tasks" classpath="${FLEX_UNIT_LIBS_HOME}/flexUnitTasks-4.1.0-8.jar" />
<!-- dev -->
<echo>basedir: ${basedir}</echo>
<echo>tdmsedir: ${tdmsedir}</echo>
<echo>builddir: ${builddir}</echo>
<echo>FLEX_HOME: ${FLEX_HOME}</echo>
<echo>FLEX_UNIT_HOME: ${FLEX_UNIT_HOME}</echo>
<echo>FLEX_UNIT_LIBS_HOME: ${FLEX_UNIT_LIBS_HOME}</echo>
<echo>FLEX_UNIT_REPORTS_HOME: ${FLEX_UNIT_REPORTS_HOME}</echo>
<!-- =================================
target: run-tdmse-test
================================= -->
<target name="flex-unit-start-test-runner"
description="clean, compile and run tdmse flexunit tests"
depends="flex-unit-clean-tdmse-tests,
flex-unit-tdmse-compile-test-suite,
flex-unit-execute-tdmse-test-runner"/>
<target name="flex-unit-clean-tdmse-tests" description="Cleans the FlexUnit test and reports directories">
<delete dir="${FLEX_UNIT_REPORTS_HOME}" failOnError="false"
includeEmptyDirs="true" />
<mkdir dir="${FLEX_UNIT_REPORTS_HOME}" />
<delete dir="${FLEX_UNIT_TEST_HOME}" failOnError="false"
includeEmptyDirs="true" />
<mkdir dir="${FLEX_UNIT_TEST_HOME}" />
</target>
<target name="flex-unit-tdmse-compile-test-suite">
<mxmlc file="${tdmsedir}/flex-src/TDMSETestRunner.mxml"
output="${FLEX_UNIT_TEST_HOME}/TDMSETestRunner.swf">
<load-config filename="${FLEX_HOME}/frameworks/flex-config.xml"/>
<!-- ==== include tdmse resource bundles ====== -->
<locale>en_US</locale>
<source-path path-element="${tdmsedir}/flex-src/locale/{locale}" />
<include-resource-bundles>COMMON</include-resource-bundles>
<include-resource-bundles>OW</include-resource-bundles>
<include-resource-bundles>PREF</include-resource-bundles>
<include-resource-bundles>RD</include-resource-bundles>
<include-resource-bundles>RG</include-resource-bundles>
<!-- ==== compile parsley library ============= -->
<compiler.library-path dir="${PARSLEY_HOME}" append="true">
<include name="parsley-flex4-2.4.0.swc" />
<include name="spicelib-flex-2.4.0.swc" />
</compiler.library-path>
<!-- ==== compile all tdmse flex-src ========== -->
<source-path path-element="${tdmsedir}/flex-src" />
<source-path path-element="${tdmsedir}/flex-test" />
<!-- ==== compile all flexunit swc's ========== -->
<compiler.library-path dir="${FLEX_UNIT_LIBS_HOME}" append="true">
<include name="*.swc"/>
</compiler.library-path>
<!-- ==== compile all flexunit swc's ========== -->
<compiler.library-path dir="${FLEX_UNIT_LIBS_HOME}/mocklibs" append="true">
<include name="*.swc"/>
</compiler.library-path>
<compiler.verbose-stacktraces>true</compiler.verbose-stacktraces>
<compiler.headless-server>true</compiler.headless-server>
</mxmlc>
</target>
<target name="flex-unit-execute-tdmse-test-runner"
description="executes the test runner app">
<flexunit swf="${FLEX_UNIT_TEST_HOME}/TDMSETestRunner.swf"
toDir="${FLEX_UNIT_REPORTS_HOME}"
haltonfailure="false"
localTrusted="true"
verbose="true"
headless="false"/>
<junitreport todir="${FLEX_UNIT_REPORTS_HOME}">
<fileset dir="${FLEX_UNIT_REPORTS_HOME}">
<include name="Test-*.xml"/>
</fileset>
<report format="frames" todir="${FLEX_UNIT_REPORTS_HOME}/html"/>
</junitreport>
</target>
<!-- ======================================================== -->
</project>
[/code]
I haven't seen much info about this problem anywhere on google except for this forum post:
http://forums.adobe.com/thread/740146
Thanks for any help!If you include the xalan.jar library to the build.xml execution classpath everything works!!!!!!.
I hope it will be userfull. -
Hi,
I have two servers with Server 1 and Server 2(I mean two different machine) and both the servers are configured with Distributed cache. For example Server 1 have a cache name "ABC" and Server 2 have a cache name "XYZ".
I want to pre load the same data to both the servers with different cache names and my JOB java class is pointing to tangosol override file for Server 1.
How can I load the data to server 2 with server 1 tangosol override file?
I dont want to use push replication patteren.
Thanks,
Raj.Hi Raj
You cannot get the storage enabled members from an Extend client as the cache service will be a RemoteCacheService or more likely a SafeCacheService wrapping a RemoteCacheService.
I am not sure I follow exactly what you are trying to achieve from your posts above.
Why do you want to get the storage enabled members - is is so that you can make the same call invocationService.execute(task,Collections.singleton(members.toArray()[0]), null); to cluster two from cluster one?
If you want to do this then you need two invocable, one is LoaderInvocable class you mention above and the other looks like this:
public class RemoteLoaderInvocable extends AbstractInvocable {
private String cacheName;
private String springBeanId;
public RemoteLoaderInvocable() {
public RemoteLoaderInvocable(String cacheName, String springBeanId) {
this.cacheName = cacheName;
this.springBeanId = springBeanId;
@Override
public void run() {
NamedCache cache = CacheFactory.getCache(cacheName);
Set<Member> memberSet = ((PartitionedService) cache.getCacheService()).getOwnershipEnabledMembers();
Member[] members = memberSet.toArray(new Member[memberSet.size()]);
LoaderInvocable task = new LoaderInvocable(cacheName,springBeanId);
getService().query(task, members);
}You would need to make the above class properly implement POF of whatever you are using for serialization.
You then declare a remote invocation scheme like you have for the remote cache scheme in cluster 1
<remote-invocation-scheme>
<scheme-name>tier-2-proxy-invocation-scheme</scheme-name>
<service-name>ExtendTcpProxyInvocationService</service-name>
<initiator-config>
<tcp-initiator>
<remote-addresses>
<socket-address>
<address>localhost</address>
<port>6005</port>
</socket-address>
</remote-addresses>
<connect-timeout>20s</connect-timeout>
</tcp-initiator>
<outgoing-message-handler>
<request-timeout>20s</request-timeout>
</outgoing-message-handler>
</initiator-config>
</remote-invocation-scheme>Then in cluster1 you can do...
InvocationService cluster2Service = CacheFactory.getService("ExtendTcpProxyInvocationService");
service.query(new RemoteLoaderInvocable(cacheName, springBeanId), null);That will allow you to execute your LoaderInvocable from cluster 1 against storage enabled members in cluster 2, but as I said, I don't see what you are really trying to do.
JK -
Pre-loading Oracle text in memory with Oracle 12c
There is a white paper from Roger Ford that explains how to load the Oracle index in memory : http://www.oracle.com/technetwork/database/enterprise-edition/mem-load-082296.html
In our application, Oracle 12c, we are indexing a big XML field (which is stored as XMLType with storage secure file) with the PATH_SECTION_GROUP. If I don't load the I table (DR$..$I) into memory using the technique explained in the white paper then I cannot have decent performance (and especially not predictable performance, it looks like if the blocks from the TOKEN_INFO columns are not memory then performance can fall sharply)
But after migrating to oracle 12c, I got a different problem, which I can reproduce: when I create the index it is relatively small (as seen with ctx_report.index_size) and by applying the technique from the whitepaper, I can pin the DR$ I table into memory. But as soon as I do a ctx_ddl.optimize_index('Index','REBUILD') the size becomes much bigger and I can't pin the index in memory. Not sure if it is bug or not.
What I found as work-around is to build the index with the following storage options:
ctx_ddl.create_preference('TEST_STO','BASIC_STORAGE');
ctx_ddl.set_attribute ('TEST_STO', 'BIG_IO', 'YES' );
ctx_ddl.set_attribute ('TEST_STO', 'SEPARATE_OFFSETS', 'NO' );
so that the token_info column will be stored in a secure file. Then I can change the storage of that column to put it in the keep buffer cache, and write a procedure to read the LOB so that it will be loaded in the keep cache. The size of the LOB column is more or less the same as when creating the index without the BIG_IO option but it remains constant even after a ctx_dll.optimize_index. The procedure to read the LOB and to load it into the cache is very similar to the loaddollarR procedure from the white paper.
Because of the SDATA section, there is a new DR table (S table) and an IOT on top of it. This is not documented in the white paper (the white paper was written for Oracle 10g). In my case this DR$ S table is much used, and the IOT also, but putting it in the keep cache is not as important as the token_info column of the DR I table. A final note: doing SEPARATE_OFFSETS = 'YES' was very bad in my case, the combined size of the two columns is much bigger than having only the TOKEN_INFO column and both columns are read.
Here is an example on how to reproduce the problem with the size increasing when doing ctx_optimize
1. create the table
drop table test;
CREATE TABLE test
(ID NUMBER(9,0) NOT NULL ENABLE,
XML_DATA XMLTYPE
XMLTYPE COLUMN XML_DATA STORE AS SECUREFILE BINARY XML (tablespace users disable storage in row);
2. insert a few records
insert into test values(1,'<Book><TITLE>Tale of Two Cities</TITLE>It was the best of times.<Author NAME="Charles Dickens"> Born in England in the town, Stratford_Upon_Avon </Author></Book>');
insert into test values(2,'<BOOK><TITLE>The House of Mirth</TITLE>Written in 1905<Author NAME="Edith Wharton"> Wharton was born to George Frederic Jones and Lucretia Stevens Rhinelander in New York City.</Author></BOOK>');
insert into test values(3,'<BOOK><TITLE>Age of innocence</TITLE>She got a prize for it.<Author NAME="Edith Wharton"> Wharton was born to George Frederic Jones and Lucretia Stevens Rhinelander in New York City.</Author></BOOK>');
3. create the text index
drop index i_test;
exec ctx_ddl.create_section_group('TEST_SGP','PATH_SECTION_GROUP');
begin
CTX_DDL.ADD_SDATA_SECTION(group_name => 'TEST_SGP',
section_name => 'SData_02',
tag => 'SData_02',
datatype => 'varchar2');
end;
exec ctx_ddl.create_preference('TEST_STO','BASIC_STORAGE');
exec ctx_ddl.set_attribute('TEST_STO','I_TABLE_CLAUSE','tablespace USERS storage (initial 64K)');
exec ctx_ddl.set_attribute('TEST_STO','I_INDEX_CLAUSE','tablespace USERS storage (initial 64K) compress 2');
exec ctx_ddl.set_attribute ('TEST_STO', 'BIG_IO', 'NO' );
exec ctx_ddl.set_attribute ('TEST_STO', 'SEPARATE_OFFSETS', 'NO' );
create index I_TEST
on TEST (XML_DATA)
indextype is ctxsys.context
parameters('
section group "TEST_SGP"
storage "TEST_STO"
') parallel 2;
4. check the index size
select ctx_report.index_size('I_TEST') from dual;
it says :
TOTALS FOR INDEX TEST.I_TEST
TOTAL BLOCKS ALLOCATED: 104
TOTAL BLOCKS USED: 72
TOTAL BYTES ALLOCATED: 851,968 (832.00 KB)
TOTAL BYTES USED: 589,824 (576.00 KB)
4. optimize the index
exec ctx_ddl.optimize_index('I_TEST','REBUILD');
and now recompute the size, it says
TOTALS FOR INDEX TEST.I_TEST
TOTAL BLOCKS ALLOCATED: 1112
TOTAL BLOCKS USED: 1080
TOTAL BYTES ALLOCATED: 9,109,504 (8.69 MB)
TOTAL BYTES USED: 8,847,360 (8.44 MB)
which shows that it went from 576KB to 8.44MB. With a big index the difference is not so big, but still from 14G to 19G.
5. Workaround: use the BIG_IO option, so that the token_info column of the DR$ I table will be stored in a secure file and the size will stay relatively small. Then you can load this column in the cache using a procedure similar to
alter table DR$I_TEST$I storage (buffer_pool keep);
alter table dr$i_test$i modify lob(token_info) (cache storage (buffer_pool keep));
rem: now we must read the lob so that it will be loaded in the keep buffer pool, use the prccedure below
create or replace procedure loadTokenInfo is
type c_type is ref cursor;
c2 c_type;
s varchar2(2000);
b blob;
buff varchar2(100);
siz number;
off number;
cntr number;
begin
s := 'select token_info from DR$i_test$I';
open c2 for s;
loop
fetch c2 into b;
exit when c2%notfound;
siz := 10;
off := 1;
cntr := 0;
if dbms_lob.getlength(b) > 0 then
begin
loop
dbms_lob.read(b, siz, off, buff);
cntr := cntr + 1;
off := off + 4096;
end loop;
exception when no_data_found then
if cntr > 0 then
dbms_output.put_line('4K chunks fetched: '||cntr);
end if;
end;
end if;
end loop;
end;
Rgds, PierreI have been working a lot on that issue recently, I can give some more info.
First I totally agree with you, I don't like to use the keep_pool and I would love to avoid it. On the other hand, we have a specific use case : 90% of the activity in the DB is done by queuing and dbms_scheduler jobs where response time does not matter. All those processes are probably filling the buffer cache. We have a customer facing application that uses the text index to search the database : performance is critical for them.
What kind of performance do you have with your application ?
In my case, I have learned the hard way that having the index in memory (the DR$I table in fact) is the key : if it is not, then performance is poor. I find it reasonable to pin the DR$I table in memory and if you look at competitors this is what they do. With MongoDB they explicitly says that the index must be in memory. With elasticsearch, they use JVM's that are also in memory. And effectively, if you look at the awr report, you will see that Oracle is continuously accessing the DR$I table, there is a SQL similar to
SELECT /*+ DYNAMIC_SAMPLING(0) INDEX(i) */
TOKEN_FIRST, TOKEN_LAST, TOKEN_COUNT, ROWID
FROM DR$idxname$I
WHERE TOKEN_TEXT = :word AND TOKEN_TYPE = :wtype
ORDER BY TOKEN_TEXT, TOKEN_TYPE, TOKEN_FIRST
which is continuously done.
I think that the algorithm used by Oracle to keep blocks in cache is too complex. A just realized that in 12.1.0.2 (was released last week) there is finally a "killer" functionality, the in-memory parameters, with which you can pin tables or columns in memory with compression, etc. this looks ideal for the text index, I hope that R. Ford will finally update his white paper :-)
But my other problem was that the optimize_index in REBUILD mode caused the DR$I table to double in size : it seems crazy that this was closed as not a bug but it was and I can't do anything about it. It is a bug in my opinion, because the create index command and "alter index rebuild" command both result in a much smaller index, so why would the guys that developped the optimize function (is it another team, using another algorithm ?) make the index two times bigger ?
And for that the track I have been following is to put the index in a 16K tablespace : in this case the space used by the index remains more or less flat (increases but much more reasonably). The difficulty here is to pin the index in memory because the trick of R. Ford was not working anymore.
What worked:
first set the keep_pool to zero and set the db_16k_cache_size to instead. Then change the storage preference to make sure that everything you want to cache (mostly the DR$I) table come in the tablespace with the non-standard block size of 16k.
Then comes the tricky part : the pre-loading of the data in the buffer cache. The problem is that with Oracle 12c, Oracle will use direct_path_read for FTS which basically means that it bypasses the cache and read directory from file to the PGA !!! There is an event to avoid that, I was lucky to find it on a blog (I can't remember which, sorry for the credit).
I ended-up doing that. the events to 10949 is to avoid the direct path reads issue.
alter session set events '10949 trace name context forever, level 1';
alter table DR#idxname0001$I cache;
alter table DR#idxname0002$I cache;
alter table DR#idxname0003$I cache;
SELECT /*+ FULL(ITAB) CACHE(ITAB) */ SUM(TOKEN_COUNT), SUM(LENGTH(TOKEN_INFO)) FROM DR#idxname0001$I;
SELECT /*+ FULL(ITAB) CACHE(ITAB) */ SUM(TOKEN_COUNT), SUM(LENGTH(TOKEN_INFO)) FROM DR#idxname0002$I;
SELECT /*+ FULL(ITAB) CACHE(ITAB) */ SUM(TOKEN_COUNT), SUM(LENGTH(TOKEN_INFO)) FROM DR#idxname0003$I;
SELECT /*+ INDEX(ITAB) CACHE(ITAB) */ SUM(LENGTH(TOKEN_TEXT)) FROM DR#idxname0001$I ITAB;
SELECT /*+ INDEX(ITAB) CACHE(ITAB) */ SUM(LENGTH(TOKEN_TEXT)) FROM DR#idxname0002$I ITAB;
SELECT /*+ INDEX(ITAB) CACHE(ITAB) */ SUM(LENGTH(TOKEN_TEXT)) FROM DR#idxname0003$I ITAB;
It worked. With a big relief I expected to take some time out, but there was a last surprise. The command
exec ctx_ddl.optimize_index(idx_name=>'idxname',part_name=>'partname',optlevel=>'REBUILD');
gqve the following
ERROR at line 1:
ORA-20000: Oracle Text error:
DRG-50857: oracle error in drftoptrebxch
ORA-14097: column type or size mismatch in ALTER TABLE EXCHANGE PARTITION
ORA-06512: at "CTXSYS.DRUE", line 160
ORA-06512: at "CTXSYS.CTX_DDL", line 1141
ORA-06512: at line 1
Which is very much exactly described in a metalink note 1645634.1 but in the case of a non-partitioned index. The work-around given seemed very logical but it did not work in the case of a partitioned index. After experimenting, I found out that the bug occurs when the partitioned index is created with dbms_pclxutil.build_part_index procedure (this enables enables intra-partition parallelism in the index creation process). This is a very annoying and stupid bug, maybe there is a work-around, but did not find it on metalink
Other points of attention with the text index creation (stuff that surprised me at first !) ;
- if you use the dbms_pclxutil package, then the ctx_output logging does not work, because the index is created immediately and then populated in the background via dbms_jobs.
- this in combination with the fact that if you are on a RAC, you won't see any activity on the box can be very frightening : this is because oracle can choose to start the workers on the other node.
I understand much better how the text indexing works, I think it is a great technology which can scale via partitioning. But like always the design of the application is crucial, most of our problems come from the fact that we did not choose the right sectioning (we choosed PATH_SECTION_GROUP while XML_SECTION_GROUP is so much better IMO). Maybe later I can convince the dev to change the sectionining, especially because SDATA and MDATA section are not supported with PATCH_SECTION_GROUP (although it seems to work, even though we had one occurence of a bad result linked to the existence of SDATA in the index definition). Also the whole problematic of mixed structured/unstructured searches is completly tackled if one use XML_SECTION_GROUP with MDATA/SDATA (but of course the app was written for Oracle 10...)
Regards, Pierre -
Adding a pre loader to an XML photo gallery between the photos.
Hey,
I have made a photogallery in actionscript 3 which uses an .XML file to import pictures. As the user clicks on the displayed image the code loads the next image in the cycle into the display. Now, I would like to add a preloader which displays the loading progress of each image as the user clicks (otherwise there is just a blank area as the image loads). I have made a pre-loader for the main .SWF but I can't figure out how to make it work for the images or how to make a seperate one for the images. The fact is that I am a bit of a muppet when it comes to AS3, and am finding myself getting lost an confused quite easily.
I have attatched the .FLA if that helps any! If not then...
here is the link to the .HTML page that contains the .swf:
http://www.davidframpton.co.uk/portfolio.html
Here is the code I am using for the main pre-loader held in frame 1:
stop();
addEventListener(Event.ENTER_FRAME, loaderF);
function loaderF(e:Event):void {
var toLoad:Number = loaderInfo.bytesTotal;
var loaded:Number = loaderInfo.bytesLoaded;
var total:Number = loaded/toLoad;
if(loaded == toLoad) {
removeEventListener(Event.ENTER_FRAME, loaderF);
gotoAndStop(2);
} else {
preloader_mc.preloaderFill_mc.scaleX = total;
preloader_mc.percent_txt.text = Math.floor(total * 100) + "%";
And here is the code for the photogallery:
stop();
var xmlRequest:URLRequest = new URLRequest("http://www.davidframpton.co.uk/galleryData.xml");
var xmlLoader:URLLoader = new URLLoader (xmlRequest);
var imgData:XML;
var imageLoader:Loader;
var rawImage:String;
var rawH:String;
var rawW:String;
var imgNum:Number = 0;
var checkSec:Timer = new Timer(100);
var numberOfChildren:Number;
xmlLoader.addEventListener(Event.COMPLETE, xmlLoadedF);
master_mc.addEventListener(MouseEvent.CLICK, nextImgF);
master_mc.buttonMode = true;
function xmlLoadedF(event:Event):void{
checkSec.start();
checkSec.addEventListener(TimerEvent.TIMER, checkerF);
imgData = new XML(event.target.data);
function packagedF():void{
checkSec.removeEventListener(TimerEvent.TIMER, checkerF);
rawImage = imgData.image[imgNum].imgURL;
numberOfChildren = imgData.*.length();
imageLoader = new Loader;
imageLoader.load(new URLRequest(rawImage));
master_mc.addChild(imageLoader);
function checkerF(event:TimerEvent):void{
if (imgNum == 0) {
packagedF();
}else if(imgNum < numberOfChildren){
imageLoader.unload();
packagedF();
}else {
imageLoader.unload();
imgNum = 0;
packagedF();
function nextImgF(event:MouseEvent):void {
checkSec.addEventListener(TimerEvent.TIMER, checkerF);
imgNum++;
I would really appreciate any help. Even if your could guide me to where I can learn how to do this myself in an simple fashion, I would be greatful.
Thanks in advance
DaveThe Loader class has a contentLoaderInfo property that is a LoaderInfo class object. You can assign an event listener to the contentLoader Info that listens for PROGRESS. There is an example in the Loader class section that shows the contentLoaderInfo property being used for a variety of event detections, including PROGRESS.
Maybe you are looking for
-
Running a java program at "Start Up"
Besides running an html file with an applet in it. Are there any simple ways to launch a java program every time the computer is turned on. I am not asking for specific directions, but rather just an idea, and i will go find my own guide.
-
Can I download Adobe Photoshop CS2 legally from Adobe's link?
Dear Adobe Community, The following link shows how to get Adobe Photoshop CS2 "legally" http://www.digitaltrends.com/computing/how-to-get-photoshop-for-free/ The conditions from Adobe are that you must have either purchased the license perviously or
-
Printer goes offline after printing
Hello, I have an HP Laserjet Pro MFP M476DW used wireless, which worked fine until the upgrade to Yosemite 10.10.2. Now go offline after you have printed a copy and must be turned off and on for printing. And then press the last thing in the print qu
-
Variable coming from a session attribute
Hello, I am developing a web application with JDeveloper 10g I've got a View Object which is basically a query, where I use a variable: WHERE BbCustomerOrderStatusTab.CUSTNO = :CustomerNumber When I define CustomerNumber in a form, it works: <af:pane
-
I am having a problem with my player. It's a Nomad Zen Xtra 30GB player. As for the firmware it is version .03.02 and I am trying to update it to .20.08 but it is not working. Well to put it plainly...whenever I start my player all I get is the rescu