How to use batch mode in cq dam - new questions added

Hi I am doing DAM migration. I am using custom code to pick the image and create asset by calling Assetmanager.createAsset which creates dam assets.
This code I am calling through the scheduler which will run for every 0.5 hr. Around 1000 images we are trying to push in each cycle. I came acrosss batchMode for saving all the images per batch so that it will reduce the migration time But I am not sure how to use it.
.setBatchMode(true); isBatchMode are the methods available in Asset api.
Please share your thoughts on this.
Some more Point I want to ask.
1.What is the best appraoch when we are pushing images to DAM
     Stopping the workflows push all the images and run the work flows. (Is it possible to do this?)
     Do the both simultaniously
     Do it in the bath (i.e push bunch of images and then run the workflows)
2.When i am migrating images (from file system which is residing in the same box where cq is running )it is almost taking 0.5 hr for 1000 images (avg size of image is 100kb). Is there any possibility to      improve this process.
3. When I am adding images I am adding subassets to some of the images so when ever I add subasset cq is creating new version of the asset which is not required for me. What is the best approach to avoid      creating too many versions for images in DAM. By doing this is there any performance improve in the system.
Thanks,
Maruthi

Hi Jorg,
Thank you.
I will try out batch saving option.
I have few more doubts.
1. Today I tried for moving aroung 5k images through the scheduler in my local machine. It went smoothly with out much issues but as usual some of the renditions are failing for some of the sub assets. This is about 3 for every 10 images. Renditions are generating properly for all assets it is failing in case of sub assets only. Along with this I am getting version exceptions. Below are errors which I am facing very frequently during migration dry run. This seems to be beacuse of the non synchronized execute methods in WF steps. What is your call on these issues how can we avoid these kind of errors.
20.02.2013 19:16:00.082 *ERROR* [JobHandler: /etc/workflow/instances/2013-02-20/model_1361367956960012000:/content/dam/<IMAGE PATH>/subassets/<Image Name>/jcr:content/renditions/original] com.day.cq.dam.core.impl.AssetImpl setRendition: cannot set new rendition [cq5dam.thumbnail.140.100.png] for asset [<IMAGE PATH>/subassets/<Image Name>]: javax.jcr.version.VersionException: Unable to perform operation. Node is checked-in.
20.02.2013 19:17:01.660 *ERROR* [JobHandler: /etc/workflow/instances/2013-02-20/model_1361368020884400000:/content/dam/<IMAGE PATH>/jcr:content/metadata] com.day.cq.dam.core.impl.handler.xmp.NCommXMPHandler Stack Trace: java.lang.Exception: Unable to create revision.
Caused by: javax.jcr.RepositoryException: Unable to update item: item.save()
Caused by: javax.jcr.InvalidItemStateException: Item cannot be saved because it has been deleted externally: item.save()
20.02.2013 19:19:08.666 *WARN* [JobHandler: /etc/workflow/instances/2013-02-20/model_1361368144852589000:/content/dam/<IMAGE PATH>/subassets/<Image Name>/jcr:content/renditions/original] com.day.cq.dam.core.process.ExtractMetadataProcess unexpected error occurred during metadata extraction. Cause: Unable to perform operation. Node is checked-in. javax.jcr.version.VersionException: Unable to perform operation. Node is checked-in.
2. Can you share about experience in DAM migrations. What is the avg time it takes for migrating about 1 to 1.2 lac images which are aroung 60 gig. We thought of running the scheduler (this.scheduler.addPeriodicJob(jobName, job, config, period, canRunConcurrently);)for every 0.5 hr in that case it will go on for 3 days.

Similar Messages

How to use batch files to send the load from ODC to UCM?

Hello all.
We're trying to do this along this week and, until now, we couldn't figure out how to use batch files containing metada on ODC and commit the output files to UCM.
So these are our specs:
VM 1
ODC - 10gR3
OS - Windows XP 32 bits SP3
DB - Oracle DB 11.2
VM 2
No ODC
UCM 11.1.1.6
OS - Enterprise Linux Enterprise Linux Server release 5.5 (Carthage)
We've opened a ticket with Oracle Support to know how we should do this. The number is SR 3-6108348211.
Let me try to explain what we want to do:
1 - we have a batch file with all metadata of many files from UCM
2 - we want to use this file in ODC, so the application will convert the images and commit them to UCM
3 - we should see all these files, their metadata, thumbnails and related content in UCM
4 - this is a batch file example we want to send to ODC:
@Properties LocalData
IdcService=CHECKIN_UNIVERSAL
dRevLabel = 1
primaryFile=/tra/Relatorio_UHPF-03-04-2008-M-RL-EA.pdf
dDocName=TRA_33
dDocTitle=UHPF-03-04-2008-M-RL-EA
dSecurityGroup=MAM_TRA
dDocType=Document
dDocAuthor=luis.neotropical
dInDate=14/05/08
xC_CLASSIFICACAO=EA - Educação Ambiental
xC_DATA=01/04/08
xC_DATAVALIDADE=30/04/08
xC_LOCALIZACAOFISICA=N/D
xC_USUARIO_DEP=LUIS FERNANDO DA CAMARA
xC_TIPO=RL - Relatório
xC_USINA=UHPF - USINA HIDRELÉTRICA PASSO FUNDO
xC_FICHA=MAM - Relatorios Ambientais
xC_IDDOCMAN=TRADocID=157
xC_IDANEXODOCMAN=TRAFileID=33
xC_DESTINOINICIAL=Tractebel
xC_ORIGEM=Neotropical
xC_FORMATODOCUMENTO=Digital
xC_GENERODOCUMENTO=
xC_DOCPRINCIPAL=Sim
@end
<<EOD>>
5 - So, when we use this batch file on ODC, the file (or image) will be converted, all metadata attached and then sent to UCM.
But we don't know how to do the link between ODC and UCM. The Oracle Support says it is necessary to do some customization. In the books I could not find any info about how to do, just generic information or how to use ODC.
Is there a way (without customization) to do that? Can anyone give us a step-by-step guide?
Thanks for all help and guidance.
Fernando

What is the one-sentence requirement or issue you're trying to solve?
If you only want content to be converted to pdf, then you should already have that with your items checked into UCM (if you have IBR enabled).
if you really want to feed content into ODC using a batchfile, my first thought would be to create a transformation utility/app that will convert your batchfiles to the expected ODC import server folder job format. then you'll have to move or map the content to match.
Again, without knowing the exact issue/business requirement you're trying to work through, I'd say a redesign of your ingestion process may be in order.
If you feed content directly into ODC through any supported ODC method (watch folder, email, scanner, fax, etc), then you'll be able to use everything ootb as you'll be able to auto-commit directly into UCM or add an indexing step and manual commit to UCM.
ODC is basically a front end for indexing and extra ingestion options to your content repo.
IPM is basically the same, but it includes some extra process-related details (process metadata, process integrations/bpel/bpm, other system integrations/ebs/crm, etc). I don't feel that IPM would help with the transformation-specific question you've put out there.
-ryan

How to use batch processing with jpg pictures taken with iphone cameras?

How to use batch processing with jpg pictures taken with iphone cameras?

Open the editor . Go to file>process multiple files
Sent from my iPad

How to use Batch operation for two xsodata services?

Hi All,
I have two xsodata services. How to use submit batch for two xsodata services
Thanks,
Mj

Gateway Batch Calls from SAPUI5

Database Backup using batch mode doesn't work

Hello,
i try to use the batch mode to backup the HANA DB (1.00.21) but nothing happens.
my backup.sql
\connect -n <server name> -i <instance number> -u <user> -p <password>
BACKUP DATA USING FILE ('Monday')
excecute the backup
/usr/sap/<SID>/HDB<instance number>/exe/hdbsql -I backup.sql
The instructions work for themselves but with this script nothing happens.
Any ideas?
Thanks

Hello,
The manual advises against your proposal rather, because the password is visible in the process.
Actually it is not advising against what I suggest and what it in the blog.
You have three options:
1.) run everything from command line (this is what SAP suggested that is wrong because you would see the password)
2.) store password in file - less wrong than option 1.) because everyone having access to file can see the password
3.) store password in encrypted user store and use just -U <user> (no password needed)
This is also suggested in guide:
In addition, the password must be saved in the hdbuserstore, and not in a file.
The issue is in separator - it is stated that default is '//' but apparently it is not - it is ';'.
This syntax would work:
\connect -n <server name> -i <instance number> -u <user> -p <password>;
BACKUP DATA USING FILE ('Monday');
Anyway - it is wrong from security perspective. User store is much better because the password is encrypted.
Tomas

How to use old archieve logs with a new control file

Environment:
ORACLE_BASE="/export/home/oracle"
ORACLE_HOME="/export/home/oracle/product/8.1.6"
NLS_LANG=".UTF8"
2 partitions:
i) /data1 -- contains important datafiles (OS striping on 3 hard
disks)
ii) /export/home -- contains the oracle program, and SYS/SYSTEM
datafiles
Problem:
-/data1 cannot be read/mount (damaged)
-oracle failed
Action Performed:
-reinstalled OS
-mount /export/home successfully (all oracle system files,
instance init files exist)
-/data1 is an empty partition
-created the oracle user, and its groups
-chown recusively for the $ORACLE_BASE directory
-set all the oracle environment variables
-attempted to start the instance, but failed due to a control
file was
missing
-since control files were set to be mirrored, i copied a control
file somewhere
from /export/home/oracle/oradata/<SID>/control1.ctl to
/data1/oracle/oradata/<SID>/control2.ctl (i.e. have them back to
their original locations)
-the instance failed to start as well, since the datafile set in
the control files couldn't be found
-this forced me to re-create the control file... b4 i re-create
a new control file, i backed up the old one
-once the control file was created, the database can be started,
but, to oracle, all achieve log information are lost (although
the achieve log's physical files r still there)
-i imported the important data from a dump file that was
exported a week ago b4 the system failure
-since we r using the new control file, the redo logs switch
contains no achieve log information that the old control file
has, so running "recover database" doesn't do anything
Purpose:
since the dump file is a week old, i'd like to get the data
after my last export and b4 the system failure. the database was
run in arhieve log mode, how can i recover those data with the
new control file
Question:
-how can we create a new control file that can drive the old
achieve logs?
-can we convert the achieve log data (.dbf format) into text
format?
-can we still use the old control files to start the database?
-what's a suggested solution if we'd like to re-construct the
database up to the moment b4 the system failure in another
server?
thx

user3930585 wrote:
I am in an unenviable position, with an unsupported database.
We are running Oracle 9i on Windows XP. We are upgrading soon to Oracle 11g on a newer platform, but need to get our development environment working first.
We lost a system that was running our development database without having a database export. The C drive was placed into a new system as the D drive.
I have loaded Oracle 9i on the C drive, but I have been unable to determine how to point it to the existing data files on the D drive. My search skills may be the limiting factor here...
We cannot simply load the drive as C, since the hardware is different.
What are the steps to point the new database software at the data files on the D drive? Or, how do I copy the old data files into the new Oracle Home and have them recognized properly?
Are you stating that you don't know how to use COPY command?
Can you recreate same directory structure on new C drive as exist on old C drive?
Can you then drag & drop copies of the files?

How to use existing plugin transformation from a new plugin

Hi,
Begginer's question:
I use the SDK examples for a new plugin I want to write.
I want to invoke several commands of an existing plugins from my plugin.
For example I define a new Effect Control: My Opacity. For start I would like to invoke the functionality of Transform->Opacity.
Now, I saw in the example Projector that I can invoke
suites.EffectSuite2()->AEGP_ApplyEffect
Is this the way to do it?
How can I pass the parameter that the user gave me to the needed effect?
I guess rhere is a quicker way to find the effect by name instead of iteration on all available as done in the Projector example.
Thanx in advance,
Miro

Hello miro A, welcome to the forum!
i'm having some trouble understanding the process you're creating, so i have a couple of questions:
1. is your effect a layer effect? (like "gaussian blur")
or is it a general plug-in? (like layer->transform->fit vertical, or the "wiggler" panel)
the two (effects and AEGPs) differ in many ways and will determine the way you approach the problem.
2. when you say "the parameter that the user gave me", what do you mean?
is there a standard slider on your effect that the user can manipulate?
in the mean time i'll do my best to answer you questions:
yes, suites.EffectSuite2()->AEGP_ApplyEffect() is the way to add a new effect to a layer,
BUT if your effect is a layer effect (again, like "curves"), then you're in for some major problems.
layer effects can't add new effects to the same layer as themselves.
it causes errors and crashes, because by the time your effect returns from it's call AE discovers that the layer has changed in the mean time (you added an effect), and AE doesn't cope with that change well. at all.
no, there is no way of knowing what effect to access on a layer without iterating through them at some point in time.
to access an effect you must retrieve an effectRef.
to get an effectRef you must call it's index on a layer, along with the identifier of a specific layer. (layerH and effect index on that layer (say... 3rd effect))
to know the index, you must iterate though the effects on a layer and check each one for it's name or matchName.
you don't have to do it every time.
you can store the index for later use, but keep in mind that the user might move effects around,
so make smart decisions.
wait. it gets worse.
now you want to affect a parameter on a different effect.
that can be done using streamRefs. these refer to the different parameters on all effects.
once you obtain the streamRef of a wanted parameter, you can read it or write to it.
to get a param's stream ref on an effect for which you already have an effectRef, you must know it's index in the effect. (for example, the "blurriness" on "gaussian blur" is 1 (never 0. zero is the input buffer))
the index is not always what it seems. there may be hidden params (and other stuff in the way).
the param index might change if the vendor of the other effect decides to change it.
in short:
yes, it's as complex as you feared it would be, and as you saw in the "projector" sample.

I don't understand how to use the volume control on the new iphone headphones

I just bought the new style earphones for my iphone and it has a new volume control -- how does it work? On the old one you just pushed up or down for volume control but now it just increases volume for the time you hold it down? Does anyone know how to use this properly?

I have had good success with the System Font Panel. Now all of a sudden, I only get part of it. Any suggestions on how to restore the entire panel? There are no change size options in the corners like in some dialog boxes. I was going to paste what I have here, but for some reason, paste is not available.

Trouble figuring out how to use Portrait mode.

I have a book that I have already contructed in paperback form and now I'm wanting to make it into an ibook using iBooks Author. My book was originally done in an 8x10 format so I'd like to contruct it in portrait mode. I would like to be able to make each page of my book to be the hight and width of the ipad sceen and no more. I would then like to be able to side swipe with my fingers in order to go to the next page, all in portrait mode, much like you would see if you had a PDF file loaded into your bookshelf.
My book is picture and design heavy and I'd need the formatting of the page to stick to its original design or close to it. I know the ipad screen isn't 8x10 and Id obviously have to do some reconstruction to make it look right on using the ipads dementions. For an example of the
The problem I'm running into with iBooks Author is it seems to be setup for landscape view only. When I try to use Portrait view it gives me this endles well, isolating the top portion of the page for the chapter reference. When I load it into my ipad, instead of being able to side swipe my fingers to change the page I have to just keep scrolling down. What am I doing wrong? How can I get it to work like a PDF would but actually be able to take advantage of all the iBook Author fatures like widgets, glossary, chapter selection, and such? Here is an azample of a page from my book. Is this type of book layout possible?

Thanks for the answer Ken. I'm going to try a different workaround. The global was too slow, and I think I'll break my subVI into two parts. I'll create a sub that has all the setup stuff in it, then embed the actual "check trigger status" loop in the main VI. The loop contains only 2 or 3 nodes. Too bad LabView works this way. I can see one reason it should, but another larger reason it shouldn't. Wishlist.... Oh, speaking of wishlist, I like the improvements that 6.0 has brought, but one thing still bugs me. There's no way to have LabView remember the place to look for files when it's first started. It defaults to "My Documents", which should be, as all LabView programers know "LabVIEW6\user.lib" (or whatever). Of course, once th
ere, LabView remembers for that session. Next time it's started, back to "My Documents" again. How 'bout fixing the "Options", "Path" settings so that it will actually remember the path set? Am I missing something here, or does it have anything to do with the fact that we're using Windows 98? My buddy's using NT, and his works the same. Is there a way around this? TIA, Rob.

How to use ColumnList MOde in Query Template

Hi,
I am working on SAP MII 11.5 and having trouble with SQL Query Template with Column List mode.
It is throughing an error "Enter a table Name.
Please help me in this regard

You will need to use the Group parameter with the table name.
<PARAM NAME="Group" VALUE="Employees">
You can also set it with javascript for interactive use that would emulate the Template Editor:
document.APPLET.getQueryObject().setGroup("Employees");

How to use batch file in window to send out Oracle AWR report automatically

Dear All
Please help me to write batch script as scheduler in windows to send out Oracle AWR report every 2 hours automatically
I have database 10.2.0.3 , its on windows platform .
Thanks in advance

846671 wrote:
Dear All
Please help me to write batch script as scheduler in windows to send out Oracle AWR report every 2 hours automatically
I have database 10.2.0.3 , its on windows platform .
Thanks in advancewhat utility do you use to "send out" Oracle AWR report ?

How to use Clamshell mode in windows 7 via bootcamp

I have a 15" MBP, on SL, running bootcamp for Windows 7. I need it for work, and doing mostly email and spread sheet. I have set up like this
---MONITOR 1 ------------- MONITOR 2 ----------- MACBOOK
( USB TO VGA) (DVI TO MINIDISPLAY)
I can extend my desktops to all three, and have made monitor 2 my "main desktop", and have changed power settings in the control panel for when i close the lid to "do nothing". Yet when I close the lid on the MacBook to store it away, it turns off monitor 2, and reverts monitor 1 as main display.
Any one else run into the same problem?
Side note: my nVidia control panel says my drivers are up to date, but the only option on the left side is "stereotopic 3D" no other settings

I have a 15" MBP, on SL, running bootcamp for Windows 7. I need it for work, and doing mostly email and spread sheet. I have set up like this
---MONITOR 1 ------------- MONITOR 2 ----------- MACBOOK
( USB TO VGA) (DVI TO MINIDISPLAY)
I can extend my desktops to all three, and have made monitor 2 my "main desktop", and have changed power settings in the control panel for when i close the lid to "do nothing". Yet when I close the lid on the MacBook to store it away, it turns off monitor 2, and reverts monitor 1 as main display.
Any one else run into the same problem?
Side note: my nVidia control panel says my drivers are up to date, but the only option on the left side is "stereotopic 3D" no other settings

How to use my time capsule on my new macbook pro retina (time machine error)

Hello all,
I've been using my old mac for a while with my time capsule, but recently I bought the new macbook pro retina and I wanted to use the time capsule as the backup disk on the new one. However, whenever I try to run the backup, a message appears "The backup disk image “/Volumes/Data/XXX’s MacBook.sparsebundle” is already in use."
I wanted to override the settings so that the new macbook will use the time capsule for its backup disk instead of the old one, as I will no longer be using it.
I was wondering if anyone had this problem before and if anyone know how I can solve it?
Thank you

You could delete the old backup from your old laptop? If you need to keep it then you need to rename that folder so that your new macbook can creatie its own file in the same name.
Regards,
Ryan

Using "bridge mode" to extend a network question

I had been using my TC as my only wireless router. I recently obtained FiOS service and they provided me with a router that is working just fine. That router is in the basement. The house is wired for internet so I connected the TC upstairs thinking I could use it to extend the signal.
I put it in bridge mode but even when I'm in the same room my connecting devices don't show a very strong wireless signal. I'm wondering if I've set it up correctly.
I noticed when I go into the airport utility that wireless mode is turned off. Is this correct for what I'm trying to do?
If I turn on the option to "extend a wireless network) I'm not sure if I'm supposed to enter the name of the network currently assigned to my other router. A password is pre-filled in there it looks like but perhaps that from when I used to the TC by itself.
Under the "internet" tab, I have "connection sharing" set to "off-bridge mode." I think that's correct, yes?
Thanks.

Bridge mode is the correct setting for Connection Sharing on your TC, but you need to configure your wireless on the TC to "Create a wireless network" with the exact same name (SSID), security and password that the FIOS router is using. This will, in effect, expand your network. Your laptop will automatically connect to the device with the strongest signal as you move around the house. This is known as a "roaming" network, and it is the basic network design behind most commercial wireless installations.
The "extend a wireless network" setting is only used if you have another Apple "n" router as your main base station and you want to expand the network using wireless only, not ethernet. The "extend" setting would not be compatible with any of the FIOS routers, so you would not be able to use this setting on your network.

Computer crash - how to use ipod to transfer songs to new computer?

DD's computer crashed last week - now has a new computer. We need to get songs from 20 G color/photo ipod onto new computer. Apple help pages only seem to give you options using your old computer to set ipod to transfer music. Can anyone direct us to information on getting ipod linked to new computer and transfering music over?

Connect your iPod to your computer. If it is set to update automatically you'll get a message that it is linked to a different library and asking if you want to link to this one and replace all your songs etc, press "Cancel". Pressing "Erase and Sync" will irretrievably remove all the songs from your iPod. Your iPod should appear in the iTunes source list from where you can change the update setting to manual and use your iPod without the risk of accidentally erasing it. Also when using a lot of the utilities your iPod needs to be enabled for disc use, changing to manual update will do this by default. Check the "manually manage music and videos" box in Summary then press the Apply button: Managing content manually on iPod
Once you are safely connected there are a few things you can do to restore your iTunes from the iPod. If you have any iTMS purchases the transfer of purchased content from the iPod to authorised computers was introduced with iTunes 7. A paragraph on it has been added to this article: Transfer iTunes Store purchases using iPod
The transfer of non iTMS content such as songs imported from CD is designed by default to be one way from iTunes to iPod. However there is a manual method of accessing the iPod's hard drive and copying songs back to iTunes on Windows. The procedure is a bit involved and was written long before iTunes 7 so it requires a little adaptation, also it won't recover playlists but if you're interested it's posted in this thread: MacMuse - iPod to iTunes
If you prefer something more automated then there are a number of third party utilities that you can use to retrieve the music files and playlists from your iPod. This is just a selection, you'll find that they have varying degrees of functionality and some will transfer movies, videos, photos and games as well. Have a look at the web pages and documentation, they are generally quite straightforward. You can also read reviews of some of them here: Wired News - Rescue Your Stranded Tunes
YamiPod Mac and Windows Versions
iGadget Windows Only
iPod Access Mac and Windows Versions
PodUtil Mac and Windows Versions
iPodCopy Mac and Windows Versions
TuneJack Windows Only
CopyPod Windows Only
Whichever of these retrieval methods you choose, keep your iPod in manual mode until you have reloaded your iTunes and you are happy with your playlists etc then it will be safe to return it auto-sync. I would also advise that you get yourself an external hard drive and back your stuff up in case you have problems again. External drives are comparatively inexpensive these days and you can get loads of storage for a reasonable outlay.

How to use batch mode in cq dam - new questions added

Similar Messages

Maybe you are looking for