Best approach to archival of large databases?

I have a large database (~300 gig) and have a data/document retention requirement that requires me to take a backup of the database once every six months to be retained for 5 years. Other backups only have to be retained as long as operationally necessary, but twice a year, I need these "reference" backups to be available, should we need to restore the data for some reason - usually historical research for data that extends beyond what's currently in the database.
What is the best approach for making these backups? My initial response would be to do a full export of the database, as this frees me from any dependencies on software versions, etc. However, an export takes a VERY long time. I can manage it by doing concurrent multiple exports by tablespace - this is able to be completed in < 1 day. Or I can back up the software directory + the database files in a cold backup.
Or is RMAN well-suited for this? So far, I've only used RMAN for my operational-type backups - for short-term data recovery needs.
What are other people doing?

Thanks for your input. How would I do this? My largest table is in monthly partitions each in its own tablespace. Would the process have to be something like: alter table exchange partition-to-be-rolled-off with non-partitioned-table; then export that tablespace?

Similar Messages

What is the best approach to return Large data from Stored Procedure ?

no answers to my original post, maybe better luck this time, thanks!
We have a stored proc (Oracle 8i) that:
1) receives some parameters.
2)performs computations which create a large block of data
3) return this data to caller.
compatible with both ASP (using MSDAORA.Oracle), and ColdFusion (using Oracle ODBC driver). This procedure is critical in terms of performance.
I have written this procedure as having an OUT param which is a REF CURSOR to a record containing a LONG. In order to make this work, at the end of the procedure I have to store the working buffer (an internal LONG variable) into a temp table, and then open the cursor as a SELECT from the temp table.
I have tried to open the cursor as a SELECT of the working buffer (from dual) but I get the error "ORA-01460: unimplemented or unreasonable conversion requested"
I suspect this is taking too much time; any tips about the best approach here? is there a resource with REAL examples on returning large data?
If I switch to CLOB, will it speed the process, be compatible with callers, etc ? all references to CLOB I saw use trivial examples.
Thanks for any help,
Yoram Ayalon

Create a new farm in the secondary Data Center at the same patch level with the desired configuration. Replicate the databases using the method of choice (Mirroring, AlwaysOn, etc.). Create a downtime window where you can then attach the databases to the
new farm's Web Application(s)/Service Application(s).
Trevor Seward
Follow or contact me at...
&nbsp&nbsp
This post is my own opinion and does not necessarily reflect the opinion or view of Microsoft, its employees, or other MVPs.

Best approach to return Large data ( 4K) from Stored Proc

We have a stored proc (Oracle 8i) that:
1) receives some parameters.
2)performs computations which create a large block of data
3) return this data to caller.
compatible with both ASP (using MSDAORA.Oracle), and ColdFusion (using Oracle ODBC driver). This procedure is critical in terms of performance.
I have written this procedure as having an OUT param which is a REF CURSOR to a record containing a LONG. In order to make this work, at the end of the procedure I have to store the working buffer (an internal LONG variable) into a temp table, and then open the cursor as a SELECT from the temp table.
I have tried to open the cursor as a SELECT of the working buffer (from dual) but I get the error "ORA-01460: unimplemented or unreasonable conversion requested"
I suspect this is taking too much time; any tips about the best approach here? is there a resource with REAL examples on returning large data?
If I switch to CLOB, will it speed the process, be compatible with callers, etc ? all references to CLOB I saw use trivial examples.
Thanks for any help,
Yoram Ayalon

We have a stored proc (Oracle 8i) that:
1) receives some parameters.
2)performs computations which create a large block of data
3) return this data to caller.
compatible with both ASP (using MSDAORA.Oracle), and ColdFusion (using Oracle ODBC driver). This procedure is critical in terms of performance.
I have written this procedure as having an OUT param which is a REF CURSOR to a record containing a LONG. In order to make this work, at the end of the procedure I have to store the working buffer (an internal LONG variable) into a temp table, and then open the cursor as a SELECT from the temp table.
I have tried to open the cursor as a SELECT of the working buffer (from dual) but I get the error "ORA-01460: unimplemented or unreasonable conversion requested"
I suspect this is taking too much time; any tips about the best approach here? is there a resource with REAL examples on returning large data?
If I switch to CLOB, will it speed the process, be compatible with callers, etc ? all references to CLOB I saw use trivial examples.
Thanks for any help,
Yoram Ayalon

How can we suggest a new DBA OCE certification for very large databases?

How can we suggest a new DBA OCE certification for very large databases?
What web site, or what phone number can we call to suggest creating a VLDB OCE certification.
The largest databases that I have ever worked with barely over 1 Trillion Bytes.
Some people told me that the results of being a DBA totally change when you have a VERY LARGE DATABASE.
I could guess that maybe some of the following topics of how to configure might be on it,
* Partitioning
* parallel
* bigger block size - DSS vs OLTP
* etc
Where could I send in a recommendation?
Thanks Roger

I wish there were some details about the OCE data warehousing.
Look at the topics for 1Z0-515. Assume that the 'lightweight' topics will go (like Best Practices) and that there will be more technical topics added.
Oracle Database 11g Data Warehousing Essentials | Oracle Certification Exam
Overview of Data Warehousing
Describe the benefits of a data warehouse
Describe the technical characteristics of a data warehouse
Describe the Oracle Database structures used primarily by a data warehouse
Explain the use of materialized views
Implement Database Resource Manager to control resource usage
Identify and explain the benefits provided by standard Oracle Database 11g enhancements for a data warehouse
Parallelism
Explain how the Oracle optimizer determines the degree of parallelism
Configure parallelism
Explain how parallelism and partitioning work together
Partitioning
Describe types of partitioning
Describe the benefits of partitioning
Implement partition-wise joins
Result Cache
Describe how the SQL Result Cache operates
Identify the scenarios which benefit the most from Result Set Caching
OLAP
Explain how Oracle OLAP delivers high performance
Describe how applications can access data stored in Oracle OLAP cubes
Advanced Compression
Explain the benefits provided by Advanced Compression
Explain how Advanced Compression operates
Describe how Advanced Compression interacts with other Oracle options and utilities
Data integration
Explain Oracle's overall approach to data integration
Describe the benefits provided by ODI
Differentiate the components of ODI
Create integration data flows with ODI
Ensure data quality with OWB
Explain the concept and use of real-time data integration
Describe the architecture of Oracle's data integration solutions
Data mining and analysis
Describe the components of Oracle's Data Mining option
Describe the analytical functions provided by Oracle Data Mining
Identify use cases that can benefit from Oracle Data Mining
Identify which Oracle products use Oracle Data Mining
Sizing
Properly size all resources to be used in a data warehouse configuration
Exadata
Describe the architecture of the Sun Oracle Database Machine
Describe configuration options for an Exadata Storage Server
Explain the advantages provided by the Exadata Storage Server
Best practices for performance
Employ best practices to load incremental data into a data warehouse
Employ best practices for using Oracle features to implement high performance data warehouses

What are the best approaches for mapping re-start in OWB?

What are the best approaches for mapping re-start in OWB?
We are using OWB repository 10.2.0.1.0 and OWB client 10.2.0.1.31. The Oracle version is 10 G (10.2.0.3.0). OWB is installed on Linux.
We have number of mappings. We built process flows for mappings as well.
I like to know, what are the best approches to incorportate re-start options in our process. ie a failure of mapping in process flow.
How do we re-cycle failed rows?
Are there any builtin features/best approaches in OWB to implement the above?
Does runtime audit tables help us to build re-start process?
If not, do we need to maintain our own tables (custom) to maintain such data?
How did our forum members handled above situations?
Any idea ?
Thanks in advance.
RI

Hi RI,
How many mappings (range) do you have in a process flows?Several hundreds (100-300 mappings).
If we have three mappings (eg m1, m2, m3) in process flow. What will happen if m2 fails?Suppose mappings connected sequentially (m1 -> m2 -> m3). When m2 fails then processflow is suspended (transition to m3 will not be performed). You should obviate cause of error (modify mapping and redeploy, correct data, etc) and then repeat m2 mapping execution from Workflow monitor - open diagram with processflow, select mapping m2 and click button Expedite, choose option Repeat.
In re-start, will it run m1 again and m2 son on, or will it re-start at row1 of m2?You can specify restart point. "at row1 of m2" - I don't understand what you mean (all mappings run in Set based mode, so in case of error all table updates will rollback,
but there are several exception - for example multiple target tables in mapping without corelated commit, or error in post-mapping - you must carefully analyze results of error).
What will happen if m3 fails?Process is suspended and you can restart execution from m3.
By having without failover and with max.number of errors=0, you achieve re-cycle failed rows to zero (0).This settings guarantee existence only two return result of mapping - SUCCSES or ERROR.
What is the impact, if we have large volume of data?In my opinion for large volume Set based mode is the prefered processing mode of data processing.
With this mode you have full range enterprise features of Oracle database - parallel query, parallel DML, nologging, etc.
Oleg

Best approach to do Range partitioning on Huge tables.

Hi All,
I am working on 11gR2 oracle 3node RAC database. below are the db details.
SQL> select * from v$version;
BANNER
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
PL/SQL Release 11.2.0.3.0 - Production
CORE 11.2.0.3.0 Production
TNS for Linux: Version 11.2.0.3.0 - Production
NLSRTL Version 11.2.0.3.0 - Production
in my environment we have 10 big transaction (10 billion rows) tables and it is growing bigger and bigger. Now the management is planning to do a range partition based on created_dt partition key column.
We tested this partitioning startegy with few million record in other environment with below steps.
1. CREATE TABLE TRANSACTION_N
PARTITION BY RANGE ("CREATED_DT")
( PARTITION DATA1 VALUES LESS THAN (TO_DATE(' 2012-08-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART1,
PARTITIONDATA2 VALUES LESS THAN (TO_DATE(' 2012-09-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART2,
PARTITION DATA3 VALUES LESS THAN (TO_DATE(' 2012-10-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART3
as (select * from TRANSACTION where 1=2);
2. exchange partion for data move to new partition table from old one.
ALTER TABLE TRANSACTION_N
EXCHANGE PARTITION DATA1
WITH TABLE TRANSACTION
WITHOUT VALIDATION;
3. create required indexes (took almost 3.5 hrs with parallel 16).
4. Rename the table names and drop the old tables.
this took around 8 hrs for one table which has 70 millions of records, then for billions of records it will take more than 8 hrs. But the problem is we get only 2 to 3 hrs of down time in production to implement these change for all tables.
Can you please suggest the best approach i can do, to copy that much big data from existing table to the newly created partitioned table and create required indexes.
Thanks,
Hari

>
in my environment we have 10 big transaction (10 billion rows) tables and it is growing bigger and bigger. Now the management is planning to do a range partition based on created_dt partition key column.
We tested this partitioning startegy with few million record in other environment with below steps.
1. CREATE TABLE TRANSACTION_N
PARTITION BY RANGE ("CREATED_DT")
( PARTITION DATA1 VALUES LESS THAN (TO_DATE(' 2012-08-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART1,
PARTITIONDATA2 VALUES LESS THAN (TO_DATE(' 2012-09-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART2,
PARTITION DATA3 VALUES LESS THAN (TO_DATE(' 2012-10-01 00:00:00', 'YYYY-MM-DD HH24:MI:SS') ) TABLESPACE &&TXN_TAB_PART3
as (select * from TRANSACTION where 1=2);
2. exchange partion for data move to new partition table from old one.
ALTER TABLE TRANSACTION_N
EXCHANGE PARTITION DATA1
WITH TABLE TRANSACTION
WITHOUT VALIDATION;
3. create required indexes (took almost 3.5 hrs with parallel 16).
4. Rename the table names and drop the old tables.
this took around 8 hrs for one table which has 70 millions of records, then for billions of records it will take more than 8 hrs. But the problem is we get only 2 to 3 hrs of down time in production to implement these change for all tables.
Can you please suggest the best approach i can do, to copy that much big data from existing table to the newly created partitioned table and create required indexes.
>
Sorry to tell you but that test and partitioning strategy is essentially useless and won't work for you entire table anyway. One reasone is that if you use the WITHOUT VALIDATION clause you must ensure that the data being exchanged actually belongs to the partition you are putting it in. If it doesn't you won't be able to reenable or rebuild any primary key or unique constraints that exist on the table.
See Exchanging Partitions in the VLDB and Partitioning doc
http://docs.oracle.com/cd/E18283_01/server.112/e16541/part_admin002.htm#i1107555
>
When you specify WITHOUT VALIDATION for the exchange partition operation, this is normally a fast operation because it involves only data dictionary updates. However, if the table or partitioned table involved in the exchange operation has a primary key or unique constraint enabled, then the exchange operation is performed as if WITH VALIDATION were specified to maintain the integrity of the constraints.
If you specify WITHOUT VALIDATION, then you must ensure that the data to be exchanged belongs in the partition you exchange.
>
Comments below are limited to working with ONE table only.
ISSUE #1 - ALL data will have to be moved regardless of the approach used. This should be obvious since your current data is all in one segment but each partition of a partitioned table requires its own segment. So the nut of partitioning is splitting the existing data into multiple segments almost as if you were splitting it up and inserting it into multiple tables, one table for each partition.
ISSUE#2 - You likely cannot move that much data in the 2 to 3 hours window that you have available for down time even if all you had to do was copy the existing datafiles.
ISSUE#3 - Even if you can avoid issue #2 you likely cannot rebuild ALL of the required indexes in whatever remains of the outage windows after moving the data itself.
ISSUE#4 - Unless you have conducted full volume performance testing in another environment prior to doing this in production you are taking on a tremendous amount of risk.
ISSUE#5 - Unless you have fully documented the current, actual execution plans for your most critical queries in your existing system you will have great difficulty overcoming issue #4 since you won't have the requisite plan baseline to know if the new partitioning and indexing strategies are giving you the equivalent, or better, performance.
ISSUE#6 - Things can, and will, go wrong and cause delays no matter which approach you take.
So assuming you plan to take care of issues #4 and #5 you will probably have three viable alternatives:
1. use DBMS_REDEFINITION to do the partitioning on-line. See the Oracle docs and this example from oracle-base for more info.
Redefining Tables Online - http://docs.oracle.com/cd/B28359_01/server.111/b28310/tables007.htm
Partitioning an Existing Table using DBMS_REDEFINITION
http://www.oracle-base.com/articles/misc/partitioning-an-existing-table.php
2. do the partitioning offline and hope that you don't exceed your outage window. Recover by continuing to use the existing table.
3. do the partitioning offline but remove the oldest data to minimize the amount of data that has to be worked with.
You should review all of the tables to see if you can remove older data from the current system. If you can you could use online redefinition that ignores older data. Then afterwards you can extract this old data from the old table for archiving.
If the amount of old data is substantial you can extract the new data to a new partitioned table in parallel and not deal with the old data at all.

What is the best approach to handle multiple FK with single table.

If two tables are joined with each other with more than one ways, for example
MAIN table is (col1, col2,....coln, person_creator_id, person_modifier_id)
PERSON table is (person_id, name, address,........ phone) etc
At database level PERSON_CREATOR_FK and PERSON_MODIFIER_FK are defined.
Objective is to create a report that shows
col1, col2...coln, person creator name, person modifier name
If above two objects are imported with FKs in a EUL and discoverer plus is used to create above report. On first inclusion of person name discoverer plus will ask you to pick the join (provided the checkbox to disable this feature is not checked). Once you pick 'person creator' join it will never allow you to pick person modifier name.
One solution is two create a custom folder with query like
select col1, col2,...coln,
pc.name, pc.address,.... pc.phone
pm.name, pm.address,.... pm.phone
from main m,
person pc,
person pm
where m.person_id_creator = pc.person_id
and m.person_id_modifier = pm.person_id
Second solution is to import the PERSON folder twice in EUL (optionally named one as perosn_creator and other as person_modifier) and manually define one join per table. i.e. join MAIN with PERSON_CREATOR on person_creator_fk and join MAIN with PERSON_MODIFIER table using person_modifier_fk.
Now discoverer plus will let you drag Name from each person folder without needing to resolve multiple joins.
Question is, what approach is better OR is there a better way?
With solution 1 you will not be able to use functions on folder items.
With solution 2 there is a EUL design overhead of including same object multiple times and then manually defining all join (or deleting unwanted joins), and this could be a problem when you have person_modifier and person_creator in nearly all tables. It could be more complicated if person table is further linked other tables and users want to see that information too. (for instance, if person address is stored in LOCATION table joined with location_id and user want to see both creator address and modifier address....now you will have to create multiple LOCATION folders).
A third solution could be to register a function in discoverer that return person name when person_id is passed. This will work perfectly for above requirement but a down side is the report will run slower if they need filters on person names (then function will be used in where clause). Also, this solution is very specific to above scenario, it will not work if you want the report developer the freedom to pick any attribute from person table (lets say, person table contain 50 attributes then its not a good idea to register 50 functions).
Any comments/suggestion will be appreciated.
thanks

Hi
In a roundabout way you have really answered your own question :-)
In my opinion, the best approach, although by all means not the only approach - see below) would be to have the object loaded as two folders with one join going to the first folder and the second join to the other folder. You would of course name the folders appropriately.
Here's a workflow that I use all of the time and one that I teach when I'm giving Discoverer Administrator training. It might help you:
1. Bring in the PERSON folder to begin with
2. Make all necessary adjustments to bring it up to deployment standard. These adjustments would be: folder name (E.g PERSON_CREATOR), item names, item placement, default positions, default aggregation and so on.
3. Create or assign the required lists of values
4. Create any required calculations
5. Create any required conditions
6. Create the first join from this folder to MAIN.
7. Click on the heading for the folder and press CTRL-C.
8. Click on the heading for the business area and press CTRL-V. A second copy of the folder, complete with all of the adjustments you made earlier will be inserted into the business area.
Note: joins are not copied, everything else is.
9. Rename this folder to say PERSON_MODIFIED
10. Rename the items as appropriate
11. Add a join from this folder to MAIN - you're done
Other ideas that I have used and work well would be to use a database view or create a complex folder. Either will work, In both cases you would need to join on some other column other than the ones you referred earlier.
I hope this helps
Best wishes
Michael

Best approach for IDOC - JDBC scenario

Hi,
In my scenarion I am creating sales order(ORDERS04) in R/3 system and which need to be replicated in a SQL Server system. I am sending the order to XI as an IDoc and want to use JDBC for sending data to SQL Server. I need to insert data in two tables(header & details). Is it possible without BPM? Or what is the best approach for this?
Thanks,
Sri.

Yes, this is possible without the BPM.
Just create the Corresponding Datatype for the insertion.
if the records to be inserted are different, then there wil be 2 different datatypes ( one for header and one for detail).
Do a mutlimapping, where your Source is mapped into the header and details datatype and then send using the JDBC sender adapter.
For the strucutre of your Datatype for insertion , just check this link,
http://help.sap.com/saphelp_nw04/helpdata/en/7e/5df96381ec72468a00815dd80f8b63/content.htm
To access any Database from XI, you will have to install the corresponding Driver on your XI server.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3867a582-0401-0010-6cbf-9644e49f1a10
Regards,
Bhavesh

Best practices to reduce downtime for Database releases(rolling changes)

Hi,
What are best practices to reduce downtime for database releases on 10.2.0.3? What DB changes can be rolling and what can't?
Thanks in advance.
Regards,
RJiv.

I would be very dubious about any sort of universal "best practices" here. Realistically, your practices need to be tailored to the application and the environment.
You can invest a lot of time, energy, and resources into minimizing downtime if that is the only goal. But you'll generally pay for that goal in terms of developer and admin time and effort, environmental complexity, etc. And you generally need to architect your application with rolling upgrades in mind, which necessitates potentially large amounts of redesign to existing applications. It may be perfectly acceptable to go full-bore into minimizing downtime if you are running Amazon.com and any downtime is unacceptable. Most organizations, however, need to balance downtime against other needs.
For example, you could radically minimize downtime by having a second active database, configuring Streams to replicate changes between the two master databases, and configure the middle tier environment so that you can point different middle tier servers against one or the other database. When you want to upgrade, you point all the middle tier servers against database A other than 1 that lives on a special URL. You upgrade database B (making sure to deal with the Streams replication environment properly depending on requirements) and do the smoke test against the special URL. When you determine that everything works, you configure all the app servers to point at B and have Streams replication process configured to replicate changes from the old data model to the new data model), upgrade B, repeat the smoke test, and then return the middle tier environment to the normal state of balancing between databases.
This lets you upgrade with 0 downtime. But you've got to license another primary database. And configure Streams. And write the replication code to propagate the changes on B during the time you're smoke testing A. And you need the middle tier infrastructure in place. And you're obviously going to be involving more admins than you would for a simpler deploy where you take things down, reboot, and bring things up. The test plan becomes more complicated as well since you need to practice this sort of thing in lower environments.
Justin

What's the best approach to resetting Calendar data on Server?

I have a database format error in a calendar that I only noticed after the migration to Server on Yosemite. I'll paste a snippet from the Error Log in at the bottom that shows the error - I've highlighted the description of the problem in red.
I found a pretty cool writeup from Linc in a different thread, but it's aimed at fixing a similar problem for a local user on their own machine rather that an iCal server like what we're running. Here's the link to that thread: Re: Calendar crashes on open For example, does something like Calendar Cleaner work on our server database as well?
In my case I think I'd basically like to gracefully remove all the Calendar databases from Server and start fresh (all the users' calendars are backed up on their local machines, so they can just import them into fresh/empty calendars once I've cleaned out the old stuff). Any thoughts on "best approach" would be much appreciated.
Here's the error log...
File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 1099, in _inlineCallbacks
2015-01-31 07:14:41-0600 [-] [caldav-0]         result = g.send(result)
2015-01-31 07:14:41-0600 [-] [caldav-0]       File "/Applications/Server.app/Contents/ServerRoot/Library/CalendarServer/lib/python 2.7/site-packages/txdav/caldav/datastore/sql.py", line 3635, in component
2015-01-31 07:14:41-0600 [-] [caldav-0]         e, self._resourceID
2015-01-31 07:14:41-0600 [-] [caldav-0]     txdav.common.icommondatastore.InternalDataStoreError: Data corruption detected (Invalid property: GEO:33.4341666667\\;-112.008055556
2015-01-31 07:14:41-0600 [-] [caldav-0]     BEGIN:VCALENDAR
2015-01-31 07:14:41-0600 [-] [caldav-0]     VERSION:2.0
2015-01-31 07:14:41-0600 [-] [caldav-0]     CALSCALE:GREGORIAN
2015-01-31 07:14:41-0600 [-] [caldav-0]     PRODID:-//Apple Inc.//Mac OS X 10.8.2//EN
2015-01-31 07:14:41-0600 [-] [caldav-0]     BEGIN:VEVENT
2015-01-31 07:14:41-0600 [-] [caldav-0]     UID:[email protected]
2015-01-31 07:14:41-0600 [-] [caldav-0]     DTSTART:20121114T215900Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     DTEND:20121114T232700Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     CLASS:PUBLIC
2015-01-31 07:14:41-0600 [-] [caldav-0]     CREATED:20121108T123850Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     DESCRIPTION:Flight leg 2 of 2 for trip from MSP to LAX\\nhttp://www.google.
2015-01-31 07:14:41-0600 [-] [caldav-0]      com/search?q=US+29+flight+status\\nBooked on November 8\\, 2012\\n
2015-01-31 07:14:41-0600 [-] [caldav-0]     DTSTAMP:20121114T210756Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     GEO:33.4341666667\\;-112.008055556
2015-01-31 07:14:41-0600 [-] [caldav-0]     LAST-MODIFIED:20121108T123850Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     LOCATION:Sky Harbor International Airport\\, Phoenix\\, AZ
2015-01-31 07:14:41-0600 [-] [caldav-0]     SEQUENCE:0
2015-01-31 07:14:41-0600 [-] [caldav-0]     STATUS:CONFIRMED
2015-01-31 07:14:41-0600 [-] [caldav-0]     SUMMARY:US 29 from PHX to LAX
2015-01-31 07:14:41-0600 [-] [caldav-0]     URL:http://www.hipmunk.com/flights/MSP-to-LAX#!dates=Nov14,Nov17&group=1&s
2015-01-31 07:14:41-0600 [-] [caldav-0]      elected_flights=96f6fbfd91,be8b5c748d;kind=flight&locations=MSP,LAX&dates=
2015-01-31 07:14:41-0600 [-] [caldav-0]      Nov14,Nov16&group=1&selected_flights=96f6fbfd91,
2015-01-31 07:14:41-0600 [-] [caldav-0]     END:VEVENT
2015-01-31 07:14:41-0600 [-] [caldav-0]     BEGIN:X-CALENDARSERVER-PERUSER
2015-01-31 07:14:41-0600 [-] [caldav-0]     UID:[email protected]
2015-01-31 07:14:41-0600 [-] [caldav-0]     X-CALENDARSERVER-PERUSER-UID:D0737009-CBEE-4251-A288-E6FCE5E00752
2015-01-31 07:14:41-0600 [-] [caldav-0]     BEGIN:X-CALENDARSERVER-PERINSTANCE
2015-01-31 07:14:41-0600 [-] [caldav-0]     TRANSP:OPAQUE
2015-01-31 07:14:41-0600 [-] [caldav-0]     BEGIN:VALARM
2015-01-31 07:14:41-0600 [-] [caldav-0]     ACKNOWLEDGED:20121114T210756Z
2015-01-31 07:14:41-0600 [-] [caldav-0]     ACTION:AUDIO
2015-01-31 07:14:41-0600 [-] [caldav-0]     ATTACH:Basso
2015-01-31 07:14:41-0600 [-] [caldav-0]     TRIGGER:-PT2H
2015-01-31 07:14:41-0600 [-] [caldav-0]     UID:040C4AB7-EF30-4F0C-9D46-6A85C7250444
2015-01-31 07:14:41-0600 [-] [caldav-0]     X-APPLE-DEFAULT-ALARM:TRUE
2015-01-31 07:14:41-0600 [-] [caldav-0]     X-WR-ALARMUID:040C4AB7-EF30-4F0C-9D46-6A85C7250444
2015-01-31 07:14:41-0600 [-] [caldav-0]     END:VALARM
2015-01-31 07:14:41-0600 [-] [caldav-0]     END:X-CALENDARSERVER-PERINSTANCE
2015-01-31 07:14:41-0600 [-] [caldav-0]     END:X-CALENDARSERVER-PERUSER
2015-01-31 07:14:41-0600 [-] [caldav-0]     END:VCALENDAR
2015-01-31 07:14:41-0600 [-] [caldav-0]     ) in id: 3405
2015-01-31 07:14:41-0600 [-] [caldav-0]
2015-01-31 07:16:39-0600 [-] [caldav-1] [-] [txdav.common.datastore.sql#error] Transaction abort too long: PG-TXN</Applications/Server.app/Contents/ServerRoot/Library/CalendarServer/lib/ python2.7/site-packages/calendarserver/tools/purge.py#1032$_cancelEvents>, Statements: 5, IUDs: 0, Statement: None
2015-01-31 08:08:40-0600 [-] [caldav-1] [AMP,client] [calendarserver.tools.purge#warn] Cleaning up future events for principal A95C9DB2-9757-46B2-ADF6-4DECE2728820 since they are no longer in directory
2015-01-31 08:09:10-0600 [-] [caldav-1] [-] [twext.enterprise.jobqueue#error] JobItem: 39, WorkItem: 762001 failed: ERROR: canceling statement due to statement timeout
2015-01-31 08:09:10-0600 [-] [caldav-1]
2015-01-31 08:13:40-0600 [-] [caldav-1] [-] [txdav.common.datastore.sql#error] Transaction abort too long: PG-TXN</Applications/Server.app/Contents/ServerRoot/Library/CalendarServer/lib/ python2.7/site-packages/calendarserver/tools/purge.py#1032$_cancelEvents>, Statements: 5, IUDs: 0, Statement: None

<facepalm> Well, there you go. It turns out I was over-thinking this. The Calendar app on a Mac can manage this database just fine. Sorry about that. There may be an easier way to do this, but here's how I did it.
Use the Calendar.app on a local computer to:
- Export the corrupted calendar to an ICS file on the local computer (Calendar -> File -> Export -> Export)
- Create a new local calendar (Calendar -> File -> New Calendar -> On My Mac)
- Import the corrupted calendar into the new/empty local calendar (Calendar -> File -> Import...)
- Delete years and years of old events, including the one that was triggering that error message
- Export the (now much smaller) local calendar to another ICS file on my computer (Calendar -> File -> Export -> Export)
- Create a new calendar on the server (Calendar -> File -> New Calendar -> in the offending server-based iCal account)
- Import the edited/fixed/smaller/no-longer-corrupted calendar into the new/empty server calendar (Calendar -> File -> Import...)
- Make the newly-created iCal calendar the primary calendar (drag it to the top of the list of calendars on the server)
- Delete the old/corrupted calendar (right-clicking on the bad calendar in the calendar list - you can only delete it once it's NOT the primary calendar any more)

Best way to organize a large photo library on a 10.6.8 Macbook?

I have an older Macbook pro- version 10.6.8.
I am looking for the best way to organize my large library of photos (approx. 15,000). I have both personal as well as professional photos that I would like to organize and keep separately. I currently use iPhoto'09 version 8.1.2 but it has become very slow and I would like to find a solution that uses better organization. I am considering keeping my personal photos in iPhoto and my professional photos in another organization app. I was thinking about purchasing Aperture, however it is only available for Mac OS X version 10.7.5 or later and the same goes for the latest version of iPhoto.
I am a little confused about what my options are. Can anyone recommend anything? I am looking simply for a good organization tool, I am not interested in photo editing or anything beyond that.

Well now we know that the speed problem is in your old library. Repair it.
Option 1
Back Up and try rebuild the library: hold down the command and option (or alt) keys while launching iPhoto. Use the resulting dialogue to rebuild. Choose to Repair Database. If that doesn't help, then try again, this time using Rebuild Database.
If that fails:
Option 2
Download iPhoto Library Manager and use its rebuild function. (In Library Manager it's the FIle -> Rebuild command)
This will create an entirely new library. It will then copy (or try to) your photos and all the associated metadata and versions to this new Library, and arrange it as close as it can to what you had in the damaged Library. It does this based on information it finds in the iPhoto sharing mechanism - but that means that things not shared won't be there, so no slideshows, books or calendars, for instance - but it should get all your events, albums and keywords, faces and places back.
Because this process creates an entirely new library and leaves your old one untouched, it is non-destructive, and if you're not happy with the results you can simply return to your old one.
Backing Up:
Time machine will back up, yes. Just be sure it's set up correctly.
Most Simple Back Up
Drag the iPhoto Library from your Pictures Folder to another Disk. This will make a copy on that disk.
Slightly more complex:
Use an app that will do incremental back ups. This is a very good way to work. The first time you run the back up the app will make a complete copy of the Library. Thereafter it will update the back up with the changes you have made. That makes subsequent back ups much faster. Many of these apps also have scheduling capabilities: So set it up and it will do the back up automatically. Examples of such apps: Chronosync or DejaVu . But are many others. Search on MacUpdate
Regards
TD

Best approach... TiledView or regular ViewBean

I'm wondering what approach would be best with JATO and the display
I'm trying to build on a JSP page. My page layout will look something
like this...
Checked Out Items: (none)
ToDo Items: 3 InfoDocs
2 Sun Alerts
Draft Items: (none)
My Docs: 345 InfoDocs
28 Sun Alerts
18 SRDB's
Now, this might get confusing so please ask questions if anything I
state is not clear. The values after the colons (:) (i.e. 3 InfoDocs,
2 Sun Alerts, etc) are dynamic. These values will be genereated off of
queries on a database. There could be more listings or there could be
the value (none). As far as setting this up through the JATO
framework, I'm trying to determine the best way to do this. Right now
I have a VoyagerHome.jsp that will represent the layout displayed
above. I also have a VoyagerHomeViewBean.java. At first I was thinking
of registering a Tiled View in this ViewBean but then I felt it didn't
make sense and wouldn't work out the way I wanted it to. So now I'm
thinking of registering the labels (Checked Out Items:, ToDo Items:,
Draft Items:, and My Docs:) as StaticTextFields within the
VoyagerHomeViewBean.
Then I think I would also need to make the values (3 InfoDocs, 2 Sun
Alerts, etc) children and make them HREF jato types. But I'm not sure
how I can do this when the numbers are going to be dynamic. Does this
make sense? One question I have is should I or do I have to register
each document type (InfoDoc,
Sun Alert, SRDB, etc) for each label grouping (Checked Out Items:,
ToDo Items:, etc). So for example, in the end, I will need place
holders for the following:
Checked Out Items: xxx InfoDocs
Checked Out Items: xxx Sun Alerts
Checked Out Items: xxx SRDBs
Checked Out Items: xxx Cobalt Assets
Checked Out Items: xxx iPlanet Assets
ToDo Items: xxx InfoDocs
ToDo Items: xxx Sun Alerts
ToDo Items: xxx SRDBs
ToDo Items: xxx Cobalt Assets
ToDo Items: xxx iPlanet Assets
same for Draft Items and My Docs....
This may seem confusing so please ask questions. In
other words, is there a way to re-use the HREF tags and run them
through a tiled view or something eventhough these values for the HREF
tags are going to be run off of different database tables?
What I'm trying to do is kinda difficult to explain but I hope you get
some idea of what I'm trying to accomplish.
Thanks
- Billy -

Best approach i can think of is a TiledView with HREFs for InfoDocs, Sun
Alerts etc. You can use a StaticTextField for the numbers in the
TiledView. ToDo Items, Draft Items etc. you can just label them in your
jsp itself, no need to register them as children.
Senthil
chubbykidd wrote:
I'm wondering what approach would be best with JATO and the display
I'm trying to build on a JSP page. My page layout will look something
like this...
Checked Out Items: (none)
ToDo Items: 3 InfoDocs
2 Sun Alerts
Draft Items: (none)
My Docs: 345 InfoDocs
28 Sun Alerts
18 SRDB's
Now, this might get confusing so please ask questions if anything I
state is not clear. The values after the colons (:) (i.e. 3 InfoDocs,
2 Sun Alerts, etc) are dynamic. These values will be genereated off of
queries on a database. There could be more listings or there could be
the value (none). As far as setting this up through the JATO
framework, I'm trying to determine the best way to do this. Right now
I have a VoyagerHome.jsp that will represent the layout displayed
above. I also have a VoyagerHomeViewBean.java. At first I was thinking
of registering a Tiled View in this ViewBean but then I felt it didn't
make sense and wouldn't work out the way I wanted it to. So now I'm
thinking of registering the labels (Checked Out Items:, ToDo Items:,
Draft Items:, and My Docs:) as StaticTextFields within the
VoyagerHomeViewBean.
Then I think I would also need to make the values (3 InfoDocs, 2 Sun
Alerts, etc) children and make them HREF jato types. But I'm not sure
how I can do this when the numbers are going to be dynamic. Does this
make sense? One question I have is should I or do I have to register
each document type (InfoDoc,
Sun Alert, SRDB, etc) for each label grouping (Checked Out Items:,
ToDo Items:, etc). So for example, in the end, I will need place
holders for the following:
Checked Out Items: xxx InfoDocs
Checked Out Items: xxx Sun Alerts
Checked Out Items: xxx SRDBs
Checked Out Items: xxx Cobalt Assets
Checked Out Items: xxx iPlanet Assets
ToDo Items: xxx InfoDocs
ToDo Items: xxx Sun Alerts
ToDo Items: xxx SRDBs
ToDo Items: xxx Cobalt Assets
ToDo Items: xxx iPlanet Assets
same for Draft Items and My Docs....
This may seem confusing so please ask questions. In
other words, is there a way to re-use the HREF tags and run them
through a tiled view or something eventhough these values for the HREF
tags are going to be run off of different database tables?
What I'm trying to do is kinda difficult to explain but I hope you get
some idea of what I'm trying to accomplish.
Thanks
- Billy -
To download the latest version of JATO, please visit:
http://www.sun.com/software/download/developer/5102.html
For more information about JATO, please visit:
http://developer.iplanet.com/tech/appserver/framework/index.jsp
[Non-text portions of this message have been removed]

Best approach for BI Rollout

Hi Gurus,
i am trying to understand how a sap BI Rollout is working
Scenario 1:
a BI System has been implemented e.g in England. Now a rollout should be done in france, spain etc...
1. should all keyigures and characteristics be global?
2. What about the case if each country has specific Keyfigures and cahracteristics?
3. If there are using common KF and charcteristics how about the master Data? Each country has a nother language.
Scenario 2.
All objects which have been implemented for the first country will be reimplemented for each following country.
Could someone please explain how is working or what is the best approach. If you also have a document, it will be great.
Thanks
Pat

I normally prefer saving images in LocalFolder and save file name in database table. I prefer this because saving just file name will keep size of SQLite database small so will load faster.
Gaurav Khanna | Microsoft .NET MVP | Microsoft Community Contributor

What´s the best approach to work with Excel, csv files

Hi gurus. I got a question for you. According to your experience what's the best approach to work with Excel or csv files that have to be uploaded through DataServices to you datawarehouse.
Let's say your end-user, who is not a programmer, creates a group of 4 excel files with different calculations in a monthly basis, so they can generate a set of reports from their datawarehouse once the files have been uploaded to tables in your DWH. The calculations vary from month to month. The user doesn't have a front-end to upload the excel files directly to Data Services. The end user needs to keep a track of which person uploaded the files for a determined month.
1. The end user should place their 4 excel files in a shared directory that will be seen by DataServices.
2. DataServices will execute certain scheduled job that will read the four files and upload them to the Datawarehouse at a determined time, lets say at 9:00pm.
It makes me wonder... what happens if the user needs to present their reports immediately so they can´t wait until 9:00pm. Is it possible for the end user to execute some kind of action (out of the DataServices Environment) so DataServices "could know" that it has to process those files right now, instead of waiting for the night schedule?
Is there a way that DS will track who was the person who uploaded those files?
Would it be better to build a front-end for the end user so they can upload their four files directlyto the datawarehouse?
Waiting for your comments to resolve this dilemma
Best Regards
Erika

Hi,
There are functions in DS that captures the input files automatically. You could use file_exists() or wait_for_file() option to do that. Schedule the job to run every certain minute and if the file exists then run. This could be done by using a certain file name with date and timestamp etc or after running move the old files to archive and DS wait for new files to show up.
Check this - Selective Reading and Postprocessing - Enterprise Information Management - SCN Wiki
Hope this helps.
Arun

What is best approach to report building in my case?

Hi all,
I'm just getting started with Crystal Reports for our Swing-based desktop application. We need the ability to generate PDF and XLS reports, perhaps later adding web-based dashboarding and interactive reports. I'm trying to determine the best approach to take with Crystal Reports to fit our application's data.
Our app stores results in a separate database (either Oracle, SQLServer, or Apache Derby). The result records contain lots of ID lookups to tables in another database. This makes using straight SQL for reporting difficult as I would like to avoid cross-database queries. So I'm thinking of using the POJO reporting approach where our app gathers the results, generates POJOs, and then passes them to the report.
My concern with this POJO approach is that it seems to require loading all results into memory and generating the report in one big step. I've read other posts referring to heap issues. Is there a way to avoid this? Some-how to page through report data?
I've also read that Crystal Reports can work with any data provider that implements ResultSet. Is this true? If so, could I create my own custom ResultSet implementation that would let me page through my results without loading everything into memory at-once? If possible, please point me to the documentation for this approach. I haven't been able to find any examples.
If there is a better approach that I haven't mentioned, please let me know.
Thanks in advance,
Guy

The first option is the best one for performance. The only time you should use result sets is when you need to do runtime manipulation of the data through your application and is not acheivable in a stored procedure.

Best approach to archival of large databases?

Similar Messages

Maybe you are looking for