LMS 3.2 Data purge

Hello Dear's
We have installed CS 3.2 and RME on 1 server on C: Drive. Now the problem is C: Drive is full with MB of space behind, when i went through the Cisco Works folder i found location CSCOpx/files/rme/syslogpurgeddata files are occupying space in GB so i planning to delete these files,
My concern is if i m deleting these files is it will crashed my CS and RME.??????????? AND these files are just the sylogs which have been received by devices????? Correct me if i m wrong
Thanks

you are correct, syslogfirst.db,syslogsecond.db and syslogthird.db are files you should never delete manually and you need to contact TAC to get the procedure and the necessary java file to reclaim the diskspace.
But like Afroj mentioned it is save to delete the files in NMSROOT/files/rme/syslogpurgeddata
syslog consumes a lot of disk space when a lot of messages are coming in.. Firewall logging send to the syslog server could be a reason as well as roaming messages from wireless APs - or it is just the "normal" behaviour - it depends on the network.
Reinitialization of RME will removes all data from RME - like device configuration, inventory all your RME jobs and all historical data. I definitely would prefer contacting TAC.
But if you have set syslog purge to 7 days from the beginning I assume the amount of your syslog messages is huge and if that is truth I doubt that you could reduce the size of syslogfirst.db, etc.
What is the size of these files?/files/rme/syslogpurgeddata?
[edit]
as far as I know DBSpaceReclaimer.class is included in LMS 3.2 - but currently I cannot verfy it. It will remove the three dataspaces (syslogfirst.db, etc.) and - if I remember well it - will also whipe out the current content of the RME syslog db
the header of this thread mention LMS 3.2 but in your last post you wrote CS 3.2 RME 4.2 - both are LMS 3.1 - verify your version under Common Services > Software Center > Software Update; an overview of all LMS applications and versions can be found here: Cisco Works - Appliccations and Versions -

Similar Messages

LOG_FILE_NOT_FOUND when running cleaner manually after some data purge

I hit LOG_FILE_NOT_FOUND error when running cleaner manually after some data purge, I searched the forum, found someone also faced the same issue before, but cannot find any clue on how to fix it. Below is the error trace and followed by our configurations
Caused by: com.sleepycat.je.EnvironmentFailureException: (JE 4.1.6)
Environment must be closed, caused by:
com.sleepycat.je.EnvironmentFailureException: Environment invalid because of
previous exception: (JE 4.1.6) /scratch/tie/thirdeye/index/data-store
fetchTarget of 0x50f/0x3fb9dd6 parent IN=368491717 IN
class=com.sleepycat.je.tree.IN lastFullVersion=0x510/0x2ca7d18
parent.getDirty()=false state=0 LOG_FILE_NOT_FOUND: Log file missing, log is
likely invalid. Environment is invalid and must be closed.
at
com.sleepycat.je.EnvironmentFailureException.wrapSelf(EnvironmentFailureExcept
ion.java:196)
at
com.sleepycat.je.dbi.EnvironmentImpl.checkIfInvalid(EnvironmentImpl.java:1439)
at com.sleepycat.je.Environment.checkEnv(Environment.java:2117)
at com.sleepycat.je.Environment.checkpoint(Environment.java:1440)
at
com.oracle.thirdeye.datastore.DataStoreManager.clean(DataStoreManager.java:402
at
com.oracle.thirdeye.infostore.InfoStoreManager.clean(InfoStoreManager.java:301
... 11 more
Caused by: com.sleepycat.je.EnvironmentFailureException: Environment invalid
because of previous exception: (JE 4.1.10)
/scratch/tie/thirdeye/index/data-store fetchTarget of 0x50f/0x3fb9dd6 parent
IN=368491717 IN class=com.sleepycat.je.tree.IN
lastFullVersion=0x510/0x2ca7d18 parent.getDirty()=false state=0
LOG_FILE_NOT_FOUND: Log file missing, log is likely invalid. Environment is
invalid and must be closed.
at com.sleepycat.je.tree.IN.fetchTarget(IN.java:1332)
at com.sleepycat.je.tree.IN.findParent(IN.java:2886)
at com.sleepycat.je.tree.Tree.getParentINForChildIN(Tree.java:881)
at com.sleepycat.je.tree.Tree.getParentINForChildIN(Tree.java:809)
at
com.sleepycat.je.cleaner.FileProcessor.findINInTree(FileProcessor.java:1152)
at com.sleepycat.je.cleaner.FileProcessor.processIN(FileProcessor.java:1090)
at
com.sleepycat.je.cleaner.FileProcessor.processFile(FileProcessor.java:538)
at com.sleepycat.je.cleaner.FileProcessor.doClean(FileProcessor.java:241)
at com.sleepycat.je.cleaner.Cleaner.doClean(Cleaner.java:463)
------------Configurations-------------------------
EnvironmentConfig.ENV_RUN_CLEANER -> false
EnvironmentConfig.CHECKPOINTER_HIGH_PRIORITY -> true
EnvironmentConfig.CLEANER_EXPUNGE -> false
Any hints are appreciated. I'm also working for Oracle CDC, feel free to call me at 861065151679 or drop me an email at [email protected] so that we can talk more in detail
Anfernee

Anfernee, I will contact you via email.
--mark

Data purge utility in OIM 9.1.0.2

Hi All,
Anybody aware of any data purge procedures/steps/utility in OIM.
I have studied that following tables are used for audit purpose. Following table holds of user profile snapshot (whenever user data get changed). Reference document is http://docs.oracle.com/cd/E10391_01/doc.910/e10365/useraudit.htm
UPA
UPA_USR
UPA_FIELDS
UPA_GRP_MEMBERSHIP
UPA_RESOURCE
AUD_JMS
UPA_UD_FORMS
UPA_UD_FORMFIELDS
I guess tis tables can be truncated (after taking a backup) without any risk ?
Please suggest?
Ritu

Refer more about script here:docs.oracle.com/cd/E14899_01/doc.9102/e14763/bulkload.htm#CHDHAFHC
OIM server should be up and running while running the script.
Regards,
GP

LMS 4.2 data migratiom from LMS3.2 SP1

Hi,
We would like to do data migration.
The lms4.2 is a soft appliance version. The lms3.2 is windows version.
The restore process exits and the log file shows the rme.db file copy is failed.
But the backup contains rmeeng.db file instead of rme.db.
The data migration is possible based on lms 4.2 data migration doc but restore script is bad.
Has anybody got same experience?
How can we do data migration?
Regards

Hi,
I shared
https://supportforums.cisco.com/servlet/JiveServlet/downloadBody/38973-102-1-94844/restorebackup.log.zip
thx,

Oracle EBS Data Purging and Archival

Hi,
I would like to know if there is any tool available in market for Oracle EBS data purging and Archival?
Thanks,

yes, there are 3rd-party tool available which will apply a set of business rules (ie all data older than Nov.1, 2007) through the various Oracle modules implemented at a customer site.
They are 3rd-party tools; You can go to Oracle.com and look in partners validated integration solutions. At the moment there are 2 partners offering such integrated solution:
Solix EDMS Validated Integration with 12.1
IBM Optim Data Growth Solution
the only other solution is to hire OCS for a customized developed solution

Problem restoring LMS 2.6 data to LMS 4.0

Hello,
I'm trying to migrate from LMS 2.6 on a Windows 2003 server to LMS 4.0 on Windows 2008 R2.
Two things I'll note here which might help future people attempting to use the LMS 4.0 backup/restore scripts as detailed in the migration document:
1) Make sure nobody has installed cygwin on the server before you run the backup scripts. If they have, remove it and the reg keys.
2) On the target server make sure to run the restore script CMD session using runas or disable UAC on Windows 2008 or the restore scripts will fail
My next problem I can't get past. I've been running the restore since yesterday morning and it still hasn't finished. It hasn't moved from 40% complete migrating the IPM data but in the last 24 hours it has eaten up 6Gb more RAM.
C:\Users\zadmkovesa>e:\sw\CSCOpx\bin\perl.exe e:\Sw\CSCOpx\bin\restorebackup.pl
-d e:\lmsbackup\ -t e:\lmsbackup\temp
Restore started at : 2011/03/15 11:21:12
Please see 'E:\Sw\CSCOpx\log\restorebackup.log' for status.
     USER ID is ..................................... : zadmkovesa
     OS of the backup archive is..................... : Windows
     WARNING: The temp directory e:\lmsbackup\temp\tempBackupData is not empty.
              An earlier instance of restore operation might have been interrupt
ed before completion.
              If you proceed with the restore operation, this directory and its
sub directories will be deleted.
              Do you want to continue? (y-continue or n-quit, y/n)?y
     Generation to be restored is ................... : 0
     Backup taken from............................... : e:\lmsbackup\
     Common Services version in the backup data is... : 3.0.6
     Common Services is installed in................. : E:\Sw\CSCOpx
     The temp folder for this restore program........ : e:\lmsbackup\temp\tempBa
ckupData
     Applications installed on this machine ......... : [Common Services][Campus
Manager][Resource Manager Essentials][Device Fault Manager][cvw][cwlms][cwporta
l][ipm][upm]
     Applications in the backup archive ............. : [Common Services][Campus
Manager][Resource Manager Essentials][Device Fault Manager][cvw][ipm]
     WARNING: The list of applications installed on this CiscoWorks server does
not match the list of
              applications in the backup archive. If you restore data from this
backup archive,it may
              cause problems in the CiscoWorks applications.
              Do you want to continue the restore operation? (y-continue or n-q
uit, y/n)?y
     Applications to be restored are................. : [Common Services] [Campu
s Manager] [Resource Manager Essentials] [Device Fault Manager] [cvw] [ipm]
     Available disk space in NMSROOT................. : 237023900 Kb
     Required disk space in NMSROOT.................. : 38857544 Kb
     (The temp and NMSROOT are on same device, therefore this required disk spac
e includes temp space)
Copying the backup files to the temporary location [e:\lmsbackup\temp\tempBack
upData]
preRestore of [Common Services] has started.
preRestore of [Common Services] has completed.
preRestore of [Campus Manager] has started.
preRestore of [Campus Manager] has completed.
preRestore of [Resource Manager Essentials] has started.
preRestore of [Resource Manager Essentials] has completed.
preRestore of [Device Fault Manager] has started.
preRestore of [Device Fault Manager] has completed.
preRestore of [cvw] has started.
preRestore of [cvw] has completed.
preRestore of [ipm] has started.
Not all data from IPM 2.6 will be migrated to LMS 4.0. For information on the d
ata that is migrated, see the "Migrating Data From LMS 2.6 or 2.6 SP1" section i
n the "Migrating Data to CiscoWorks LAN Management Solution 4.0" chapter in the
LMS4.0 Installation Guide for details. Do you want to continue[Y/N]:[Y]y
Do you want the IPM 2.6 collectors present in the backup to be DELETED from the
source routers [Y/N]:[Y]n
preRestore of [ipm] has completed.
doRestore of [Common Services] has started.
          License check started.
             WARNING: The license details in the server are different from the b
ackup data.
                      After restoring, please check the license available in the
server.
             WARNING: Your current license count is lower than your earlier lice
nse count.
                      If you restore the data now, devices that exceed the curre
nt licence count
                      will be moved to Suspended state.
          License check completed.
          Restoring certificate.
             WARNING: Cannot evaluate the hostname, hence the certificate
                      may be from this host or another host.
                      [ Certificate not overwritten ]
          Restored Certificate.
          Restoring Common Services database.
          Restored Common Services database.
          Restoring CMIC data.
          Restored CMIC data.
          Restoring CMC data.
          Restored CMC data.
          Restoring Security Settings.
                INFO:
                Backup Mode is ACS. In LMS we are not supporing ACS for AAA.
                Setting Login Mode to CiscoWorks Local.
          Restored Security Settings.
          Restoring DCR data.
          Restored DCR data.
          Restoring Certificate key store.
          Restored Certificate key store.
          Restoring JAAS configuration.
          Restored JAAS configuration.
          JRM Job Migration started.
          JRM job Migration done.
doRestore of [Common Services] has completed.
doRestore of [Campus Manager] has started.
doRestore of [Campus Manager] has completed.
doRestore of [Resource Manager Essentials] has started.
10% of RME Restore completed
30% of RME Restore completed
50% of RME Restore completed
70% of RME Restore completed
100% of RME Restore completed
doRestore of [Resource Manager Essentials] has completed.
doRestore of [Device Fault Manager] has started.
10% of DFM Restore completed
30% of DFM Restore completed
50% of DFM Restore completed
80% of DFM Restore completed
Going to modify Eight PM report
Modified Sucessfully Eight PM report
100% of DFM Restore completed
doRestore of [Device Fault Manager] has completed.
doRestore of [cvw] has started.
doRestore of [cvw] has completed.
doRestore of [ipm] has started.
10% of IPM migration completed
20% of IPM migration completed
30% of IPM migration completed
40% of IPM migration completed
>>>
The restore log is more than 8Mb in size so I won't upload it unless someone really wants to see it. Here is a snip from the end of it showing no clues I can make sense of:
INFO: Getting message
INFO: Connect the database dsn=ipmdb
INFO: Connected the Database
INFO: Command Executed
INFO: Connecting the Database ipmdb
INFO: Company=Cisco Systems;Application=NMTG;Signature=010fa55157edb8e14d818eb4fe3db41447146f1571g32125eb777a87cbf8b29a954f559d4221b792ff8
INFO: Preparing AUTH cmd
INFO: AUTH Executed
INFO: AUTH cmd finished
INFO: Stopping the Database engine ipmdb
INFO: E:\Sw\CSCOpx/objects/db/conf/ConfigureDB.LOCK released for the future operations...
INFO: File not exists.[Tue Mar 15 13:17:30 2011] Successfully registered the database with DM
[Tue Mar 15 13:17:30 2011] Successfully configured IPMDB database !..
10% of IPM migration completed
INFO: Start changing password for database 'ipm'...
    Starting database engine ipmEng
INFO: New userinfo updated into database successfully.
    Stopping database engine ipmEng
SQL Anywhere Command File Hiding Utility Version 10.0.1.4051
INFO: Password changed in odbc template file for database 'ipm'.
INFO: Password changed for ODBC registry 'ipm'.
INFO: Password changed for Property file E:\Sw\CSCOpx\lib\classpath\com\cisco\nm\cmf\dbservice2\DBServer.properties.
INFO: Database password successfully changed.
INFO: Process created
INFO: Started the Database engine : ipmEng Retry 0
INFO: Started the Database engine : ipmEng Retry 1
INFO: Started the Database engine : ipmEng Retry 2
INFO: Started the Database engine : ipmEng Retry 3
INFO: Started the Database engine : ipmEng Retry 4
INFO: Getting message
INFO: Connect the database DSN=ipm
INFO: Connected the Database
INFO: Command Executed
INFO: File not exists.[Tue Mar 15 13:18:08 2011] Updated IPM 2.6 DB password into IPM 5.0 DB
20% of IPM migration completed
The CiscoWorks Daemon Manager service is starting.
The CiscoWorks Daemon Manager service was started successfully.
[Tue Mar 15 13:18:12 2011] Waiting for all daemons to start completely...
[Tue Mar 15 13:20:12 2011] Successfully stated daemon manager
30% of IPM migration completed
[Tue Mar 15 13:20:12 2011] Checking if IPM Process is up and running
INFO:Daemon Manager is processing other tasks in the queue.Please try again later.
[Tue Mar 15 13:25:12 2011] Process IPMProcess is not running or never started
[Tue Mar 15 13:25:12 2011] Will check after 60 seconds
INFO:Daemon Manager is processing other tasks in the queue.Please try again later.
[Tue Mar 15 13:31:12 2011] Process IPMProcess is not running or never started
[Tue Mar 15 13:31:12 2011] Will check after 60 seconds
[Tue Mar 15 13:34:54 2011] Process IPMProcess is running normally
[Tue Mar 15 13:34:54 2011] Let's proceed further..
40% of IPM migration completed
[Tue Mar 15 13:39:54 2011] delete flag is 0
[Tue Mar 15 13:39:54 2011] Data passed to MigrMain : 2.6 5.0 E:\Sw\CSCOpx E:\Sw\CSCOpx e:\lmsbackup\temp\tempBackupData Migration e:\lmsbackup\temp\tempBackupData 0
Should I just wait? Is this something that might take days if I've got a lot of IPM data or is it broken? I don't really care about keeping IPM data so could I do something to complete the data migration for everything else? Any advice appreciated.
regards,
Aaron

The restore can take a long time if you have a lot of data. The problem is the database needs to be completely unloaded and reloaded to convert from ASA 9 to ASA 10. However, if you do not care about IPM data, and you still have LMS 2.6 running, you can take a new LMS backup not using the wrapper.pl script (this will keep IPM from being backed up).

LMS 3.2 Data Collection Issue

Hi ,
I have LMS 3.2 and license for adding 5000 devices , my data collection is running continously for the past 2 days, when i try to stop the daemon manager and restart it comes to idle state but after some time it again goes to Running state
I am not getting the best practices deviations and discrepaqncies report after this issue
I am attaching the ANIServer.properties , ani.log and ANIServer.log file
Please help

this seems to be BugID CSCtd49439:
http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?caller=pluginredirector&method=fetchBugDetails&bugId=CSCtd49439
also consider to install the patch for BugID CSCtg20882:
http://tools.cisco.com/Support/BugToolKit/search/getBugDetails.do?caller=pluginredirector&method=fetchBugDetails&bugId=CSCtg20882
if you have CM 5.2 you should consider to upgrade to CM 5.2.1 which is available here:
http://www.cisco.com/cisco/software/type.html?mdfid=282641773&flowid=5141&softwareid=280775108
the patches for BugIDs CSCtd49439 and CSCtg20882 are availabel by contacting TAC

LMS 3.2 Syslog purge job failed.

We installed LMS 3.2 on windows server 2003 enterprise edition. RME version is 4.3.1. We have created daily syslog purge job from RME> Admin> Syslog> Set Purge Policy. This job failes with the following error.
"Drop table failed:SQL Anywhere Error -210: User 'DBA' has the row in 'SYSLOG_20100516' locked 8405 42W18
[ Sat Jun 19 01:00:07 GMT+05:30 2010 ],ERROR,[main],Failed to purge syslogs"
After server restart job will again execute normally for few days.
Please check attached log file of specified job.
Regards

The only reports of this problem in the past has been with two jobs being created during an upgrade. This would not have been something you would have done yourself. I suggest you open a TAC service request so database locking analysis can be done to find what process is keeping that table locked.

Sliding window for historical data purge in multiple related tables

All,
It is a well known question of how to efficiently BACKUP and PURGE historical data based on a sliding window.
I have a group of tables, they all have to be backed up and purged based on a sliding time window. These tables have FKs related to each other and these FKs are not necessary the timestamp column. I am considering using partition based on the timestamp column for all these tables, so i can export those out of date partitions and then drop them. The price I have to pay by this design is that timestamp column is actually duplicated many times among parent table, child tables, grand-child tables although the value is the same, but I have to do the partition based on this column in all tables.
It's very much alike the statspack tables, one stats$snapshot and many child tables to store actual statistic data. I am just wondering how statspack.purge does this, since using DELETE statement is very inefficient and time consuming. In statspack tables, snap_time is only stored in stats$snapshot table, not everywhere in it's child table, and they are not partitioned. I guess the procedure is using DELETE statement.
Any thought on other good design options? Or how would you optimize statspack tables historical data backup and purge? Thanks!

hey oracle gurus, any thoughts?

Delete or Truncate statement for data purging

Hi,
I am writting a stored procedure to purge data from table every month. There is no constraint on table column except primary key.
I am using 'delete' statement as it records an entry in the transaction log for each deleted row. But it's a slow process compared to 'Truncate' statement.
Can you please suggest what should I choose (Delete or truncate) as per best practice.
Thanks
Sandy
SandyLeo

If you want to delete all rows in the table use TRUNCATE, otherwise I would suggest the below technique
--SQL2008 and onwards
insert into Archive..db
select getdate(),d.*
from (delete from db1
output deleted.*
where col=<value>
) d
go
Best Regards,Uri Dimant SQL Server MVP,
http://sqlblog.com/blogs/uri_dimant/
MS SQL optimization: MS SQL Development and Optimization
MS SQL Consulting:
Large scale of database and data cleansing
Remote DBA Services:
Improves MS SQL Database Performance
SQL Server Integration Services:
Business Intelligence

LMS 3.2 Data transfer

HI all,
We have created LMS 3.2 in our server and works fine for a while.Now, we have decided to change the server, so we installed LMS 3.2 in our new server once again. my question would be is there any way to export data( all configuration) from privous LMS server to new one ? your help would be appreciated.
Regards,

Yes there is a way, and its not too complicated.
LMS has a backup utility, which can be restored to another LMS install to migrate previous server data.
Steps are :
Take Backup --> Install LMS on new Server --> do backup restore.
One main question here is, if you can you're planing to install the same LMS version i.e. 3.x or if you are planning to go to other version, like 4.x, there could be some important thigs to consider.
Following are the documents which will tell you the procedure for Backup and Restore:
Backing up Data:
http://www.cisco.com/en/US/docs/net_mgmt/ciscoworks_common_services_software/3.3/user/guide/admin.html#wp890648
Restoring Backup Data:
http://www.cisco.com/en/US/docs/net_mgmt/ciscoworks_common_services_software/3.3/user/guide/admin.html#wp1276623
-Thanks
Vinod

Data purging in 11i

Hi All,
I am new to Oracle 11i apps. i would like to know,
1. What are the tables or logs need to be purge in periodic basis?
2. Why i need to purge those tables or logs?
3. Am i need to do it manually or scripts exists in the server?
4. Is there any criteria to purge those tables or logs?
Please help me.

Hi,
Please see notes :
Reducing Your Oracle E-Business Suite Data Footprint using Archiving, Purging, and Information Lifecycle Management [ID 752322.1]
Purging Strategy for eBusiness Suite 11i [ID 732713.1]
How Does Archive & Purge functionality works in 11i AP? [205362.1]
Purge Concurrent Request and/or Manager Data Slow Performance [ID 789698.1]
Please also review forum Search:
https://forums.oracle.com/thread/search.jspa?peopleEnabled=true&userID=&containerType=&container=&q=ebs+purge
Thanks &
Best Regards,

Oracle Apps data Purge

Hi Apps Gurus
We have a requirement to delete one of the operating units data from Oracle Projects ,SCM and Finance modules.
There are huge transactions and interfaced to GL and other modules(e.g. Payable Invoices have been transferred to GL)
There are standard concurrent programs and Purge functionalities, however it checks for dependencies. We would like to delete it completely including GL module.
Regards
Dharam

Hi;
You can not delete module from EBS,If you do than consistiency will be destory. You can not delete data from backend too, coz its also can be cause many problem.
If you need to purge huge data than you have to log SR and confirm it wiht oracle support
Regard
Helios

CRM Data Purge

Hi
Could anyone point me in the direction of permanently purging CRM data in e-Business Suite? We have now accumulated significant volumes of CRM data (in millions), namely hz_parties, hz_locations, hz_party_relationships, notes, etc. We are interested in purging historic data from the system relating to a party rather than set the party to inactive.
Any assistance/pointers would be much appreciated.
Regards
SH

Hi Guys
Many thanks for all your responses. I will raise a SR for Oracle to confirm that parties cannot be deleted but I get the point around these being master entities in the system. I can go with the option of inactivating the parties, thereby making them unavailable on the system.
regards
SH

LMS - Legacy training data load

We are going to implement SAP LMS soon. We are in the planning phase. I have one question around that - What is the best way to load Courses(Business Events) Object type E in the system ? We have lots of training history in the legacy system. The L-D relationship is easy to load via DTT /LSMW. What is the best way to load Object E for each Business Evey Types D and the Persons enrolled for the respective E.
Thanks for your help
Sanghamitra
Edited by: Sanghamitra on Feb 19, 2009 1:21 PM

Hi,
You can use a LSMW for Tcode PV10/PV11 to create the business events.
Also to book attendees its better and convenient to create a LSMW for Tcode PV08 rather than PV00 or PV07 as in these 2 you cannot mention the Event (E) ID and can cause a confusion just in case there are 2 events with similar dates under that event.
Hope this helps.
Shreyasi.

LMS 3.2 Data purge

Similar Messages

Maybe you are looking for