About ODI Log Line granularity

I'm trying to build a dataquality tool to certificate the quality of the data. I've read the other thread about this argument and i've found that there are 3 tables
SNP_SESS_TXT_LOG
SNP_SESS_TASK
SNP_SESS_TASK_LOG
that maintain task information. There are also two files (name.bad and name.error) that describe the log of the last loading of each files.
I want to create a report as the following:
TASK NO : 345
LOAD FROM : SAMPLE.TXT
TOTAL LINE : 1000
NOT LOADED : 25
WARNING : 400
DUPLICATE LINE: 56
NOT NUMBER LINE : 60
can you confirm me that the only mode is parsing the above sources?
Regards
Francesco

Hi Francesco,
Trying to contribute a little,
There are lot other tables in work repo where Scenario and Session information been stored. Please have a look at the below,
List of tables having Session related information,
SNP_SESS_TXT_LOG
SNP_SESS_TASK_LOG
SNP_STEP_LOG
SNP_TASK_TXT
SNP_SESS_TASK
SNP_SESS_STEP
SNP_SEQ_SESS
SNP_VAR_SESS
SNP_SESSION
SNP_EXP_TXT (starting with ODI 10.1.3 versions):
SNP_SESS_TASK_LOG.I_TXT_TASK_MESS = SNP_EXP_TXT.I_TXT
SNP_STEP_LOG.I_TXT_STEP_MESS = SNP_EXP_TXT.I_TXT
SNP_VAR_SESS.I_TXT_VAR = SNP_EXP_TXT.I_TXT
SNP_VAR_SESS.I_TXT_DEF_T = SNP_EXP_TXT.I_TXT
SNP_SESSION.I_TXT_SESS_MESS = SNP_EXP_TXT.I_TXT
SNP_SESSION.I_TXT_SESS_PARAMS = SNP_EXP_TXT.I_TXT
List of tables having tables storing Scenario related information,
SNP_SCEN_TXT
SNP_SCEN_TASK
SNP_SCEN_STEP
SNP_SEQ_SCEN
SNP_VAR_SCEN
SNP_PLAN_AGENT
SNP_SCEN
SNP_EXP_TXT (starting with ODI 10.1.3 versions):
SNP_SCEN.I_TXT_SCEN = SNP_EXP_TXT.I_TXT
SNP_VAR_SCEN.I_TXT_VAR = SNP_EXP_TXT.I_TXT
SNP_VAR_SCEN.I_TXT_DEF_T = SNP_EXP_TXT.I_TXT
List of tables stores Reports associated with a Scenario,
SNP_SCEN_REPORT
SNP_STEP_REPORT
SNP_EXP_TXT (starting with ODI 10.1.3 versions):
SNP_SCEN_REPORT.I_TXT_SESS_MESS = SNP_EXP_TXT.I_TXT
SNP_STEP_REPORT.I_TXT_STEP_MESS = SNP_EXP_TXT.I_TXT
Thanks,
G

Similar Messages

ODI Log Level

Hi,
I am looking for a description of ODI Log Levels.
I know that the log level controls the details of the log output in ODI operator, but does exists some more detailed documentation about it?
I would need information like what details are shown in which log level.
Thanks in advance!
Cheers,
H.

It is important to understand that the way odi works, it uses the "log" to drive all executuions. When you start a scenario, it copies eachof the steps of the scenarios into the execution log with the session ID, and wih a status of Waiting. As it executes each, it marks it as being executed, and when complete, marks it as completed (in or or successfully). When it has executed all the steps, it will go back to the log and selectively delete the entries there. When you execute the scenario, you execute it with a log-level of 0-5, and ODI will basically delete all entries in the log with a level > your chosen level. If you inspect the steps of a KM, Procedure etc, you will see that each has a log-level associated with it. This is what will decide if it is to be kept or not.
If the session ends in failure, it will keep all the entries.

Question about imap log format.

I hava a question about imap log file.
Here are sample imap log lines
[26/Dec/2005:13:21:24 +0900] mail imapd[513]: Account Notice: close [203.231.11.113] ywmoon 2005/12/26 13:21:24 0:00:00 1013 2843 2
[26/Dec/2005:13:21:32 +0900] mail imapd[513]: Account Notice: close [203.231.14.251] hkchoi 2005/12/26 13:20:37 0:00:55 446 1196 0
Above line...
First line
ywmoon : UserID
2005/12/26 : Date
13:21:24 : login time (hour:minute:second)
0:00:00 : ?
1013 : bytes from client to server
2843 : bytes from server to client
2 : ?
next line
13:20:37 : same above
0:00:55 : ?
446 : same above
1196 : same above
0 : ?
From above, I don't know "?" mark fields.
0:00:00 or 0:00:55 ==> expenditure time to login ? And is this "hour:minute:second" OR "minute:second:milliSecond" ?
2 or 0 ==> 1 means INBOX. 0 and 2, what they are mean ?
Thank you in advance...

I hava a question about imap log file.
Here are sample imap log lines
[26/Dec/2005:13:21:24 +0900] mail imapd[513]: Account
Notice: close [203.231.11.113] ywmoon 2005/12/26
13:21:24 0:00:00 1013 2843 2
[26/Dec/2005:13:21:32 +0900] mail imapd[513]: Account
Notice: close [203.231.14.251] hkchoi 2005/12/26
13:20:37 0:00:55 446 1196 0
Above line...
First line
ywmoon : UserID
2005/12/26 : Date
13:21:24 : login time (hour:minute:second)
0:00:00 : ?how long the connection lasted.
1013 : bytes from client to server
2843 : bytes from server to client
2 : ?Number of messages?
that's a guess. we don't actually document this stuff.
>
next line
13:20:37 : same above
0:00:55 : ?
446 : same above
1196 : same above
0 : ?
From above, I don't know "?" mark fields.
0:00:00 or 0:00:55 ==> expenditure time to login ?
And is this "hour:minute:second" OR
"minute:second:milliSecond" ?
2 or 0 ==> 1 means INBOX. 0 and 2, what they are mean
Thank you in advance...

Executing batch files via ODI cmd line tool

Hi,
I'm experiencing an issue when trying to run batch files via the ODI Cmmmand line tool with any agent that isn't the local agent. My call is simply the full filepath of the batch file. When I run with local agent everything works fine. However when I run with an agent configured in the Topology the process just hangs in the operator indefinately in a running state but never executes or produces any output and I have to kill it. Any ideas? The agent is installed on the same server as the ODI Studio instance I use when running the local agent

Sounds like that on the remote agent, the batch job is waiting for a user key input and hence it appears in a hung state. You can add try to trace from Agent logs and echo combinations to know where is this happening
In unix environment you can send keys programmatically. Not sure how to do that in the Windows environment.

Error Stack in Expert Routine, Infos about Object Log

Hi all,
currently I try to find some information about using the error stack in combination with an expert routine. So far I know that I have to use the Object Log, which is already in place in my code for monitor messages.
LOOP AT itab_input INTO wa_input.
IF sy-subrc <> 0.
        CLEAR msg.
        msg-msgid = 'MY_CLASS'.
        msg-msgty = 'E'.
        msg-msgno = '002'.
        msg-msgv1 = v1.
        msg-msgv2 = v2.
        msg-msgv3 = v3.
        APPEND msg TO t_msg.
        " ??? Write wa_input to error stack???
        CONTINUE.
      ENDIF.
ENDLOOP.
Does somebody know how I could append wa_input to the error stack? Or does somebody have a good documentation about Object log?
Thanks a lot!
Nita

Good Morning,
thanks a lot for your input. I tried to implement this function, but I do not know where I could get the Segment Id from.
Do you know what i_use_crosstab is used for? I think i_with_message should be set to 'X' if I want to write wa_input-record it to the error stack.
CALL METHOD log->verify_record
          EXPORTING
            i_use_crosstab = ''
            i_segid         = lv_segid
            i_record        = wa_input-record
            i_with_message = 'X'
          RECEIVING
            r_skip          = lv_skip
          EXCEPTIONS
            too_many_errors = 1
            not_in_crosstab = 2
            OTHERS          = 3.
From semantic point of view the coding should do following:
- To avoid a second loop in my expert routine it should only check the current src record. If this is wrong, which I already determine in my coding, it should write the record in the error stack. If it is correct, it should check whether there are already records with the same semantic key in the error stack and if yes, add it also to it.
- I assume that I have to delete this record manually from my src. package than.
Cheers
Nita

Invalid logging line: !DOCTYPE html PUBLIC "-//W3C//DTD XHTM error

Hi..
I am getting the following error while deploying a bpel process cantaining java embedding on weblogic server 11g.
[04:31:54 PM] Received HTTP response from the server, response code=200
[04:31:54 PM] Invalid logging line: <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
[04:31:54 PM] Invalid logging line: <html xmlns="http://www.w3.org/1999/xhtml">
[04:31:54 PM] Invalid logging line: <head>
[04:31:54 PM] Invalid logging line: <title>GE | Web Site Verification</title>
[04:31:54 PM] Invalid logging line: <style type="text/css">
[04:31:54 PM] Invalid logging line: 
[04:31:54 PM] Invalid logging line: </style>
[04:31:54 PM] Invalid logging line: <script>
[04:31:54 PM] Invalid logging line: function show_lang(section) {
[04:31:54 PM] Invalid logging line:      document.getElementById('excerpt_EN').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('excerpt_SCN').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('excerpt_FR').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('excerpt_ES').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('excerpt_DE').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('excerpt_IT').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('excerpt_JP').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('footer_EN').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('footer_SCN').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('footer_FR').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('footer_ES').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('footer_DE').style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById('footer_IT').style.display = "none";
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById('footer_JP').style.display = "none";
[04:31:54 PM] Invalid logging line:      var excerpt = "excerpt_" + section;
[04:31:54 PM] Invalid logging line:      var footer="footer_"+
[04:31:54 PM] Invalid logging line: section;
[04:31:54 PM] Invalid logging line:      document.getElementById(excerpt).style.display = "block";
[04:31:54 PM] Invalid logging line:      document.getElementById(footer).style.display
[04:31:54 PM] Invalid logging line: = "block";
[04:31:54 PM] Invalid logging line: }
[04:31:54 PM] Invalid logging line: function show(section) {
[04:31:54 PM] Invalid logging line:      var excerpt = "excerpt_" + section;
[04:31:54 PM] Invalid logging line:      var full_text = "full_" + section;
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById(excerpt).style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById(full_text).style.display = "block";
[04:31:54 PM] Invalid logging line: }
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: function hide(section) {
[04:31:54 PM] Invalid logging line:      var excerpt = "excerpt_" + section;
[04:31:54 PM] Invalid logging line:      var full_text = "full_" + section;
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: document.getElementById(full_text).style.display = "none";
[04:31:54 PM] Invalid logging line:      document.getElementById(excerpt).style.display = "block";
[04:31:54 PM] Invalid logging line: }
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: /** BEGIN SCRIPS FOR REMEMBER SSO IMPLEMENTATION **/
[04:31:54 PM] Invalid logging line: function rememberSSOID(){
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line:      if (document.SSOForm.saveID.checked){
[04:31:54 PM] Invalid logging line:           saveSSOID();
[04:31:54 PM] Invalid logging line:      } else {
[04:31:54 PM] Invalid logging line:           clearSSOID();
[souhaitez continuer sur ce site.
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: Pour en savoir plus
[04:31:54 PM] Invalid logging line: sur le processus de protection de l'accès Internet GE, consultez les informations ci-dessous.</p>
[04:31:54 PM] Invalid logging line:      <p id="excerpt_ES"
[04:31:54 PM] Invalid logging line: style="display:none">La página a la que intenta acceder no es un sitio web de confianza de GE. Para protegerlo a usted y
[04:31:54 PM] Invalid logging line: a la Compañía, por favor, seguidamente inicie sesión para confirmar que desea continuar en este sitio. Para
[04:31:54 PM] Invalid logging line: obtener más datos respecto de la protección al acceso a Internet de GE, consulte la información que aparece
[04:31:54 PM] Invalid logging line: debajo.</p>
[04:31:54 PM] Invalid logging line:      <p id="excerpt_JP"
[04:31:54 PM] Invalid logging line: style="display:none">アクセスしようとして
[04:31:54 PM] Invalid logging line: いるサイトはGEが信賴していな
[04:31:54 PM] Invalid logging line: いウェブサイトです。自身と
[04:31:54 PM] Invalid logging line: 会社を守るため、下記にログ
[04:31:54 PM] Invalid logging line: インしてこのサイトを続けて
[04:31:54 PM] Invalid logging line: 閲覧することを確認してくだ
[04:31:54 PM] Invalid logging line: さい。 GE のインターネットアクセス保
[04:31:54 PM] Invalid logging line: 護プロセスについての詳細は
[04:31:54 PM] Invalid logging line: 、下記を参照してください。
[04:31:54 PM] Invalid logging line: </p>
[04:31:54 PM] Invalid logging line:      <p id="excerpt_DE" style="display:none">Die Website,
[04:31:54 PM] Invalid logging line:           <li>
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line:      </ul>
[04:31:54 PM] Invalid logging line: </div>
[04:31:54 PM] Invalid logging line: <div id="footer_JP" style="display:none">
[04:31:54 PM] Invalid logging line: <p><img
[04:31:54 PM] Invalid logging line: src="https://www.ge.com/security_proxy_sign_on/more-information.png"></p>
[04:31:54 PM] Invalid logging line:      <ul>
[04:31:54 PM] Invalid logging line:           <li>
[04:31:54 PM] Invalid logging line:
[04:31:54 PM] Invalid logging line: <div id="excerpt_one_JP"><a href="javascript:show('one_JP')
[04:31:54 PM] Invalid logging line: name="why_title">このページにアクセスする理由</a></div>
[04:31:54 PM] Invalid logging line:                     <div id="full_one_JP" style="display:none;">
[04:31:54 PM] Invalid logging line:                          <p><a
[04:31:54 PM] Invalid logging line: href="javascript:hide('one_JP')"
[04:31:54 PM] Invalid logging line: name="why_title">このページにアクセスする理由</a></p>
[04:31:54 PM] Invalid logging line:                          <p
[04:31:54 PM] Invalid logging line: class="why_desc">GE の企業情報を保護することは
[04:31:54 PM] Invalid logging line: 最優先事項です。
[04:31:54 PM] Invalid logging line: この情報は、物理的、電子的、手
[04:31:54 PM] Invalid logging line: 続き上のセーフガード（この認証
[04:31:54 PM] Invalid logging line: ページ等）により保護されます。
[04:31:54 PM] Invalid logging line: このページは、アクセスしている
[[04:31:54 PM] ---- Deployment finished. ----

Hi:
R u behind a Proxy?
If it so, u can configure it at JDEveloper in the Tools->Preferences->Web Browser and Proxy section.
Or u can deploy ur composite, directly in Enterprise Manager - Fusion Middleware Control.
thx
best

About transaction logs

Can you tell me about transaction log space? how does it gets full? How is it related to performance?

Hi,
Monitoring the SAP Log Disk
Use
The size of the transaction log must be checked regularly to work out how much free space is available on the log disk. There should always be enough free space to allow the next file extension. When the SAP system has been installed the autogrow increment is set. At least the size of this increment should be available on the log disk to permit the next file extension. If less space is available and the transaction log file fills up, the SAP system will come to a standstill.
Ideally, the transaction log should never be filled to more than 60-70%. If the transaction log regularly exceeds this level between 2 transaction log backups, the transaction log must be saved at more frequent time intervals.
The size of the log can be assessed on the basis of information given for completed backups in the SAP transaction for Backup and Restore Information.
Procedure:
       1.      To access the transaction for Backup Restore Information choose CCMS ® DB Administration ® Backup logs.
Alternatively, enter the transaction code DB12.
The initial screen of the monitor CCMS Monitoring Tool u2013 DB12 (Backup Restore Information) appears.
       2.      Choose Backup history and then Logs Backup.
       3.      A result list appears. Find the largest transaction log backup of the past week. Select a row and then History info to find out the number of pages that were processed during the backup. To work out the amount of space used in the transaction log, multiply the number of dumped pages by 8 KB. You can then work out how much free space is left on the transaction log disk.
If you use a RAID1 disk system exclusively for the SAP transaction log and create hourly log backups, you will rarely encounter space problems. The SAP log file is initially created with a size of 1 GB. The smallest disk normally has 9 GB space and the log file can therefore grow to 9 GB.
Hope it Helps
Srini

About ODI dose any books are available in Indian Market??

Dear All,
about ODI dose any books are available in Indian Market??
Thanks & Regards
Zakeer
[email protected]

hi Zakeer,
If you contact the Oracle University they will provide you the enough materials for ODI
thansk,
SAichand.v

About ADF logging.xml

hello everyone, configure a loghandler in logging.xml like this:
<property name='path' value='${domain.home}/servers/${weblogic.Name}/logs/owsm/msglogging/diagnostic.log'/>
where the ${domain.home} and ${weblogic.Name} set up, then can I set up other variable and how?

hello my jdev is 12c,
please look this url about ADF log
thanks

Budget billing plan is inconsistent due to incorrect log. line numbering

Hello All,
We are facing an issue with Budget Billing Plan Change(EA62)/Display(EA63).
Issue details are as follows.
-       Initially BBP had 2 products and I partially billed both products and Then I moved out one product and Then I invoiced that one and Then I partially billed the remaining product.
-    Now if i am trying to open the Budget Billing Plan using EA62/63,i am getting the following error.
         Budget billing plan is inconsistent due to incorrect log. line numbering,Message No: TU397.
          We have applied note no : 0001969117.
         Still we are facing the same issue, Kindly help me on this.

Hello All,
We are facing an issue with Budget Billing Plan Change(EA62)/Display(EA63).
Issue details are as follows.
-       Initially BBP had 2 products and I partially billed both products and Then I moved out one product and Then I invoiced that one and Then I partially billed the remaining product.
-    Now if i am trying to open the Budget Billing Plan using EA62/63,i am getting the following error.
         Budget billing plan is inconsistent due to incorrect log. line numbering,Message No: TU397.
          We have applied note no : 0001969117.
         Still we are facing the same issue, Kindly help me on this.

Question about ODI execution log

Hi guys,
I need to delete the result of the execution of a package I'm referring to get in a table if the scenario runs with status of warning, mistake or sucess. I can see the values in the operation.
Do you know uin which table ODI stores this values?
Thanks in advance.

ORV wrote:
Hi guys,
I need to delete the result of the execution of a package I'm referring to get in a table if the scenario runs with status of warning, mistake or sucess. I can see the values in the operation.
Do you know uin which table ODI stores this values?
Look for SNP_SESSION
SNP_STEP_LOG
Thanks in advance.

Confused about the log files

I have written an application that has a Primary and Secondary database. The application creates tens-of-thousands of records in the Primary database, with a 1-to-1 relationship in the Secondary. On subsequent runs it will either update existing Primary records (which should not update the secondary as that element does not change) or it will create new records.
The application actually works correctly, with the right data, the right updates and the right logical processing. The problem is the log files.
The input data I am testing with is originally 2Mb as a CSV file and with a fresh database it creates almost 20Mb of data. This is about right for the way it splits the information up and indexes it. If I run the application again with exactly the same data, it should just update all the entries and create nothing new. My understanding is that the updated records will be written to the end of the logs, and the old ones in the earlier logs would be redundant and the cleaner thread would clean them up. I am explicitly cleaning as per the examples. The issue is that each run, the data just doubles in size! Logically it is fine, physically it is taking a ridiculous amount of space. RUnning DbSpace shows that the logs are mostly full (over 90%) where I would expect most to be empty, or sparsely occupied as the new updates are written to new files. cleanLog() does nothing. I am at a total loss!
Generally the processing I am doing on the primary is looking up the key, if it is there updating the entry, if not creating one. I have been using a cursor to do this, and using the putCurrent() method for existing updates, and put() for new records. I have even tried using Database.delete() and the full put() in place of putCurrent() - but no difference (except it is slower).
Please help - it is driving me nuts!

Let me provide a little more context for the questions I was asking. If this doesn't lead us further into understanding your log situation, perhaps we should take this offline. When log cleaning doesn't occur, the basic questions are:
a. is the application doing anything that prohibits log cleaning? (in your case, no)
b. has the utilization level fallen to the point where log cleaning should occur? (not on the second run, but it should on following runs)
c. does the log utilization level match what the application expects? (no, it doesn't match what you expect).
1) Ran DbDump with and withour -r. I am expecting the
data to stay consistent. So, after the first run it
creates the data, and leaves 20mb in place, 3 log
files near 100% used. After the second run it should
update the records (which it does from the
applications point of view) but I now have 40mb
across 5 log files all near 100% usage.I think that it's accurate to say that both of us are not surprised that the second run (which updates data but does not change the number of records) creates a second 20MB of log, for a total of 40MB. What we do expect though, is that the utilization reported by DbSpace should fall to closer to 50%. Note that since JE's default minimum utilization level is 50%, we don't expect any automatic log cleaning even after the second run.
Here's the sort of behavior we'd expect from JE if all the basics are taken care of (there are enough log files, there are no open txns, the application stays up long enough for the daemon to run, or the application does batch cleanLog calls itself, etc).
run 1 - creates 20MB of log file, near 100% utilization, no log cleaning
run 2 - updates every record, creates another 20MB of log file, utilization falls, maybe to around 60%. No log cleaning yet, because the utilization is still above the 50% threshold.
run 3 - updates every record, creates another 20MB of log file, utilization falls below 50%, log cleaning starts running, either in the background by the daemon thread, or because the app calls Environment.cleanLog(), without any need to set je.cleaner.forceCleanFiles.
So the question here is (c) from above -- you're saying that your DbSpace utilization level doesn't match what you believe your application is doing. There are three possible answers -- your application has a bug :-), or with secondaries and whatnot, JE is representing your data in a fashion you didn't expect, or JE's disk space utilization calculation is inaccurate.
I suggested using DbDump -r as a first sanity check of what data your application holds. It will dump all the valid records in the environment (though not in key order, no -r is slower, but dumps in key order). Keys and data should up on different lines, so the number of lines in the dump files should be twice the number of records in the environment. You've done this already in your application, but this is an independent way of checking. It also makes it easier to see what portion of data is in primary versus secondary databases, because the data is dumped into per-database files. You could also load the data into a new, blank environment to look at it.
I think asked you about the size of your records because a customer recently reported a JE disk utilization bug, which we are currently working on. It turns out that if your data records are very different in size (in this case, 4 orders of magnitude) and consistently only the larger or the smaller records are made obsolete, the utilization number gets out of whack. It doesn't really sound like your situation, because you're updating all your records, and they don't sound like they're that different in size. But nevertheless, here's a way of looking at what JE thinks your record sizes are. Run this command:
java -jar je.jar DbPrintLog -h <envhome> -S
and you'll see some output that talks about different types of log entries, and their sizes. Look at the lines that say LN and LN_TX at the top. These are data records. Do they match the sizes you expect? These lines do include JE's per-record headers. How large that is depends on whether your data is transactional or not. Non-transactional data records have a header of about 35 bytes, whereas transactional data records have 60 bytes added to them. If your data is small, that can be quite a large percentage. This is quite a lot more than for BDB (Core), partly because BDB (Core) doesn't have record level locking, and partly because we store a number of internal fields as 64 bit rather than 16 or 32 bit values.
The line that's labelled "key/data" shows what portion JE thinks is the application's data. Note that DbPrintLog, unlike DbSpace, doesn't account for obsoleteness, so while you'll see a more detailed picture of what the records look like in the log, you may see more records than you expect.
A last step we can take is to send you a development version of DbSpace that has a new feature to recalculate the utilization level. It runs more slowly than the vanilla DbSpace, but is a way of double checking the utilization level.
In my first response, I suggested trying je.cleaner.forceCleanFiles just to make it clear that the cleaner will run, and to see if the problem is really around the question of what the utilization level should be. Setting that property lets the cleaner bypass the utilization trigger. If using it really reduced the size of your logs, it reinforces that your idea of what your application is doing is correct, and casts suspicion on the utilization calculation.
So in summary, let's try these steps
- use DbDump and DbPrintLog to double check the amount and size of your application data
- make a table of runs, that shows the log size in bytes, number of log files, and the utilization level reported by DbSpace
- run a je.cleaner.forceCleanFiles cleanLog loop on one of the logs that seems to have a high utilization level, and see how much it reduces to, and what the resulting utilization level is
If it all points to JE, we'll probably take it offline, and ask for your test case.
Regards,
Linda

I have a Macbook with 10.5.8 OS on it. It is a daul boot with Wondows XP. Everytime I type in word or Outlook on the PC side the cusor is jumping around. It jumps up about 4-5 lines. Does any one have a solution?

I am having probelm with my Macbook with dual boot to PC - XP. when I am typing in Word or Outlook the cursor is jumping up 4-5 lines or it will clear the text I have typed.Someone suggested that I lower the sensitivity of the trackpad but that didn't work. Any possbile ideas would be wonderful- it is driving me crazy....

greytdogs wrote:
Any advice to a girl who understands very little about computers would be greatly appreciated.
Have someone look at your machine, discuss upgrading the operating system to 10.6.8 as it will run all your currently installed software (10.7 may not and require more memory, new software purchases)
Also to set up a TimeMachine backup system too.
We can only help those who can help themselves, some need someone to assist them in person.
It's no problem, I don't do my own dental or car work, I turn to those who can assist me with that.
Good Luck

Pls Help about counting the lines of the file in java

private int GrepPBArequestLog(String STRexpression) throws IOException
int totalnum = 0;
try {
String[] cmd = {"grep", "-ic", STRexpression, src};
System.out.println("grep, cmd " STRexpression" "+src);
Process grepProc = Runtime.getRuntime().exec(cmd);
String line = "";
BufferedReader br = new BufferedReader(new InputStreamReader(grepProc.getInputStream()));
line = br.readLine();
System.out.println("read: "+line);
while (line != null)
System.out.println("Line: "+line);
line = line.substring(line.indexOf(":") + 1, line.length());
System.out.println("Substring: "+line);
try
int temp = Integer.parseInt(line);
totalnum = totalnum + temp;
catch(NumberFormatException e)
System.out.println("String: "+line);
System.out.println("NumberFormatException Occured"+e.getMessage());
}//end while
the output is:
service No: 209
Wapdate: 07/Jul/2003
Went inside: GrepPBArequestLog
grep cmd .*07/Jul/2003.*GET.*209.* /var/log/httpd/access_log*
Line:
read: null
totalnum: 0
wap 07/Jul/2003:
wap 209:
total hits 209: 0
+++++++++++++++++++++++++++++++++
the read: should not be null because there is a number of lines and
totalnum shouldn't be 0.

You don't want to simply:
import java.io.*;
public class CountEm {
private static BufferedReader br;
private static int count;
private static String fileName, record;
public static void main(String[] argv) {
    switch(argv.length) {
      case 1: { fileName = argv[0]; break; }
      default: { System.out.println("Usage: java CountEm [filename]"); System.exit(-1); }
    try { countEm(); }
    catch(IOException ioe) { System.out.println("ERROR doing countEm()\n"+ioe); }
    finally { System.out.println("Count: "+count); }
public static void countEm() throws IOException {
    br = new BufferedReader(new FileReader(fileName));
    while ( ( record = br.readLine() ) != null ) { count++; }
}~Bill

Question about AVCHD & Log and Transfer

I will be recording videos in a remote location for five days next month. The recordings will be about 1.5 hr each, for a total of twenty two separate presentations. If I purchase a hard drive camcorder (Sony HDR-XR550V) for this event, will log & transfer dump the whole lot into FCE or will they be split up so I can select them in proper order.
I would rather use a camcorder that recorded to an external memory card, but twenty two gets very expensive.
David

Yes, to use AVCHD material you should upgrade your FCE to version 4.0.1. This is a free upgrade.
To do this:
The first thing you should do is buy or obtain an external hard disk of equal or greater size to the system disk you have now inside your computer and make a +clone copy+ of your system disk. This is to protect you if something should go wrong during the upgrade, or if your internal hard disk should ever fail, you will have a fully functioning copy of your hard disk to use to restore your work.
You can get Carbon Copy Cloner, a shareware software that is almost an industry standard, here:
http://www.bombich.com/
After you have made a clone of your system hard drive, (which may take several hours the first time you do it), then go to the Apple menu in the upper left corner of your screen and select Software Update.
This will look at all the Apple software that is on your computer and find any software that needs updating.
You will be presented by a list of all the software on your computer that can be updated, you should see Final Cut Express somewhere in that list.
If you do not see it, have you moved the application from where it was originally installed, or renamed it? It needs to be in it's original location in the application folder, with it's original name for Software Update to work.
You can deselect any software you don't want updated from the list, then start the software updater.
You may need to restart your machine to complete the installation.
I would expect no difficulties from upgrading your software, but you have your cloned backup just in case. Once you have made a clone back up, get in the habit of re-cloning your drive every other day or so to protect your work. After the initial cloning, the cloning will take much less time as it will only make the changes you have made to your system disk on your clone - not recopy the whole thing as it did the first time.
Hope this helps.
MtD

About ODI Log Line granularity

Similar Messages

Maybe you are looking for