Log file analysis

Hi to all Developers.
I am developing an application for web statistics analysis.
The main part of it is to get the log file of website from server.
We can get the log file from web hosting site by manually.
But i want to get the log file through the ftp connection, but i am not able to locate the
path of the log file. By using ftp (through the code) we can get the public file access,
but how to get the log file.
Thanks in advance.

I am developing application for giving the all statistics of an web
site. where in you can retrieve the stat for the log file of that
website.
the web hosting company provide the control panel access to the site
owner, where in he can get the log file manually by going to the web
hosting site,where he can download the file.
But as i am developing the desktop application one can't ask the user
to download the log file each time when he want to view the stat of
his site.
So i want to give the user as only first time give the path of file,
and through coding(i.e by using ftp connection) i will download the
file only at back end only.
The similar software like web stat analyser, woopara do the same
thing.
I use the beta version of these software and while configuring they
ask only for one time for path of the log file.
so i want to know how to get log file through ftp connection.( The
manual of these software says we can get the log file by specifying
the path of log file such as /logs/access.log.
Thanks.

Similar Messages

Log file analysis - BPELFault - process instance id

Hello,
I'd like to ask you is there any way how to log BPEL process instance id into log files when BPELFault is thrown.
For example in our production logs there are faults like this:
com.oracle.bpel.client.BPELFault: faultName: {{http://schemas.xmlsoap.org/ws/2003/03/business-process/}selectionFailure}
messageType: {}
parts: {{summary=<summary>XPath query string returns zero node.
According to BPEL4WS spec 1.1 section 14.3, The assign activity &lt;to&gt; part query should not return zero node.
Please check the BPEL source at line number "2109" and verify the &lt;to&gt; part xpath query.
Possible reasons behind this problems are: some xml elements/attributes are optional or the xml data is invalid according to XML Schema.
To verify whether XML data received by a process is valid, user can turn on validateXML switch at the domain administration page.
</summary>
But there is no information in which process and instance id it was occured.
There are many processes and instances in our prod server, so it is impossible to identify in which process and in which instance the error was occured.
Is there any way how to configure/implement it so in log file there will be also instance ID ?
For example
com.oracle.bpel.client.BPELFault: faultName: {{http://schemas.xmlsoap.org/ws/2003/03/business-process/}selectionFailure}
messageType: {}
parts: {{....}}
instance id: {12345678}
thank you very much.
Roman

Hi Roman,
Best way is create your fault handling framewrok. Where you create a BPEL process which stores all the faulted values in a table in DB and this BPEL process you can call from you catch blocks. In this way you can easily keep track of the errors and position where the error occurred. Also since you have put all the things in table you can generate reports for your production.
Regards
Sahil

Report LOG File Analysis

Hi I am running a report wich calls couple of other reports. I
have given a trace option in the command prompt like this
TRACEOPTS=(TRACE_PRF,TRACE_SQL,TRACE_TMS) . My report took 1
hour 45 minuites to run and it created a log file as below. Can
any one tell me what the time in the log file represents and how
to decode it ? Also How to read the log file ?
Thanks
Feroz
LOG :
Report:
P:\Business_Analysis_&_Reporting_Tool\Test_REPORT_Templates\STORE
TYPES\RunReports_In_Batch.rep
Logged onto server:
Username:
LOG :
Logged onto server: cposp201
Username: t2727
14:30:52 SQL EXECUTE QUERY : SELECT
team_customer_department FROM WM_US_PROD_MV_V
group by team_customer_department
15:16:44 SQL EXECUTE QUERY : SELECT DISTINCT Team_GBU
FROM Wm_Us_Prod_Mv
| Report Builder Profiler statistics |
TOTAL ELAPSED Time: 4291215.29 seconds
Reports Time: 4291175.29 seconds ( 0.00% of TOTAL)
ORACLE Time: 40.00 seconds ( 0.00% of
TOTAL)
UPI: 1.00 seconds
SQL: 39.00 seconds
TOTAL CPU Time used by process: N/A

Hi I am running a report wich calls couple of other reports. I
have given a trace option in the command prompt like this
TRACEOPTS=(TRACE_PRF,TRACE_SQL,TRACE_TMS) . My report took 1
hour 45 minuites to run and it created a log file as below. Can
any one tell me what the time in the log file represents and how
to decode it ? Also How to read the log file ?
Thanks
Feroz
LOG :
Report:
P:\Business_Analysis_&_Reporting_Tool\Test_REPORT_Templates\STORE
TYPES\RunReports_In_Batch.rep
Logged onto server:
Username:
LOG :
Logged onto server: cposp201
Username: t2727
14:30:52 SQL EXECUTE QUERY : SELECT
team_customer_department FROM WM_US_PROD_MV_V
group by team_customer_department
15:16:44 SQL EXECUTE QUERY : SELECT DISTINCT Team_GBU
FROM Wm_Us_Prod_Mv
| Report Builder Profiler statistics |
TOTAL ELAPSED Time: 4291215.29 seconds
Reports Time: 4291175.29 seconds ( 0.00% of TOTAL)
ORACLE Time: 40.00 seconds ( 0.00% of
TOTAL)
UPI: 1.00 seconds
SQL: 39.00 seconds
TOTAL CPU Time used by process: N/A

Referrer log file?

Is there any way to change the log format for the access log to include the referrer? Or to add a separate referrer log file? I know I can do this and much more with a filter or other programmatic technique, but I was looking to do some quick and dirty log file analysis. This is for Sun Application Server 1.4.
Thanks in advance.

Unfortunatly, the Access Log API is not public, so yoiu can't do what you want. I will file an RFE and see if I can add this feature for the next release.
Thanks
-- Jeanfrancois

The analysis of a Apache log file

What will you recommend for the analysis of a Apache log file?

Your favorite text-editor?
Are you looking for some specific analysis? There surely are tools available for that.
Can you be more specific in your question, please.
cu
Andreas

Java.util.logging: write to one log file from many application (classes)

I have a menuapp to launch many applications, all running in same JVM and i want to add logging information to them, using java.util.logging.
Intention is to redirect the logginginfo to a specific file within the menuapp. Then i want all logging from all applications written in same file. Finally, if needed (but i don't think it is), i will include code to write logging to specific file per app (class). The latter is probably not neccessary because there are tools to analyse the logging-files and allow to select filters on specific classes only.
The applications are in their own packages/jars and contain following logging-code:
        // Redirect error output
        try {
            myHandler = new FileHandler("myLogging.xml",1000000,2);
        } catch (IOException e) {
          System.out.println("Could not create file. Using the console handler");
        myLogger.addHandler(myHandler);
        myLogger.info("Our first logging message");
        myLogger.severe("Something terrible happened");
        ...When i launch the menuapplication, it writes info to "myLogging.xml.0"
but when i launch an application, the app writes info to "myLogging.xml.0.1"
I already tried to leave out the creation of a new Filehandler (try/catch block in code above) but it doesn't help.
Is it possible to write loginfo to same specific file?

You should open/close it somehow at every write from different processes.
But I personally prefer different file names to your forced merging, though.

Apple Mobile Device Support fails to install. Log file provided.

I have uninstalled the older version of itunes and all associated files in the reccommended order. In particular I have verified all Apple Mobile Device files, services and registry entries have been removed. I then downloaded itunes version 11.0.3 to my PC and installed the product. Other than AMDS the product loaded onto my PC and appears to work ok, including being able to recognise my ipod. Unfortunately itunes does not recognise my iphone.
However, the install produced two error messages.
First Error:
Program Files\itunes\ipodUpdaterExt.dll failed to register.
HRESULT-1073741819
Contact your support personnel
Second Error:
Service 'Apple Mobile Device' failed to start. Verify you have sufficient privileges to start system services
During the install, the program 'rolled back' the portion related to AMDS. To further analyse the problem I extracted the AppleMobileDeviceSupport64.msi from the itunes64Setup.exe file. I ran the .msi file as the System Administrator and produced a log file. The log file partially contained the following:
DIFXAPP: INFO:   ENTER: DriverPackageInstallW
DIFXAPP: INFO:   Installing INF file 'C:\Program Files\Common Files\Apple\Mobile Device Support\NetDrivers\netaapl64.inf' (Plug and Play).
DIFXAPP: INFO:   Could not open file C:\Windows\System32\DriverStore\FileRepository\netaapl64.inf_amd64_neutral_bf78 5db627c6d127\netaapl64.inf. (Error code 0x3: The system cannot find the path specified.)
DIFXAPP: ERROR: PnP Install failed. (Error code 0x3EE: The volume for a file has been externally altered so that the opened file is no longer valid.)
DIFXAPP: INFO:   Attempting to rollback ...
DIFXAPP: INFO:   No devices to rollback
DIFXAPP: INFO:   Successfully removed '{4241D803-8012-4EA8-9DF1-63C9C886FCED}' from reference list of driver store entry 'C:\Windows\System32\DriverStore\FileRepository\netaapl64.inf_amd64_neutral_bf7 85db627c6d127\netaapl64.inf'
DIFXAPP: INFO:   RETURN: DriverPackageInstallW (0x3EE)
DIFXAPP: ERROR: encountered while installing driver package 'C:\Program Files\Common Files\Apple\Mobile Device Support\NetDrivers\netaapl64.inf'
DIFXAPP: ERROR: InstallDriverPackages failed with error 0x3EE
DIFXAPP: RETURN: InstallDriverPackages() 1006 (0x3EE)
CustomAction MsiInstallDrivers returned actual error code 1603 (note this may not be 100% accurate if translation happened inside sandbox)
Action ended 18:53:33: InstallFinalize. Return value 3.
Action 18:53:33: Rollback. Rolling back action:
Rollback: MsiInstallDrivers
Rollback: MsiRollbackInstall
I am not sure why the program is looking for the netaapI64.inf file in the
C:\Windows\System32\DriverStore\FileRepository\netaapl64.inf_amd64_neutral_bf785db627c6d127\ folder.
This file currently exists in:
C:\Windows\System32\DriverStore\FileRepository\netaapl64.inf_amd64_neutral_dc2cbd989eec1514\ folder.
I would very much appreciate your help

I just came across this:
https://discussions.apple.com/thread/3960640?start=0&tstart=0
See if this helps.

SQL Loader is creating a log file of 0 (zero) bytes.

Hello!!
I am using SQL Loader to load data from a .txt file to a Oracle table.
Following is the control file:
LOAD DATA
CHARACTERSET UTF8
CONTINUEIF LAST != "|"
INTO TABLE product_review_dtl
FIELDS TERMINATED BY '||' TRAILING NULLCOLS
indiv_review_id INTEGER EXTERNAL,
pid INTEGER EXTERNAL,
merchant_review_id INTEGER EXTERNAL,
merchant_user_id CHAR "SUBSTR(:merchant_user_id,1,20)",
review_status_txt CHAR "SUBSTR(:review_status_txt,1,20)",
review_create_date DATE "YYYY-MM-DD",
helpful_votes_cnt INTEGER EXTERNAL,
not_helpful_votes_cnt INTEGER EXTERNAL,
review_source_txt CHAR "SUBSTR(:review_source_txt,1,30)",
overall_rating_num INTEGER EXTERNAL,
comment_txt CHAR(4000) "SUBSTR(:comment_txt,1,4000)",
nickname CHAR "SUBSTR(:nickname,1,30)",
headline_txt CHAR "SUBSTR(:headline_txt,1,100)",
confirmed_status_grp INTEGER EXTERNAL "TO_NUMBER(SUBSTR(TO_CHAR(:confirmed_status_grp),1,5))",
location_txt CHAR "SUBSTR(:location_txt,1,100)"
Some records are loaded. A log file is also created but it is empty. Can you help me find out why the log file is empty?

user525235 wrote:
Hello Folks!!
I have 2 input files with different encoding (apparent in case of special characters).
File 1 loads successfully. For File 2 loader gives a memory fault while loading. Hence the log file is of 0 bytes. I still have no clue as to why is the loader giving a memory fault. It is not an OS level memory fault as analysed by the OS team. Please help!
Thanks in advance :)Unknown OS
Unknown database version
No details about what import command was used or the options specified
No samples / details of input files or their encoding
No details about exact error message of "memory fault"
No help is possible ;-)
Srini

Errors appeared in alert log file should send an email

Hi,
I have one requirement to do, as i am new dba, i dont know how to do this,
sendmail is configured on my unix machine, but dont know how to send the errors appeared in alert logfile should send an email to administrator.
daily, it has to check the errors in alert log file, if any errors occurs(ORA- errors or WARNING errors) should send an email to administrator.
please help me how to do it

Hi,
There are many methods for interrogating the alert log and sending e-mail. Here are my notes:
http://www.dba-oracle.com/t_alert_log_monitoring_errors.htm
- PL/SQL or Java with e-mail alert: http://www.dba-village.com/village/dvp_papers.PaperDetails?PaperIdA=2383
- Shell script - Database independent and on same level as alert log file and e-mail.
- OEM - Too inflexible for complex alert log analysis rules
- SQL against the alert log - You can define the alert log file as an external table and detect messages with SQL and then e-mail.
Because the alert log is a server side flat file and because e-mail is also at the OS-level, I like to use a server side scell script. It's also far more robust then OEM, especially when combining and evaluating multiple alert log events. Jon Emmons has great notes on this:
http://www.lifeaftercoffee.com/2007/12/04/when-to-use-shell-scripts/
If you are on Windows, see here:
http://www.dba-oracle.com/t_windows_alert_log_script.htm
For UNIX, Linux, Jon Emmons has a great alert log e-mail script.
Hope this helps . . . .
Donald K. Burleson
Oracle Press author

How to store data into log file(.doc) using CVI

The purpose is to store the capture data(from my cvi program) and store into the log file (.doc). so at the end of the program run I can retrieve the doc file where the data store to do my analysing .
Why do this: I wanted to create my program into .exe file that why I need this method or do u have other method to intro?
Any ideal or note or example to share? Pls help

If you are explicitly trying to create a Microsoft Word document, then CVI comes with Word Report instrument that can be used to generate such files. The instrument is located in toolslib\activex\word\wordreport.fp, while a sample program can be found in samples\activex\word\wordrpt.cws.
I suggest you take a look at the example program that illustrates the fundamentals of this instrument, next you can start designing your own application using that instrument.
Proud to use LW/CVI from 3.1 on.
My contributions to the Developer Zone Community
If I have helped you, why not giving me a kudos?

IMP: How to Read LOG Files

Hey Gurus,
   I want to read the log files after executing SE37 t-codes, I tried in sm21 but i didnt get any result.
   Can U tell me how to read the log files ??
   what is T-code for that? or i have change any settings???
Thanking You,
    Regards
   J Sarathi

Hi ,
You can use these two FM for analysing the log ..
               APPL_LOG_READ_INTERN
               APPL_LOG_DISPLAY_INTERN
Or You can create A Zprogram using this FM
and check the changes using RSDEPEND

Why size of archive log file increasing in merge clause

my database is running in archive log mode.
someone is running oracle merge statement. still it is running.
He will issue commit after the operation.
in that period redolog file increasing now.
my question is why size of archive log file increasing with redolog file.
i know that after commit archive log file should generate.(may be it is wrong).
please suggest........
Edited by: 855516 on Mar 13, 2012 11:18 AM

855516 wrote:
my database is running in archive log mode.
someone is running oracle merge statement. still it is running.
He will issue commit after the operation.
in that period redolog file increasing now.
my question is why size of archive log file increasing with redolog file.
i know that after commit archive log file should generate.(may be it is wrong). No this is not correct that after commit archive log will generate....You know merge statement causes the insert (if data not present already) or update if database is present.. Obviously these operation will generate lots of redo if the amount of data been processed is high.
If you feel that this operation is causing excessive of redo then root cause analysis should be done...
For that use Logminer (excellent tool to provide segment level breakdown of redo size). V$logmnr_contens has columns redo block and redo byte address associated with the current redo
change
There are some gudlines in order to reduce redos( which may vary in any environment)
1) check if there are unwanted indexes being used in tables which are refereed in merge. If yes then remove those could bring down the redo
2) Use global temporary tables to reduce redo (if there is a need to keep data only temporarily in a session)
3) Use nologging if possible (but see its implications)
Hope this helps

Incosistencies between Analyzer Server Console and stout.log file

Hi, In stout.log file of application server file there is a record: "Setting Current User Count To: 2 Users. Maximum Concurrent Licensed User Count Is: 10 Users." So 2 licences are ured, but checking "Analyer Server Console" there is only one user connected. After restarting computer "Analyzer Server Console" and stout.log number of users are sinhronized. But I don't know what happens, but after some time this two parameters are not sinhronized anymore. My problem: I have to show the number of user licences used and I am reading info rom stout.log. But something is not correct - it looks like stout.log doesn't show correct values? Do I need to specify some setting or is there a bug in code? My system: Hyperion Analytic Server version 7.1.0 Hyperion Analyzer Server version 7.0.1.8.01830 IBM DB2 Workgroup Edition version 8 fixpack 9 Tomcat version 4 Windows 2003 Server

Hi grofaty. We use 7.0.0.0.01472 and I had experienced the same behaviour, Analyzer Server Console shows one more session than stdout.log. If this difference 1 is a static value than you can assume it as an systematic bug...and do your license counting on it... But again the Analyzer Server Console is not good as it should be for productive usage because all the information is only logged online til the next application restart. E.g. it is not helpful in using it for user tracking purposes. Do you use the stdout.log in such a way or have an idea how to grep measures for session logging analysis: - Session ID - User ID - Client ID - Total Number of Requests - Average Response (sec) - Login Time - Number of concurrent sessions ?

Where are SmartView BI+ Content Independent Provider Log Files

We are on Oracle/Hyperion v11.1.1.3 (BI/Foundation/Planning Services on Solaris Unix; Weblogic; Essbase on Windows).
Our users have created some MS Powepoint presentations that contain pages that run a Financial Report (FR) which queries data from a planning application using a "Hyperion Reporting and Analysis" Independent provider connection (example: "http://server_name:19000/workspace/browse/listxml").
I am unable to find the location of the log files that shows where logon/activity is tracked. We have looked and only find tracing information from Essbase log files when the query runs and authentication happens at the Essbase level but need to find where the other log information (including APS service activity) is logged to.
Thanks.

Hello Ramkumar,
Go through the link https://help.sap.com/saphelp_nw73/helpdata/en/21/e77dc01e694f4f89ad6a833420c7d5/content.htm?frameset=/en/6a/f247bf0ce745…
for more information..
Regards
Subbarao M

BO Core File Analysis

Hi Experts ,
BO Core File Analysis :
I would like to learn doing analysis on core files, it happens many time that we get core generated we usually go for file command on core file and go for dbx and get the output , we will try to find something in log files on that crashed process or servers.
Is there any detailed guide and document or tutorial available ? , I want to understand the core written to find out the cause why and why it is happening
Please advice.
Regards,
Neo.

Expecting something on this .
Regards,

Log file analysis

Similar Messages

Maybe you are looking for