Log Analysis tools with cgi programs (slightlyoff-topic)

Has anyone used a log analysis tool successfully in conjunction with
WebEnterprise to track what users are doing?
We have a WebEnterprise app that does not really have any of that sort of
tracking built into it, so we're interested in trying to extract as much
usage information as we can from the web logs. Since there is little use of
HTTP POST operations, most of the information we would need is in fact
available in the URL, but we have not yet found the "ideal" tool for doing
this analysis. We do not want to spend a lot of time with PERL or something
writing our own tool, but many of the commercial ones seem to have limited
ability to deal effectively with parsing arguments to CGI programs in the
URL.
Any suggestions on products that do this well with any easy-to-user admin
interface and (preferable) nice-looking HTML reports?
Sam Yates
Systems Analyst
Amgen
[email protected] <mailto:[email protected]>
(805) 447-1574
To unsubscribe, email '[email protected]' with
'unsubscribe forte-users' as the body of the message.
Searchable thread archive <URL:http://pinehurst.sageit.com/listarchive/>

Similar Messages

Log analysis Tool

Hi,
I need info regd. log files generated by Weblogic5.1.
I found 3 log files namely,weblogic.log,jdbc.log,access.log.
Is there any other log files generated by Weblogic.
I am using IIS as WebServer (using iisproxy.dll). IIS is also creating one logfile
under c:\tmp folder.
Pl. give me info on list of log files created by Weblogic & IIS. Which files are
good to analysis for getting website statistics.
I am looking for Log Analysis Tool. Pl. give me list of free/low price tools.
Thanx
-Kalyan

Hi.
kalyan wrote:
Hi,
I need info regd. log files generated by Weblogic5.1.
I found 3 log files namely,weblogic.log,jdbc.log,access.log.
Is there any other log files generated by Weblogic.
No, those are the only 3 log files created by WLS.
>
I am using IIS as WebServer (using iisproxy.dll). IIS is also creating one logfile
under c:\tmp folder.The ISAPI plugin is creating this file because you have the Debug parameter set to ON
>
>
Pl. give me info on list of log files created by Weblogic & IIS. Which files are
good to analysis for getting website statistics.The best logs for web stats are the access.log file and the wlproxy.log file. You can
set different logging levels for the wlproxy.log file - read the plugin documentation
for more info on this.
>
>
I am looking for Log Analysis Tool. Pl. give me list of free/low price tools.We don't recommend specific log analysis tools - although there are several out there,
and probably more than a few low-cost ones. Perhaps someone else can answer this one.
Regards,
Michael
>
>
Thanx
-Kalyan--
Developer Relations Engineer
BEA Support

Does Sun ONE Web Proxy Server have built-in log analysis tools? What kind o

Sun ONE Web Proxy Server automatically logs all requests using either the common log-file format or an extended log-file format. The extended log-file format includes the referrer field and user agent. You can also create your own log file format by selecting which HTTP fields you would like to log. A built-in log analysis program includes reports such as total number of requests, total bytes transfered, most commmon URLs requested, most common IP addresses making requests, performance during peak periods, cache hit rates, and estimated response time reduction. The items logged and the analysis program are completely configurable using the server manager's HTML form.

Sun Java System Web Server is a web server; it serves web pages to web clients. Sun Java System Web Proxy Server, on the other hand, is a web proxy server; it routes requests/responses between web servers and web clients.
You can configure Web Server to act as a simple reverse proxy by installing the Web Server 6.1 Reverse Proxy Plugin. This doesn't provide any of the forward proxy or caching proxy functionality found in Web Proxy Server.
Both Web Server 6.1 and Web Proxy Server 4.0 are supported on Solaris 10.

RTMT logs Analysis tool

Dears,
is there any tool to analyse the RTMT logs and IOS logs.
it is hard to go line by line for troubleshooting
thanks in advance
Anas

And there is no other way to do this right than going line by line, tools won't show you every single message as a text editor will, and will often hide the lines that will tell you exactly what is going wrong.
Use tools line notepad++ to highlight and search for specific keywords or process IDs to follow a specific call and review the whole logs.

Adobe Reader used with Bidmail program

Hello-
I am currently having a problem using the "hand tool" with a program called "Bidmail." Bidmail is a social networking site for contractors to share pdf. files online. My problem is, when I log into bidmail.com, I open up a pdf. file to view and cannot use the "hand tool" to scroll left, right, up or down. The hand tool never grabs on to the page for me to scroll. It tends to highlight areas in blue than move the selected page up, down left or right. Does anyone have a solution to my problem?
I am using Windows XP if that helps any.

Contact the support of Bidmail.

Apache log analysis for portal page visits etc

We are about to go into production with Oracle Portal (9iAS rel 9.0.2.0.1).
I have been looking into how to gather statistics on web site usage and have concluded that I cannot get the information from within portal logs since many pages are served from the cache and there is no interaction with the database at all.
I think I need to, therefore, analyse the apache log files. Can anyone recommend a good 3rd party product for log analysis? I am also concerned that the portal specific urls might severely limit the usefullness of the data I can extract.
Has anyone used a log analysis tool in conjunction with Portal or knows of a product with a specific add-on for Oracle Portal (I have seen these for other portals and CMS products).
Any pointers appreciated, I am completely new to this area.
Peter.

Peter,
You might want to look at the "ClickStream Collector" that is included in a 9iAS installation.
I'm not sure if it will do what you want with Portal, but it's starting point.
Good luck!
Bill G...

CS5 Speech Analysis Tool For Transcription, Acceptable Media Types?

Hi all,
I've been fiddling with the oh so handy, speech analysis toolin CS5 PPro, and can really see the potential for cutting down on transciption time. I spent a bit of time poking around the CS5 PPro help document, as well as tutorials via lynda.com etc. to gain a bit more insight into the file types that the speech analysis will accept and am drawing a blank other than the observations I have made doing a bit of experimenting with the feature. So far, I can not get the tool to recognize 2 of our 3 cameras, native media. Currently it will analyze only raw media shot via SDHC Class 6 cards on a JVC HGMY700 in 1080i60 format. The other two camera/media types in question are Panasonic P2 MXF files and Ikegami HDS-V10 MXF files, both are also 1080i60 format.
Is there perhaps a codec/plug-in etc. available to access the speech analysis tool with these other types of media? I have found it works well with quicktime .mov files, but I might end up spending as much time waiting to convert the file to an .mov as I would just transcribing the old fashioned way.
Any insight on how I might best utilize this tool would be greatly appreciated. Thank you!
On a separate random note, if anyone has any useful info, links or otherwise, in regards to media management using CatDV and Cache-A for archive, it would also be appreciated. That's one of many projects looming...
Lindsay

Believe it or not, it has nothing to do with the media type--well, specifically, it doesn't have anything to do with the format or codec.
So, what's the problem? Annoyingly, Panasonic P2 structures are write-protected--that is, they're marked as "Read-only." While this isn't much of a problem in normal operation, when you try to do things like speech transcription (and other metadata entry, if I recall correctly), you'll effectively be shut out. The files in the structure are writeable, but the structure itself is not.
Yep. Weird.
What to do? In Explorer, simply right-click the CONTENTS folder (you might even be able to do this at the top level, if you save your P2 offloads in that way), click Properties, and clear the Read-only checkbox in Attributes. Once the Read-only attribute is cleared, you should be able to run Speech Analysis on the P2 clips. You'll probably want to change the Read-only flag with Premiere Pro closed.
Now--that might not solve it. There seems to be a latent bug in Pr that prevents you from running Speech Analysis on a single P2 MXF clip. If this seems to be the case, try selecting two or more clips in the Project Panel, and then check to see if the Analyze button or Analyze Content menu command is available. Pretty silly, but at least its a reasonably painless workaround.
Hope that gets things working for you.

HP Protect tool password manager not working with the new version of Mozilla: I got this alert: "Firefox doesn't know how to open this address, because the protocol (dpql) isn't associated with any program." please help

I have an HP ProBook 4520s. I have been using HP Protect tool's Password manager to store and manage my passords for all Login websites in Firefox 3.6. As a result, I just swiped my fingerprint to log on to any website.
After I installed the version 4 of Firefox, my all my login details do not work anymore. I have tried to reset them but I repeatedly get this error: "Firefox doesn't know how to open this address, because the protocol (dpql) isn't associated with any program."
something like this would have been passed onto the address: "dpql://c:\program%20files%20(x86)\hewlett-packard\hp%20protecttools%20security%20manager\bin\dpminionlineids.dll/qlinkload.htm#id=2".
Although the password manager works with Internet Explorer 9, I need it to work with Firefox 4 as this is my preferred browser.
Please help. Thank you!

I guess this means that IE is more user friendly for HP Password Manager finger swipe recall of passwords, a favorite of mine. I still don't see a post from Firefox as to why they haven't produced fix. So I'll switch to IE until things change. I don't see value in downgrading to a Firefox version that's no longer going to be supported.

Developing a data mining tool with cluster analysis

Can anyone help me find any relevant source code to develop a data mining tool with cluster analysis capabilities. I have found bits of source code here and there in C/C++ but haven't found any in Java. I really need to see the source code for a full program as at the moment I am trying to convert C into Java and then don't know how to tie it all together.
As you can imagine - I am a very novice programmer and haven't got much time left to complete my project! Any help would be greatly appreciated!

I really need to see the source code for a full program...
I am a very novice programmerWell then I seriously doubt that even seeing a full program would be any use. Besides do you honestly believe that anybody is going to show you their code for 10d$...
Oh, and don't cross post.

ClassLoader Analysis Tool(CAT) doesn't seem to work with WL10.3

Hi,
I have an EJB running on WL10.3. It uses the Apache Commons Pool 1.6 jar to maintain a Pool of the other component sessions. We recently came to know that WL10.3 already has commons-pool.1.3 jar in its default classpath (module directory), so 1.6 jar is not being referenced at all. So we added META-INF\weblogic-application.xml and used the following setting as per the ClassLoader Analysis Tool(CAT) suggestion. We updated the deployment with this and cleared the cache, restarted, but still the CAT Tool's 'Analyze Conflicts' gives the same suggestion, implying that the changes didn't work. So not sure if this is the problem with the CAT Tool or with the following configuration.
<?xml version="1.0"?>
<weblogic-application xmlns="http://www.bea.com/ns/weblogic/90"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
       <application-param>
            <param-name>webapp.encoding.default</param-name>
            <param-value>UTF-8</param-value>
       </application-param>
       <prefer-application-packages>
            <package-name>org.apache.commons.*</package-name>
       </prefer-application-packages>
</weblogic-application>
Also, Is there any alternative to verify this change, I checked for commons-pool verbose option, so that we could see more details and track the class files. But I don't see any option available. Can anybody help ?
Thanks.

Did you build Elsa with this package from AUR: elsa-svn-arch
The way your elsa.conf looks like indicates to me that you have not.
Please use the package because you are also missing pam-files.

Problem with 'restrict data' option in Web Analysis' Analysis Tool

I feel like i'm in the twilight zone.
We have made a report in web analysis, withh essbase as a source, and works fine.
We want to restrict data for customers that generate more than 1,000,000 revenue, for example
So, we go to Analysis tools, restrict data. The dialog window opens
We hit 'Select Column...' and nothing happens. No Column is shown, thus being unable to complete the dialog.
Should we enable something in essbase to allow this? We are newbies, but we think this should be pretty straightforward.
We have also tried to do that with the Analysis tools administrator, with the same result.
We are using Web Analysis 9.3.1.
Any feedback will be appreciated.
Thank you
Edited by: hectorsosar on 22/06/2009 02:31 PM

It got fixed by removing a filter from a dimension, and placing that dimension as a page.
Thanks,
Hector

When ever I use Adobe reader 11 with a USB device, I cannot safe remove the USB device and get the following message (or similar one) in system log: The application \Device\HarddiskVolume1\Program Files (x86)\Adobe\Reader 11.0\Reader\AcroRd32.exe with pr

When ever I use Adobe reader 11 with a USB device, I cannot safe remove the USB device and get the following message (or similar one) in system log: The application \Device\HarddiskVolume1\Program Files (x86)\Adobe\Reader 11.0\Reader\AcroRd32.exe with process id 6620 stopped the removal or ejection for the device USB\VID_05DC&PID_C75C\20131215015821328FC8.
I am running on Windows Server 2012 R2 in Desktop Experience mode.
Any ideas?
Roger

In addition to that symptom, I discovered that even though I had closed all Adobe Reader sessions, the processes kept running and used up 90%+ of my CPU.

Error 500 with cgi

hello
When i load a cgi program with my iplanet server i have a 500 error message and in the error.log :
"[04/Dec/2001:20:02:05] failure (22308): for host 10.67.209.59 trying to POST /cgi-bin/EnvoiFormulaire, cgieng_scan_heade
rs reports: the CGI program /space/iw3/iplanet/FEU/server_root/extension/cgi/EnvoiFormulaire did not produce a valid hea
der (program terminated without a valid CGI header. Check for core dump or other abnormal termination)"
my obj.conf is like this :
"Init fn="flex-init" access="/space/iw3/iplanet/FEU/server_root/logs/acces.log" format.access="%Ses->client.ip% - %Req->v
ars.auth-user% [%SYSDATE%] \"%Req->reqpb.clf-request%\" %Req->srvhdrs.clf-status% %Req->srvhdrs.content-length%"
Init fn="load-types" mime-types="mime.types"
Init fn="init-cgi" ORACLE_HOME="/space/iw3/iplanet/FEU/server_root/oracle" TWO_TASK=""
<Object name="default">
NameTrans fn="pfx2dir" from="/cgi-bin" dir="/space/iw3/iplanet/FEU/server_root/scripts" name="cgi"
NameTrans fn="pfx2dir" from="/java" dir="/space/iw3/iplanet/FEU/server_root/extension/servlets" name="ServletsByExt"
NameTrans fn="document-root" root="/space/iw3/iplanet/FEU/server_root/data"
PathCheck fn="unix-uri-clean"
PathCheck fn="check-acl" acl="default"
PathCheck fn="find-pathinfo"
PathCheck fn="find-index" index-names="index.html,home.html"
ObjectType fn="type-by-extension"
ObjectType fn="force-type" type="text/plain"
Service method="(GET|HEAD)" type="magnus-internal/imagemap" fn="imagemap"
Service method="(GET|HEAD)" type="magnus-internal/directory" fn="index-common"
Service method="(GET|HEAD|POST)" type="*~magnus-internal/*" fn="send-file"
AddLog fn="flex-log" name="access"
</Object>
<Object name="cgi">
ObjectType fn="force-type" type="magnus-internal/cgi"
Service fn="send-cgi"
</Object>
<Object name="ServletByExt">
ObjectType fn="force-type" type="magnus-internal/servlet"
Service type="magnus-internal/servlet" fn="NSServletService"
</Object>
<Object name="es-internal">
PathCheck fn="check-acl" acl="es-internal"
</Object>"
What is the problem???
How to configure well this cgi......
thxs for all ur replies
seb

Dartigues Sebastien wrote:
When i load a cgi program with my iplanet server i have a 500 error
message and in the error.log :
"[04/Dec/2001:20:02:05] failure (22308): for host 10.67.209.59 trying to
POST /cgi-bin/EnvoiFormulaire, cgieng_scan_heade
rs reports: the CGI program
/space/iw3/iplanet/FEU/server_root/extension/cgi/EnvoiFormulaire did not
produce a valid hea
der (program terminated without a valid CGI header. Check for core dump
or other abnormal termination)"At an absolute minimum your CGI needs to provide a hint to iWS about
what it's trying to send to the browser. So your CGI needs to,
minimally, send a Content-Type: line follow by \n\n.
Joe McCabe As I got up in front of them, I felt an intoxication
Moz' Pad that had nothing to do with alcohol. It was the
intoxication of being a public spectacle. -- H. Simpson

Jdk 1.5/1.6 GC log output analyze with GCCiewer. getting warning.

Hi All,
I am trying to analyze gc.log (using jdk 1.5) file with GCViewer (www.tagtraum.com/gcviewer.html ).
It is taking file as "File format: Sun 1.4.x and displaying warning in some data rows like.
INFO [DataReaderFactory]: File format: Sun 1.4.x
INFO [DataReaderSun1_4_0]: Reading Sun 1.4.x/1.5.x format...
WARNUNG [DataReaderSun1_4_0]: Error parsing entry, java.lang.NumberFormatException: 80.493: [CMS-concurrent-mark-start]
WARNUNG [DataReaderSun1_4_0]: Error parsing entry, java.lang.NumberFormatException: For input string: "0.275/0.885 secs] [Times"
WARNUNG [DataReaderSun1_4_0]: Error parsing entry, java.lang.NumberFormatException: 81.378: [CMS-concurrent-preclean-start]
WARNUNG [DataReaderSun1_4_0]: Error parsing entry, java.lang.NumberFormatException: For input string: "0.022/0.023 secs] [Times"
WARNUNG [DataReaderSun1_4_0]: Error parsing entry, java.lang.NumberFormatException: 81.401: [CMS-concurrent-abortable-preclean-start]
When I have added (manually) below line in gc.log as first line. Then GCViewer has accepted this file as "File format: Sun 1.5.x"
1.095: [GC [1 CMS-initial-mark: 25798K(49152K)] 27626K(63936K), 0.0187882 secs] [Times: user=0.02 sys=0.00, real=0.02 secs]
INFO [DataReaderFactory]: File format: Sun 1.5.x
INFO [DataReaderSun1_4_0]: Reading Sun 1.4.x/1.5.x format...
WARNUNG [DataReaderSun1_5_0]: java.lang.NumberFormatException: 82.842: [Full GC 82.842: [CMS82.845: [CMS-concurrent-abortable-preclean: 0.414/1.443 secs] [Times: user=2.07 sys=0.11, real=1.44 secs] while parsing line: 82.842: [Full GC 82.842: [CMS82.845: [CMS-concurrent-abortable-preclean: 0.414/1.443 secs] [Times: user=2.07 sys=0.11, real=1.44 secs]
java.lang.NumberFormatException: 82.842: [Full GC 82.842: [CMS82.845: [CMS-concurrent-abortable-preclean: 0.414/1.443 secs] [Times: user=2.07 sys=0.11, real=1.44 secs]
Now as during analysis, it is not taking care of WARNING lines, means results are not 100% acurate.
I am looking here your advise that which profiling or gc analysis tool is better in respect to jdk 1.5 and 1.6.
Also is there any work around in gc switches, so the generated output will be according to gcViewer tool.
Thanks in advance. Have a nice day.
Regards
Vivek

Hi "mshanu" and "amit" Thanks for ur replies Here I m posting the code of "top.jsp"........!!!!
<%@ page errorPage="errordisplay.jsp"%>
<table cellpadding="0"
       cellspacing="0" height=50 width=780>
       <tbody>
         <tr class="header">
           <td class="logo"><IMG SRC="assets/Logo.gif" BORDER=0 ALIGN=top></td>
           <td align="right"><span class="applicationtitle"><%@ include file="/contents/logo.htm" %></span><br>
           <span class="companyname"><%@ include file="/contents/companyname.htm" %></span></td>
         </tr>
        </tbody>
</table>To include top.jsp I have tried
<jsp:include page="top.jsp" flush="true">
</jsp:include>
         AND
<%@ include file="top.jsp"%>but none of this worked.
If I remove the include then It is working properly.
But I need inluded file too so that I am wondoring for the solution.
This problem seems very wiered to me. I dont know why it is happening.
This problem is started only when I used the TOMCAT 6.14.
Is it the bug of TOMCAT 6.14 or What somebody Plz help.
I got stuck here.........!!!!!!!!!!
It doesn't seem any problem with top.jsp. As per my thinking the problem is there in include due to that it doesn't compile the JSP page in Tomcat 6.0.
Earlier I am having same code running on the Tomcat 5.0.28 and JDK 1.5.0.
But problem occured when I have used Tomcat 6.x...!!

Transport roles and analysis authorization with user assigned

Hi expert,
I face with this problem transport roles and analysis authorization with user assigned. When I have created a transport request to move the roles and analysis authorization from development system to test system. I couldnu2019t maintain the user assigned, after transport I have to assigned manually all of user or create a program to fill AGR_USER table or there are other way.
Thanks for your time,
Luis

Hi,
In role administration, you have the following options for transporting roles:
You can download the roles from one system and upload them into another
You can import the role from a remote system using RFC
You can transport the roles with the transport function.
Role upload loads all role data, including authorization data from a file into the SAP system. The user assignments for the role and the generated profiles for the role are exceptions in this case.
Transporting Roles with the Role Transport Function
       1.      Start the role administration function by choosing Tools ® Administration ® User Maintenance ® Role Administration ® Roles (transaction PFCG).
       2.      Enter the role to be transported and choose Transport Role.
The Mass Transport of Roles screen appears. You can control the default settings for the options Also transport single roles for composite roles and Also transport generated profiles for roles using Customizing switches (see Role Administration Functions in the section Functions of the Utilities Menu).
You should not change the authorizations profiles of the role after you have included the role in a transport request. If you need to change the profiles or generate them for the first time, transport the entire role again afterwards.
For more information go thrpugh the below link
http://help.sap.com/saphelp_nw70/helpdata/EN/6d/7c8cfd410ea040aadf92e1f78107a4/content.htm
Regards,
Marasa.

Log Analysis tools with cgi programs (slightlyoff-topic)

Similar Messages

Maybe you are looking for