TTA 4.00.903 billing failure

Question

Hi,
there seems to be a bug with the billing component of TTA 4.00.903 on
Linux.
If the piriod of the billing report is such that the report is empty, the
command works:
lin:/opt/tarantella/bin # ./tarantella query billing full start
2005/02/13 --days 1
Generating billing report from files dated
2005.02.13-00.00.00 up to 2005.02.13-23.59.59
for the following servers: lin.local.net
Downloaded 0 billing files from "lin.local.net"
Starting to process files in:
/opt/tarantella/var/log/billing/tmp.1108744129
Please wait...
report,,,,,2005/02/13 00:00:00,1
But for period with non-empty billing recording,
the tarantella command produces a communication error:
lin:/opt/tarantella/bin # ./tarantella query billing full start
2005/02/14 --days 1
Generating billing report from files dated
2005.02.14-00.00.00 up to 2005.02.14-23.59.59
for the following servers: lin.local.net
Failed to download billing files from server "lin.local.net" to local
directory: /opt/tarantella/var/log/billing/tmp.1108744470
The error was: commproblem
Tracing the problem, using tcpdump on the
loopback interface shows, that from TTA port
5427 indeed the contents of the billing file
/opt/tarantella/var/log/billing/days/2005.02.14-00.00.00.csv
is transfered, but then a problem seems to be
arose...
Many thanks in advance,
Tankred

Answer 1

Carmelo,
in deed, I got now following in 'glue.log':
============================================
2005/02/25 16:22:18.147 (pid 13678) server/glue/info
#1109344938147
Encountered an exception during an ASAD operation:
javax.naming.CommunicationException [Root exception is
java.io.FileNotFoundException:
/opt/tarantella/var/log/billing/tmp.1109344938/aep.pass-consulting.com.2005.02.21-00.00.00.csv
(Permission denied)]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
at java.lang.Class.newInstance0(Class.java:308)
at java.lang.Class.newInstance(Class.java:261)
at
com.sco.jndi.toolkit.provider.SimpleContinuation.getSimpleException(SimpleContinuation.java:57)
at
com.sco.jndi.toolkit.provider.SimpleContinuation.getSimpleException(SimpleContinuation.java:82)
at
com.sco.jndi.toolkit.provider.ToolkitContext.namingException(ToolkitContext.java:386)
at
com.sco.jndi.toolkit.provider.ToolkitContext.namingException(ToolkitContext.java:361)
at
com.sco.jndi.toolkit.provider.ToolkitContext.namingException(ToolkitContext.java:372)
at
com.sco.jndi.provider.file.FileContext.f_bind(FileContext.java:1139)
at
com.sco.jndi.provider.file.FileContext.f_rebind(FileContext.java:1179)
at
com.sco.jndi.toolkit.provider.SimplePartialCompositeContext.pc_rebind(SimplePartialCompositeContext.java:582)
at
com.sco.jndi.toolkit.provider.SimplePartialCompositeContext.pc_rebind(SimplePartialCompositeContext.java:612)
at
com.sco.jndi.toolkit.provider.PartialCompositeContext.rebind(PartialCompositeContext.java:383)
at
javax.naming.spi.ContinuationDirContext.rebind(ContinuationDirContext.java:169)
at
com.sco.jndi.toolkit.provider.ToolkitContext.nns_rebind(ToolkitContext.java:2081)
at
com.sco.jndi.toolkit.provider.PartialCompositeContext.rebind(PartialCompositeContext.java:385)
at
javax.naming.spi.ContinuationDirContext.rebind(ContinuationDirContext.java:169)
at
com.sco.jndi.toolkit.provider.ToolkitContext.nns_rebind(ToolkitContext.java:2081)
at
com.sco.jndi.toolkit.provider.PartialCompositeContext.rebind(PartialCompositeContext.java:385)
at
javax.naming.spi.ContinuationDirContext.rebind(ContinuationDirContext.java:169)
at
com.sco.jndi.toolkit.provider.ToolkitContext.nns_rebind(ToolkitContext.java:2081)
at
com.sco.jndi.toolkit.provider.PartialCompositeContext.rebind(PartialCompositeContext.java:385)
at
javax.naming.spi.ContinuationDirContext.rebind(ContinuationDirContext.java:169)
at
com.sco.jndi.toolkit.provider.ToolkitContext.nns_rebind(ToolkitContext.java:2081)
at
com.sco.jndi.toolkit.provider.PartialCompositeContext.rebind(PartialCompositeContext.java:385)
at
com.sco.tta.server.glue.CreateAsadOp.doCreate(CreateAsadOp.java:170)
at
com.sco.tta.server.glue.CreateAsadOp.create(CreateAsadOp.java:93)
at
com.sco.tta.server.glue.AsadOpHandler.create(AsadOpHandler.java:221)
at
com.sco.tta.server.server.asad.AsadCalcTask.create(AsadCalcTask.java:983)
at
com.sco.tta.server.server.asad.AsadCalcTask.processEnvelope(AsadCalcTask.java:201)
at com.sco.tta.server.server.CalcTask.runTask(CalcTask.java:125)
at com.sco.tta.server.server.Task.run(Task.java:122)
at com.sco.cid.common.WorkerPool$Worker.run(WorkerPool.java:524)
at java.lang.Thread.run(Thread.java:534)
Caused by: java.io.FileNotFoundException:
/opt/tarantella/var/log/billing/tmp.1109344938/aep.pass-consulting.com.2005.02.21-00.00.00.csv
(Permission denied)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at
com.sco.jndi.provider.file.FileBaseContext.writeFileContents(FileBaseContext.java:322)
at
com.sco.jndi.provider.file.FileBaseContext.writeFileContents(FileBaseContext.java:450)
at
com.sco.jndi.provider.file.FileBaseContext.setFileAttributes(FileBaseContext.java:483)
at
com.sco.jndi.provider.file.FileContext.f_bind(FileContext.java:1132)
... 25 more
============================================
This lead me to the idea, the permissions of the
billing directory could be wrong, but it
wasn't. The problem remains, even when I
gave this directory all permission to all,
means:
chmod 0777 /opt/tarantells/var/log/billing
So I believe, the process can't write the
file (cf. log):
/opt/tarantella/var/log/billing/tmp.1109344938/aep.pass-consulting.com.2005.02.21-00.00.00.csv
because it doesn't try to create the intermedian
sub-dir 'tmp.1109344938' in 'billing'.
Kind regards,
Tankred
Carmelo wrote:
Tankred,
Can you add one more bit of logging
     server/glue/*:glue.log
and try to generate a query again. Let me know if there is anything
further in the logs.
Thanks,
Tankred Hirschmann wrote:
Once again,
as a workaround for the reported problem,
I collect billing records directly from
/opt/tarantella/var/log/billing/days (in the
case of an 1-server array).
The csv files there have a little bit different
format as the output from
tarantella query billing command has.
Okay, the header is:
id,time,type,user,runtime,livetime,app,server,ipaddress
time seems to be te start time of the webtop or
emulator session as 'yyyy/mm/dd hh:mm:ss'
runtime and livetime are in milliseconds.
It remain some detail questions:
- what is the difference between runtime and
lifetime
- how to merge information from an number of
csv file, witch may contain records with the
same session-id (in the case of long running
sessions)
Any hints will be welcome.
Kind regards,
Tankred
Tankred Hirschmann wrote:
Hi Carmelo,
the problem exists on two different installations:
1) SuSE 9.2 with one interface
2) redhat 3ES with 3 interfaces (internat,
local management, cross link to a WTS)
in both situations the array contains only
one server, so all inter array communication
goes over the loopback interface (lo), and
this I can check via tcpdump...
The failure remains the same after archiving,
nothing about billing in summary.txt.
Turning billing log, gives only several messages
like:
2005/02/23 12:55:00.001 (pid 3184) server/billing/moreinfo
#1109159700001
Completed billing checkpoint.
2005/02/23 12:55:57.049 (pid 3184) server/billing/moreinfo
#1109159757049
Completed a run of the decay process.
No special message appears during one runs
tarantella query billing ...
Kind regards,
Tankred
Carmelo wrote:
Tankred,
I forgot to add that you can add some logging to help identify the
problem.
>>
>>
In the Array Manager in the Log Filter section, please add the following
server/billing/*:billing%%PID%%.log
For your testing, first archive the logs
$ tarantella archive
Next run your billing command and if you can reproduce this error, then
run the archive command again and looking in
/opt/tarantella/var/log/1
for the billing log and see if it points at any problem. If you can can
post the log, that would be appreciated.
Regards,     
Carmelo wrote:
Tankred,
Can you tell us a bit more about your system?
* What version of Linux are you running?
* Does your system have multiple nics?
* What about swap file size?
* Single server or multi-server array?
Anything in the logs related to billing? Due to the log rotation, you
should have a summary.txt file on /opt/tarantella/var/log/1
Thanks,
Tankred Hirschmann wrote:
Hi,
there seems to be a bug with the billing component of TTA 4.00.903 on
Linux.
If the piriod of the billing report is such that the report is empty,
the
command works:
lin:/opt/tarantella/bin # ./tarantella query billing full start
2005/02/13 --days 1
Generating billing report from files dated
2005.02.13-00.00.00 up to 2005.02.13-23.59.59
for the following servers: lin.local.net
Downloaded 0 billing files from "lin.local.net"
Starting to process files in:
/opt/tarantella/var/log/billing/tmp.1108744129
Please wait...
report,,,,,2005/02/13 00:00:00,1
But for period with non-empty billing recording, the tarantella
command produces a communication error:
lin:/opt/tarantella/bin # ./tarantella query billing full start
2005/02/14 --days 1
Generating billing report from files dated
2005.02.14-00.00.00 up to 2005.02.14-23.59.59
for the following servers: lin.local.net
Failed to download billing files from server "lin.local.net" to local
directory: /opt/tarantella/var/log/billing/tmp.1108744470
The error was: commproblem
Tracing the problem, using tcpdump on the
loopback interface shows, that from TTA port
5427 indeed the contents of the billing file
/opt/tarantella/var/log/billing/days/2005.02.14-00.00.00.csv
is transfered, but then a problem seems to be
arose...
Many thanks in advance,
Tankred