Evaluator under Linux, runtime errors and undefined outputs

[Andrew Dunn]

I am running on Linux.

In the output please notice the evaluator failing on loading the
scenario file, printing out values that are undefined and the error at
the end.

If necessary I can host a virtual machine with the framework installed
for debugging.

Here is the output of me running the examplejavada:


Script started on Thu 17 Jun 2010 10:19:50 AM EDT
storrgie@bellona:~/Dev/projects/DXC10/framework/framework/Bin$ ./
ScenarioLoader -a

SL: INFO: Iterating through DAs in:

/home/storrgie/Dev/projects/DXC10/framework/framework/Algs

SL: INFO: Loading Diagnoser: Example Java Diagnosis Algorithm

Starting Oracle...

SDS: INFO: Parsing scenario file: /home/storrgie/Dev/projects/DXC10/
framework/framework/Scenarios/ADAPT-Lite/Exp_1081_pb_ADAPT-Lite.scn

SDS: INFO: Running in abbreviated mode.

SL: INFO: Exiting...

storrgie@bellona:~/Dev/projects/DXC10/framework/framework/Bin$ ./
Evaluator

java.lang.NullPointerException: Null output stream

Loading scenario Example Java Diagnosis Algorithm - ADAPT-Lite -
Exp_1081_pb_ADAPT-Lite.scn failed. Discarding.



DA: Example Java Diagnosis Algorithm

System: ADAPT-Lite

Recovery Cost: [undefined]

Classification Errors: [undefined]

Mean Peak Memory Usage: [undefined] kb

Detection Accuracy: 1.0

False Negatives Rate: 1.0

Mean Time To Isolate: [undefined] ms

Mean Time To Detect: [undefined] ms

Mean CPU Time: [undefined] ms

False Positives Rate: 1.0



Scores for system ADAPT-Lite:

Metric ranking: classificationErrors

1 - (22.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: detectionAccuracy

1 - (3.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: falseNegativesRate

1 - (13.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: falsePositivesRate

1 - (13.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: meanCPUTime

1 - (6.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: meanDetectionTime

1 - (22.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: meanIsolationTime

1 - (15.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: meanPeakMemory

1 - (6.0 pts) - Example Java Diagnosis Algorithm

Metric ranking: recoveryCost

1 - (22.0 pts) - Example Java Diagnosis Algorithm



Final Scores:

Example Java Diagnosis Algorithm - 122.0



Exception in thread "main" java.lang.NullPointerException: Null output
stream

at java.io.PrintStream.<init>(PrintStream.java:94)

at java.io.PrintStream.<init>(PrintStream.java:116)

at java.io.PrintStream.<init>(PrintStream.java:79)

at
org.dxc.api.datatypes.ScenarioStatusData.put(ScenarioStatusData.java:
104)

at
org.dxc.api.connection.ToOracleConnector.sendMessage(ToOracleConnector.java:
56)

at
org.dxc.evaluator.metrics.OracleInterface.shutdown(OracleInterface.java:
76)

at org.dxc.evaluator.Evaluator.main(Evaluator.java:151)


Script done on Thu 17 Jun 2010 10:20:15 AM EDT

[David Garcia]

Took me a while to track down, but this appears to be a bug in the c++
API's DxcConfig class, here being used by the Oracle. I'll email you a
new Oracle binary shortly with a workaround. If other users run into
this problem and need a fix ASAP, email me, otherwise it'll be fixed
in the next release.

David G