1 | Subject: Re: NetKarma Feedback
|
---|
2 | From: Luisa Nevers <lnevers@bbn.com>
|
---|
3 | Date: 10/21/2011 3:16 PM
|
---|
4 | To: "Ping, Robert James" <robping@indiana.edu>
|
---|
5 | CC: "Jensen, Scott" <scjensen@indiana.edu>, Beth Plale <plale@cs.indiana.edu>, Vicraj Thomas <vthomas@bbn.com>, Heidi Picher Dempsey <hpd@bbn.com>
|
---|
6 |
|
---|
7 | While waiting on the answers to my previous email. I tried to use the provenance script
|
---|
8 | and have some additional feedback.
|
---|
9 |
|
---|
10 | 9. The karma-adaptor-2.5.tar.gz file when unpacked creates a directory with no
|
---|
11 | versioning. Configuration files examples show versions as part of the name
|
---|
12 | although not 2.5:
|
---|
13 | "export ADAPTOR_HOME=/home/peng/workspace/Karma-Adaptor-2.0"
|
---|
14 |
|
---|
15 | 10. Using the instructions provided in the NetKarma Version 2.5 Quick Start Guide ,
|
---|
16 | configured and compiled the karma-adaptor and then proceeded to run the
|
---|
17 | provenance_collector.sh script, which fails as follows:
|
---|
18 |
|
---|
19 | lnevers@sendaria:~/netkarma/Karma-Adaptor$ ./provenance_collector.sh logfile-sendaria-15555-1319031471.txt
|
---|
20 | Connecting to Server...
|
---|
21 | Creating Notifications...
|
---|
22 | java.io.IOException: Possibly caused by authentication failure
|
---|
23 | at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:127)
|
---|
24 | at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:298)
|
---|
25 | at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:382)
|
---|
26 | at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:427)
|
---|
27 | at edu.indiana.dsi.karma.messaging.Sender.<init>(Sender.java:49)
|
---|
28 | at edu.indiana.d2i.adaptor.LogParser.<init>(Unknown Source)
|
---|
29 | at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
|
---|
30 | Caused by: com.rabbitmq.client.ShutdownSignalException: connection error; reason: java.io.EOFException
|
---|
31 | at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:81)
|
---|
32 | at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:47)
|
---|
33 | at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:342)
|
---|
34 | at com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:215)
|
---|
35 | at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:296)
|
---|
36 | ... 5 more
|
---|
37 | Caused by: java.io.EOFException
|
---|
38 | at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290)
|
---|
39 | at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:118)
|
---|
40 | at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:133)
|
---|
41 | at com.rabbitmq.client.impl.AMQConnection.readFrame(AMQConnection.java:409)
|
---|
42 | at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:437)
|
---|
43 | doMapping.................
|
---|
44 | doMapping.................
|
---|
45 | Exception in thread "main" java.lang.NullPointerException
|
---|
46 | at edu.indiana.d2i.adaptor.LogParser.closeConnection(Unknown Source)
|
---|
47 | at edu.indiana.d2i.adaptor.LogParser.parseRuleFile(Unknown Source)
|
---|
48 | at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
|
---|
49 |
|
---|
50 | 11. The "NetKarma GUSH Adaptor Tool User Manual V2.5" (August 26, 2011) instructs the
|
---|
51 | user to unpack a file named "karma-adaptor-tool-v2.5.tar.gz" the name of
|
---|
52 | the tgz that is available is "karma-adaptor-2.5.tar.gz".
|
---|
53 |
|
---|
54 | 12. There are inconsistencies in the instructions between the README and the User guide:
|
---|
55 | - README instructs to define ANT_HOME and the User Guide does not.
|
---|
56 | - README instucts run "ant karma-adaptor", User Guide instructs run "ant adaptor".
|
---|
57 |
|
---|
58 | 13. The netkarma_gmoc_adaptor_user_manual_v1.0.0.pdf expects a tar file named
|
---|
59 | NetKarmaGMOC_Adaptor.tar the tgz file available is named netkarmagmocadaptor-1.0.0.tar.gz
|
---|
60 |
|
---|
61 | 14. Using instructions from GMOC Adaptor instructions untarred and ran ant, which failed:
|
---|
62 |
|
---|
63 | lnevers@sendaria:~/netkarma/GMOCAdaptor$ ant create.jar
|
---|
64 | Buildfile: build.xml
|
---|
65 | init:
|
---|
66 | [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen
|
---|
67 | [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
|
---|
68 | [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/lib
|
---|
69 | [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
|
---|
70 | wsdl2java:
|
---|
71 | [java] Retrieving document at '/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
|
---|
72 | [java] Retrieving schema at 'karma_query_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
|
---|
73 | [java] Retrieving schema at 'rdf.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
|
---|
74 | [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
|
---|
75 | [java] Retrieving schema at 'opm.1_1.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
|
---|
76 | [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
|
---|
77 | [java] log4j:WARN No appenders could be found for logger (org.apache.axis2.description.WSDL11ToAllAxisServicesBuilder).
|
---|
78 | [java] log4j:WARN Please initialize the log4j system properly.
|
---|
79 | [java] Exception in thread "main" org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
|
---|
80 | [java] at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:271)
|
---|
81 | [java] at org.apache.axis2.wsdl.WSDL2Code.main(WSDL2Code.java:35)
|
---|
82 | [java] at org.apache.axis2.wsdl.WSDL2Java.main(WSDL2Java.java:24)
|
---|
83 | [java] Caused by: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
|
---|
84 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:534)
|
---|
85 | [java] at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:260)
|
---|
86 | [java] ... 2 more
|
---|
87 | [java] Caused by: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
|
---|
88 | [java] at org.apache.axis2.wsdl.databinding.TypeMappingAdapter.getTypeMappingName(TypeMappingAdapter.java:82)
|
---|
89 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputParamElement(AxisServiceBasedMultiLanguageEmitter.java:2913)
|
---|
90 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputElement(AxisServiceBasedMultiLanguageEmitter.java:2697)
|
---|
91 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.generateMethodElement(AxisServiceBasedMultiLanguageEmitter.java:2261)
|
---|
92 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.loadOperations(AxisServiceBasedMultiLanguageEmitter.java:2151)
|
---|
93 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.createDOMDocumentForInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:826)
|
---|
94 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.writeInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:718)
|
---|
95 | [java] at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:504)
|
---|
96 | [java] ... 3 more
|
---|
97 | [java] Java Result: 1
|
---|
98 | jar:
|
---|
99 | [javac] Compiling 204 source files to /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
|
---|
100 | [jar] Building jar: /home/lnevers/netkarma/GMOCAdaptor/dist/lib/client-stub-types.jar
|
---|
101 | create.compile:
|
---|
102 | [javac] Compiling 4 source files to /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
|
---|
103 | [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:75: cannot find symbol
|
---|
104 | [javac] symbol : class KarmaServiceStub
|
---|
105 | [javac] location: package org.dataandsearch.www.karma._2010._08
|
---|
106 | [javac] import org.dataandsearch.www.karma._2010._08.KarmaServiceStub;
|
---|
107 | [javac] ^
|
---|
108 | [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:148: cannot find symbol
|
---|
109 | [javac] symbol : class KarmaServiceStub
|
---|
110 | [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
|
---|
111 | [javac] KarmaServiceStub stub = null;
|
---|
112 | [javac] ^
|
---|
113 | [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:155: cannot find symbol
|
---|
114 | [javac] symbol : class KarmaServiceStub
|
---|
115 | [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
|
---|
116 | [javac] stub = new KarmaServiceStub(serviceURL);
|
---|
117 | [javac] ^
|
---|
118 | [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:224: cannot find symbol
|
---|
119 | [javac] symbol : method setWorkflowID(java.lang.String)
|
---|
120 | [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceRequestType
|
---|
121 | [javac] findServiceRequest.setWorkflowID(":");
|
---|
122 | [javac] ^
|
---|
123 | [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:271: cannot find symbol
|
---|
124 | [javac] symbol : method getServiceIDList()
|
---|
125 | [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceResponseType
|
---|
126 | [javac] ServiceIDListType serviceids = servicetype.getServiceIDList();
|
---|
127 | [javac] ^
|
---|
128 | [javac] 5 errors
|
---|
129 |
|
---|
130 | BUILD FAILED
|
---|
131 | /home/lnevers/netkarma/GMOCAdaptor/build.xml:76: Compile failed; see the compiler error output for details.
|
---|
132 |
|
---|
133 | Total time: 7 seconds
|
---|
134 |
|
---|
135 |
|
---|
136 | Thanks,
|
---|
137 |
|
---|
138 | Luisa
|
---|
139 |
|
---|
140 | On 10/12/2011 12:28 PM, Luisa Nevers wrote:
|
---|
141 | > Hello Robert,
|
---|
142 | >
|
---|
143 | > I have been taking a look a the NetKarma Version 2.5 and have some feedback.
|
---|
144 | >
|
---|
145 | > 1. The NetKarma Version 2.5 Quick Start Guide instruct the user to download
|
---|
146 | > version 2.0 files rather than version 2.5 :
|
---|
147 | > "https://pti.iu.edu/sites/default/files/karma-adaptor-2.0.tar.gz" and
|
---|
148 | > " https://pti.iu.edu/sites/default/files/karma-adaptor_v2.0_user_manual.pdf"
|
---|
149 | >
|
---|
150 | > 2. The NetKarma Version 2.5 Adaptor requires ANT and JDK to be installed, which
|
---|
151 | > are not listed as prerequisites in the Quick Start Guide. Also RabbitMQ shoudl
|
---|
152 | > be listed as a prerequisite.
|
---|
153 | >
|
---|
154 | > 3. Using the README for the NetKarma Adaptor. In the section named
|
---|
155 | > "Edit the Environment Configuration File" the user is instructed to set
|
---|
156 | > "ADAPTOR_HOME, JAVA_HOME, and ANT_HOME", the first two exist in
|
---|
157 | > the configuration file, but ANT_HOME does not exist.
|
---|
158 | >
|
---|
159 | > 4. The Quick Start Guide Steps 4 and 5 instruct to modify karma-adaptor.properties
|
---|
160 | > and KarmaQueryConfig.txt, but does not provide a path to these files.
|
---|
161 | >
|
---|
162 | > 5. The "NetKarma GUSH Adaptor Tool User Manual" section 2.2 "Service Dependencies"
|
---|
163 | > instructs me to download RabbitMQ, but does not specify if I need the server, the client,
|
---|
164 | > both, or some other component.
|
---|
165 | >
|
---|
166 | > 6. The "NetKarma GUSH Adaptor Tool User Manual" section 3 lists "karma-adaptor.homedir"
|
---|
167 | > as a karma-adaptor.properties setting, but is not found in the file. Is this an optional setting?
|
---|
168 | >
|
---|
169 | > 7. The "NetKarma GUSH Adaptor Tool User Manual" section 3 describes the setting
|
---|
170 | > "messaging.hostname" as "Hostname that hosts RabbitMQ Server" but the configuration
|
---|
171 | > file karma-adaptor.properties describes the same setting as the
|
---|
172 | > "<URL where RabbitMQ server is hosted>". After trying both seems the the URL description
|
---|
173 | > is incorrect, properties file needs update.
|
---|
174 | >
|
---|
175 | > 8. Question, should I be able to process a gush logfile using the ruleset.xml delivered as part of the
|
---|
176 | > adaptor package? I tried parsing a very simple gush log (start and stop gush) with the
|
---|
177 | > provenance_collection.sh script and it fails with "Invalid rulefile, use the correct version of the rulefile!"
|
---|
178 | >
|
---|
179 | > Thanks,
|
---|
180 | >
|
---|
181 | > Luisa
|
---|
182 | >
|
---|
183 | >
|
---|
184 | >
|
---|
185 | >
|
---|
186 | >
|
---|
187 | >
|
---|
188 |
|
---|