GIR3.2_NetKarma: NetKarma-response-20111028.txt

File NetKarma-response-20111028.txt, 15.3 KB (added by lnevers@bbn.com, 12 years ago)
Line 
1Subject:
2Re: NetKarma Feedback
3From:
4Scott Jensen <scjensen@umail.iu.edu>
5Date:
610/28/2011 1:50 PM
7To:
8Luisa Nevers <lnevers@bbn.com>
9CC:
10"Ping, Robert James" <robping@indiana.edu>, "Jensen, Scott" <scjensen@indiana.edu>, Beth Plale <plale@cs.indiana.edu>, Vicraj Thomas <vthomas@bbn.com>, Heidi Picher Dempsey <hpd@bbn.com>
11
12Hi Luisa,
13
14Thanks for the continued feedback on NetKarma - it makes it a stronger provenance tool.  Based on your feedback, we have uploaded new versions of the Quick Start Guide, the NetKarma Gush Adapter Manual, and the tarball for the NetKarma Adaptor (for changes in the README file).  Please see embedded responses below.
15
16
17
18On Fri, Oct 21, 2011 at 3:16 PM, Luisa Nevers <lnevers@bbn.com> wrote:
19
20    While waiting on the answers to my previous email. I tried to use the provenance script
21    and have some additional feedback.
22
23    9.  The karma-adaptor-2.5.tar.gz file when unpacked creates a directory with no
24         versioning.  Configuration files examples show versions as part of the name
25         although not 2.5:
26           "export ADAPTOR_HOME=/home/peng/workspace/Karma-Adaptor-2.0"
27
28 
29As you noted, the default directory name when the tarball is unpacked is Karma-Adaptor, so we updated the example in the configuration file to not include a version in the path name.  Although ADAPTOR_HOME needs to be set to each user's path (based on where they unpacked the tarball), it could be confusing to have the version in the example path so we removed it.
30
31 
32
33    10. Using the instructions provided in the NetKarma Version 2.5 Quick Start Guide ,
34           configured and compiled the karma-adaptor and then proceeded to run the
35          provenance_collector.sh script, which fails as follows:
36
37        lnevers@sendaria:~/netkarma/Karma-Adaptor$ ./provenance_collector.sh logfile-sendaria-15555-1319031471.txt
38        Connecting to Server...
39        Creating Notifications...
40        java.io.IOException: Possibly caused by authentication failure
41                at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:127)
42                at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:298)
43                at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:382)
44                at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:427)
45                at edu.indiana.dsi.karma.messaging.Sender.<init>(Sender.java:49)
46                at edu.indiana.d2i.adaptor.LogParser.<init>(Unknown Source)
47                at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
48        Caused by: com.rabbitmq.client.ShutdownSignalException: connection error; reason: java.io.EOFException
49                at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:81)
50                at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:47)
51                at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:342)
52                at com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:215)
53                at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:296)
54                ... 5 more
55        Caused by: java.io.EOFException
56                at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290)
57                at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:118)
58                at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:133)
59                at com.rabbitmq.client.impl.AMQConnection.readFrame(AMQConnection.java:409)
60                at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:437)
61        doMapping.................
62        doMapping.................
63        Exception in thread "main" java.lang.NullPointerException
64                at edu.indiana.d2i.adaptor.LogParser.closeConnection(Unknown Source)
65                at edu.indiana.d2i.adaptor.LogParser.parseRuleFile(Unknown Source)
66                at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
67
68We had a miscommunication on our end and the password for uploading logs was set to a different value on the server here at IU than was specified in the Quick Start Guide.  The password has now been reset to the value specified in the Quick Start Guide and we had a couple new users walk through the process based on the Quick Start Guide and NetKarma GUSH Adaptor Manual.
69 
70
71    11. The "NetKarma GUSH Adaptor Tool User Manual V2.5" (August 26, 2011) instructs the
72          user to unpack a file named "karma-adaptor-tool-v2.5.tar.gz" the name  of
73         the tgz that is available is "karma-adaptor-2.5.tar.gz".
74
75
76The manual has been corrected to the correct name of the tarball.
77 
78
79
80    12. There are inconsistencies in the instructions between the README and the User guide:
81                - README instructs to define ANT_HOME and  the User Guide does not.
82                - README instucts run "ant karma-adaptor", User Guide instructs run "ant adaptor".
83
84 
85The manual was updated to specify that ANT_HOME needs to be set and reflect that the correct ant task is karma-adaptor.
86 
87
88    13. The netkarma_gmoc_adaptor_user_manual_v1.0.0.pdf expects a tar file named
89         NetKarmaGMOC_Adaptor.tar the tgz file available is named  netkarmagmocadaptor-1.0.0.tar.gz
90
91We will update the user manual.  For this release, the GMOC adaptor is being made available through the server located at Indiana University as software as a resource.  Users would not need to download and install the GMOC adapter themselves, but we made the source code and build instructions available.
92
93 
94
95    14. Using instructions from GMOC Adaptor instructions untarred and ran ant, which failed:
96
97        lnevers@sendaria:~/netkarma/GMOCAdaptor$ ant create.jar
98        Buildfile: build.xml
99        init:
100            [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen
101            [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
102            [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/lib
103            [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
104        wsdl2java:
105             [java] Retrieving document at '/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
106             [java] Retrieving schema at 'karma_query_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
107             [java] Retrieving schema at 'rdf.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
108             [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
109             [java] Retrieving schema at 'opm.1_1.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
110             [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
111             [java] log4j:WARN No appenders could be found for logger (org.apache.axis2.description.WSDL11ToAllAxisServicesBuilder).
112             [java] log4j:WARN Please initialize the log4j system properly.
113             [java] Exception in thread "main" org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
114             [java]     at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:271)
115             [java]     at org.apache.axis2.wsdl.WSDL2Code.main(WSDL2Code.java:35)
116             [java]     at org.apache.axis2.wsdl.WSDL2Java.main(WSDL2Java.java:24)
117             [java] Caused by: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
118             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:534)
119             [java]     at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:260)
120             [java]     ... 2 more
121             [java] Caused by: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
122             [java]     at org.apache.axis2.wsdl.databinding.TypeMappingAdapter.getTypeMappingName(TypeMappingAdapter.java:82)
123             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputParamElement(AxisServiceBasedMultiLanguageEmitter.java:2913)
124             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputElement(AxisServiceBasedMultiLanguageEmitter.java:2697)
125             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.generateMethodElement(AxisServiceBasedMultiLanguageEmitter.java:2261)
126             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.loadOperations(AxisServiceBasedMultiLanguageEmitter.java:2151)
127             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.createDOMDocumentForInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:826)
128             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.writeInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:718)
129             [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:504)
130             [java]     ... 3 more
131             [java] Java Result: 1
132        jar:
133            [javac] Compiling 204 source files to /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
134              [jar] Building jar: /home/lnevers/netkarma/GMOCAdaptor/dist/lib/client-stub-types.jar
135        create.compile:
136            [javac] Compiling 4 source files to /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
137            [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:75: cannot find symbol
138            [javac] symbol  : class KarmaServiceStub
139            [javac] location: package org.dataandsearch.www.karma._2010._08
140            [javac] import org.dataandsearch.www.karma._2010._08.KarmaServiceStub;
141            [javac]                                             ^
142            [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:148: cannot find symbol
143            [javac] symbol  : class KarmaServiceStub
144            [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
145            [javac]     KarmaServiceStub stub = null;
146            [javac]     ^
147            [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:155: cannot find symbol
148            [javac] symbol  : class KarmaServiceStub
149            [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
150            [javac]             stub = new KarmaServiceStub(serviceURL);
151            [javac]                        ^
152            [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:224: cannot find symbol
153            [javac] symbol  : method setWorkflowID(java.lang.String)
154            [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceRequestType
155            [javac]             findServiceRequest.setWorkflowID(":");
156            [javac]                               ^
157            [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:271: cannot find symbol
158            [javac] symbol  : method getServiceIDList()
159            [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceResponseType
160            [javac]                     ServiceIDListType serviceids = servicetype.getServiceIDList();
161            [javac]                                                               ^
162            [javac] 5 errors
163
164        BUILD FAILED
165        /home/lnevers/netkarma/GMOCAdaptor/build.xml:76: Compile failed; see the compiler error output for details.
166
167        Total time: 7 seconds
168
169
170Please see response to item #13.  Unpacking the tarball, the build process ran cleanly when I retried it.  was JAVA_HOME set and on your path?  There may be further details we need to include in the manual.
171
172Thanks again for your feedback.
173
174Scott
175
176
177    Thanks,
178
179    Luisa
180
181
182    On 10/12/2011 12:28 PM, Luisa Nevers wrote:
183>     Hello Robert,
184>
185>     I have been taking a look a the NetKarma Version 2.5 and have some feedback.
186>
187>     1. The NetKarma Version 2.5 Quick Start Guide instruct the user to download
188>         version 2.0 files rather than version 2.5 :
189>      "https://pti.iu.edu/sites/default/files/karma-adaptor-2.0.tar.gz" and
190>      " https://pti.iu.edu/sites/default/files/karma-adaptor_v2.0_user_manual.pdf"
191>
192>     2. The NetKarma Version 2.5  Adaptor requires ANT and JDK to be installed, which
193>         are not listed as prerequisites in the Quick Start Guide. Also RabbitMQ shoudl
194>         be listed as a prerequisite.
195>
196>     3. Using the README for the NetKarma Adaptor.  In the section named
197>        "Edit the Environment Configuration File" the user is instructed to set
198>         "ADAPTOR_HOME, JAVA_HOME, and ANT_HOME", the first two exist in
199>        the configuration file, but ANT_HOME does not exist.
200>
201>     4. The Quick Start Guide Steps 4 and 5 instruct to modify karma-adaptor.properties
202>        and KarmaQueryConfig.txt, but does not provide a path to these files.
203>
204>     5.  The "NetKarma GUSH Adaptor Tool User Manual"  section 2.2 "Service Dependencies"
205>           instructs me to download  RabbitMQ, but does not specify if I need the server, the client,
206>          both, or some other  component.
207>
208>     6. The "NetKarma GUSH Adaptor Tool User Manual"  section 3 lists "karma-adaptor.homedir"
209>          as a karma-adaptor.properties setting, but is  not found in the file.  Is this an optional setting?
210>
211>     7. The "NetKarma GUSH Adaptor Tool User Manual"  section 3 describes the setting
212>         "messaging.hostname" as "Hostname that hosts RabbitMQ Server" but the configuration
213>        file karma-adaptor.properties describes the same setting as the
214>       "<URL where RabbitMQ server is hosted>".  After trying  both seems the the URL description
215>       is incorrect, properties file needs update.
216>
217>     8. Question, should I be able to process a gush logfile using the ruleset.xml delivered as part of the
218>         adaptor package?  I tried  parsing a very simple gush log (start and stop gush) with the
219>        provenance_collection.sh script and   it fails with "Invalid rulefile, use the correct version of the rulefile!"
220>
221>     Thanks,
222>
223>     Luisa
224>
225>
226>
227>
228>
229>
230
231
232
233
234--
235Scott Jensen, PhD
236Senior Researcher
237Data to Insight Center
238Pervasive Technology Institute
239Indiana University