GIR3.2_NetKarma: NetKarma-Feedback-20111021.txt

File NetKarma-Feedback-20111021.txt, 12.6 KB (added by lnevers@bbn.com, 8 years ago)
Line 
1Subject: Re: NetKarma Feedback
2From: Luisa Nevers <lnevers@bbn.com>
3Date: 10/21/2011 3:16 PM
4To: "Ping, Robert James" <robping@indiana.edu>
5CC: "Jensen, Scott" <scjensen@indiana.edu>, Beth Plale <plale@cs.indiana.edu>, Vicraj Thomas <vthomas@bbn.com>, Heidi Picher Dempsey <hpd@bbn.com>
6
7While waiting on the answers to my previous email. I tried to use the provenance script
8and have some additional feedback.
9
109.  The karma-adaptor-2.5.tar.gz file when unpacked creates a directory with no
11     versioning.  Configuration files examples show versions as part of the name
12     although not 2.5:
13       "export ADAPTOR_HOME=/home/peng/workspace/Karma-Adaptor-2.0"
14
1510. Using the instructions provided in the NetKarma Version 2.5 Quick Start Guide ,
16       configured and compiled the karma-adaptor and then proceeded to run the
17      provenance_collector.sh script, which fails as follows:
18
19    lnevers@sendaria:~/netkarma/Karma-Adaptor$ ./provenance_collector.sh logfile-sendaria-15555-1319031471.txt
20    Connecting to Server...
21    Creating Notifications...
22    java.io.IOException: Possibly caused by authentication failure
23            at com.rabbitmq.client.impl.AMQChannel.wrap(AMQChannel.java:127)
24            at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:298)
25            at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:382)
26            at com.rabbitmq.client.ConnectionFactory.newConnection(ConnectionFactory.java:427)
27            at edu.indiana.dsi.karma.messaging.Sender.<init>(Sender.java:49)
28            at edu.indiana.d2i.adaptor.LogParser.<init>(Unknown Source)
29            at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
30    Caused by: com.rabbitmq.client.ShutdownSignalException: connection error; reason: java.io.EOFException
31            at com.rabbitmq.utility.ValueOrException.getValue(ValueOrException.java:81)
32            at com.rabbitmq.utility.BlockingValueOrException.uninterruptibleGetValue(BlockingValueOrException.java:47)
33            at com.rabbitmq.client.impl.AMQChannel$BlockingRpcContinuation.getReply(AMQChannel.java:342)
34            at com.rabbitmq.client.impl.AMQChannel.rpc(AMQChannel.java:215)
35            at com.rabbitmq.client.impl.AMQConnection.start(AMQConnection.java:296)
36            ... 5 more
37    Caused by: java.io.EOFException
38            at java.io.DataInputStream.readUnsignedByte(DataInputStream.java:290)
39            at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:118)
40            at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:133)
41            at com.rabbitmq.client.impl.AMQConnection.readFrame(AMQConnection.java:409)
42            at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:437)
43    doMapping.................
44    doMapping.................
45    Exception in thread "main" java.lang.NullPointerException
46            at edu.indiana.d2i.adaptor.LogParser.closeConnection(Unknown Source)
47            at edu.indiana.d2i.adaptor.LogParser.parseRuleFile(Unknown Source)
48            at edu.indiana.d2i.adaptor.client.KarmaAdaptor.main(Unknown Source)
49
5011. The "NetKarma GUSH Adaptor Tool User Manual V2.5" (August 26, 2011) instructs the
51      user to unpack a file named "karma-adaptor-tool-v2.5.tar.gz" the name  of
52     the tgz that is available is "karma-adaptor-2.5.tar.gz".
53
5412. There are inconsistencies in the instructions between the README and the User guide:
55            - README instructs to define ANT_HOME and  the User Guide does not.
56            - README instucts run "ant karma-adaptor", User Guide instructs run "ant adaptor".
57
5813. The netkarma_gmoc_adaptor_user_manual_v1.0.0.pdf expects a tar file named
59     NetKarmaGMOC_Adaptor.tar the tgz file available is named  netkarmagmocadaptor-1.0.0.tar.gz
60
6114. Using instructions from GMOC Adaptor instructions untarred and ran ant, which failed:
62
63    lnevers@sendaria:~/netkarma/GMOCAdaptor$ ant create.jar
64    Buildfile: build.xml
65    init:
66        [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen
67        [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
68        [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/lib
69        [mkdir] Created dir: /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
70    wsdl2java:
71         [java] Retrieving document at '/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
72         [java] Retrieving schema at 'karma_query_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
73         [java] Retrieving schema at 'rdf.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
74         [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
75         [java] Retrieving schema at 'opm.1_1.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/karma_query_schema.xsd'.
76         [java] Retrieving schema at 'karma_ingest_type_schema.xsd', relative to 'file:/home/lnevers/netkarma/GMOCAdaptor/config/KarmaService.wsdl'.
77         [java] log4j:WARN No appenders could be found for logger (org.apache.axis2.description.WSDL11ToAllAxisServicesBuilder).
78         [java] log4j:WARN Please initialize the log4j system properly.
79         [java] Exception in thread "main" org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
80         [java]     at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:271)
81         [java]     at org.apache.axis2.wsdl.WSDL2Code.main(WSDL2Code.java:35)
82         [java]     at org.apache.axis2.wsdl.WSDL2Java.main(WSDL2Java.java:24)
83         [java] Caused by: org.apache.axis2.wsdl.codegen.CodeGenerationException: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
84         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:534)
85         [java]     at org.apache.axis2.wsdl.codegen.CodeGenerationEngine.generate(CodeGenerationEngine.java:260)
86         [java]     ... 2 more
87         [java] Caused by: org.apache.axis2.wsdl.databinding.UnmatchedTypeException: No type was mapped to the name serviceInitialized with namespace http://www.dataandsearch.org/karma/2010/08/
88         [java]     at org.apache.axis2.wsdl.databinding.TypeMappingAdapter.getTypeMappingName(TypeMappingAdapter.java:82)
89         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputParamElement(AxisServiceBasedMultiLanguageEmitter.java:2913)
90         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.getInputElement(AxisServiceBasedMultiLanguageEmitter.java:2697)
91         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.generateMethodElement(AxisServiceBasedMultiLanguageEmitter.java:2261)
92         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.loadOperations(AxisServiceBasedMultiLanguageEmitter.java:2151)
93         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.createDOMDocumentForInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:826)
94         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.writeInterfaceImplementation(AxisServiceBasedMultiLanguageEmitter.java:718)
95         [java]     at org.apache.axis2.wsdl.codegen.emitter.AxisServiceBasedMultiLanguageEmitter.emitStub(AxisServiceBasedMultiLanguageEmitter.java:504)
96         [java]     ... 3 more
97         [java] Java Result: 1
98    jar:
99        [javac] Compiling 204 source files to /home/lnevers/netkarma/GMOCAdaptor/client_gen/classes
100          [jar] Building jar: /home/lnevers/netkarma/GMOCAdaptor/dist/lib/client-stub-types.jar
101    create.compile:
102        [javac] Compiling 4 source files to /home/lnevers/netkarma/GMOCAdaptor/dist/test/classes
103        [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:75: cannot find symbol
104        [javac] symbol  : class KarmaServiceStub
105        [javac] location: package org.dataandsearch.www.karma._2010._08
106        [javac] import org.dataandsearch.www.karma._2010._08.KarmaServiceStub;
107        [javac]                                             ^
108        [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:148: cannot find symbol
109        [javac] symbol  : class KarmaServiceStub
110        [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
111        [javac]     KarmaServiceStub stub = null;
112        [javac]     ^
113        [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:155: cannot find symbol
114        [javac] symbol  : class KarmaServiceStub
115        [javac] location: class edu.indiana.dsi.karma.test.GMOCDCollector
116        [javac]             stub = new KarmaServiceStub(serviceURL);
117        [javac]                        ^
118        [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:224: cannot find symbol
119        [javac] symbol  : method setWorkflowID(java.lang.String)
120        [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceRequestType
121        [javac]             findServiceRequest.setWorkflowID(":");
122        [javac]                               ^
123        [javac] /home/lnevers/netkarma/GMOCAdaptor/test/edu/indiana/dsi/karma/test/GMOCDCollector.java:271: cannot find symbol
124        [javac] symbol  : method getServiceIDList()
125        [javac] location: interface org.dataandsearch.www.karma.query._2010._10.FindServiceResponseType
126        [javac]                     ServiceIDListType serviceids = servicetype.getServiceIDList();
127        [javac]                                                               ^
128        [javac] 5 errors
129
130    BUILD FAILED
131    /home/lnevers/netkarma/GMOCAdaptor/build.xml:76: Compile failed; see the compiler error output for details.
132
133    Total time: 7 seconds
134
135
136Thanks,
137
138Luisa
139
140On 10/12/2011 12:28 PM, Luisa Nevers wrote:
141> Hello Robert,
142>
143> I have been taking a look a the NetKarma Version 2.5 and have some feedback.
144>
145> 1. The NetKarma Version 2.5 Quick Start Guide instruct the user to download
146>     version 2.0 files rather than version 2.5 :
147>  "https://pti.iu.edu/sites/default/files/karma-adaptor-2.0.tar.gz" and
148>  " https://pti.iu.edu/sites/default/files/karma-adaptor_v2.0_user_manual.pdf"
149>
150> 2. The NetKarma Version 2.5  Adaptor requires ANT and JDK to be installed, which
151>     are not listed as prerequisites in the Quick Start Guide. Also RabbitMQ shoudl
152>     be listed as a prerequisite.
153>
154> 3. Using the README for the NetKarma Adaptor.  In the section named
155>    "Edit the Environment Configuration File" the user is instructed to set
156>     "ADAPTOR_HOME, JAVA_HOME, and ANT_HOME", the first two exist in
157>    the configuration file, but ANT_HOME does not exist.
158>
159> 4. The Quick Start Guide Steps 4 and 5 instruct to modify karma-adaptor.properties
160>    and KarmaQueryConfig.txt, but does not provide a path to these files.
161>
162> 5.  The "NetKarma GUSH Adaptor Tool User Manual"  section 2.2 "Service Dependencies"
163>       instructs me to download  RabbitMQ, but does not specify if I need the server, the client,
164>      both, or some other  component.
165>
166> 6. The "NetKarma GUSH Adaptor Tool User Manual"  section 3 lists "karma-adaptor.homedir"
167>      as a karma-adaptor.properties setting, but is  not found in the file.  Is this an optional setting?
168>
169> 7. The "NetKarma GUSH Adaptor Tool User Manual"  section 3 describes the setting
170>     "messaging.hostname" as "Hostname that hosts RabbitMQ Server" but the configuration
171>    file karma-adaptor.properties describes the same setting as the
172>   "<URL where RabbitMQ server is hosted>".  After trying  both seems the the URL description
173>   is incorrect, properties file needs update.
174>
175> 8. Question, should I be able to process a gush logfile using the ruleset.xml delivered as part of the
176>     adaptor package?  I tried  parsing a very simple gush log (start and stop gush) with the
177>    provenance_collection.sh script and   it fails with "Invalid rulefile, use the correct version of the rulefile!"
178>
179> Thanks,
180>
181> Luisa
182>
183>
184>
185>
186>
187>
188