| 129 | | Both the GEMINI and GIMI Instrumentation & Measurement projects are working towards a "GENI Experimenter Portal Service" that would allow an experimenter to setup measurements for an experiment and initialize the collection of measurements. This is a natural source for the initial generation of the MDOD. In some cases the measurement data and MDOD may be registered directly in the GENI Measurement Data Archive Service or the measurement data and MDOD could be uploaded with other logs, the manifest, and other data to the NetKarma Portal to capture the provenance, metadata, and data related to an experiment. The NetKarma Portal generates a provenance graph through NetKarma based on the OPM standard, saving the full provenance graph in the Portal, and can incorporate the provenance without annotations in the MDOD. The NetKarma Portal provides a means to create a hierarchy of the data, measurements, and provenance related to an experiment, so as this collection is bundled and submitted to the archive, the entire bundle can be described by an MDOD, using the portal-generated DOI as an ID for the bundle and including other MDODs describing measurement data by reference. This MDOD bundle is depicted graphically as follows: |
| 130 | | |
| 131 | | [[Image(MDOD-Example-Structure.png,70%)]] |
| 132 | | |
| 133 | | == Project Participants == |
| 134 | | During this period, active participants in the NetKarma project included: Beth Plale and Chris Small, as well as Scott Jensen, Postdoctoral Fellow in the Data To Insight Center, and students Peng Chen, Devarshi Ghoshal, and Yuan Luo. Robert Ping provided project management for the project. |
| 135 | | |
| 136 | | |
| 137 | | == Collaborations == |
| 138 | | |
| 139 | | * Katherine Cameron (Clemson University) – ORBIT experiments on DDoS attacks and ORBIT configuration |
| 140 | | * Nilanjan Paul (Rutgers) – ORBIT experiment configuration |
| 141 | | * Fraida Fund (NYU-Poly WITest Lab) ORBIT reservation system |
| 142 | | * Martin Swany (Indiana University) and Ezra Kissel (University of Delaware) – Discussion of measurement metadata capture in the MDOD. XSP-based experiment used in NetKarma tutorial |
| 143 | | * Harry Mussman (BBN) – Metadata capture for measurement data in the MDOD |
| 144 | | * Jeanne Ohren (BBN) – tutorial coordination and MDOD |
| 145 | | * Ahmet Babaoglu (North Carolina State University) capturing NetKarma notifications as events in IMF Messaging |
| 146 | | |
| 147 | | |
| 148 | | == Publications & Documents == |
| 149 | | Posters at the GEC14 Poster and Demo Session: [[BR]] |
| 150 | | * NetKarma Reveals the Provenance of WiMAX Experiments on ORBIT [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Poster-NetKarma_Reveals_the_Provenance_of_WiMAX_Experiments_on_ORBIT.pdf PDF] |
| 151 | | |
| 152 | | * GENI Provenance, Instrumentation and Measurement: Integrating Provenance into the GENI Measurement Data Object Descriptor [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Poster-GENI%20Provenance_Instrumentation_and_Measurement.pdf PDF] |
| 153 | | |
| 154 | | Step-by-Step Instructions for the NetKarma Tutorial at GEC14: http://d2i.indiana.edu/wiki/NetKarma_Tutorial |
| 155 | | |
| 156 | | Slides from Presentation on NetKarma at the GEC14 Experimenter's Roundtable: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Slides-NetKarma-GEC14_Experimenters_RoundTable.pdf slides] |
| 157 | | |
| 158 | | Proposed MDOD Schema for capturing the Metadata and Provenance of GENI Experiments: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/MDOD_Provenance_0.2.xsd MDOD_Provenance_0.2.xsd] |
| 159 | | |
| 160 | | Supporting schemas imported into the proposed MDOD schema: |
| 161 | | * Third-party DOI schema imported into the MDOD schema for the identifier: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/DOIMetadataKernel_v2.0_120308.xsd DOIMetadataKernel_v2.0_120308.xsd] |
| 162 | | * Third-party ISO schema required by the DOI schema: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/iso3166a2.xsd iso3166a2.xsd] |
| 163 | | * OPM schema imported into the MDOD for provenance: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/opm.1_1.xsd opm.1_1.xsd] |
| 164 | | * Karma extensions to the OPM schema: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/opm.1_1.ext.xsd opm.1_1.ext.xsd] |
| 165 | | |
| 166 | | Sample MDOD example based on capturing the metadata and provenance for an XSP experiment as used in the NetKarma tutorial: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/SampleMDOD-XSP.xml SampleMDOD-XSP.xml] |
| 167 | | |
| 168 | | |
| 169 | | == GENI Documents == |
| 170 | | none |
| | 127 | Both the GEMINI and GIMI Instrumentation & Measurement projects are working towards a "GENI Experimenter Portal Service" that would allow an experimenter to setup measurements for an experiment and initialize the collection of measurements. This is a natural source for the initial generation of the MDOD. In some cases the measurement data and MDOD may be registered directly in the GENI Measurement Data Archive Service or the measurement data and MDOD could be uploaded with other logs, the manifest, and other data to the NetKarma Portal to capture the provenance, metadata, and data related to an experiment. The NetKarma Portal generates a provenance graph through NetKarma based on the OPM standard, saving the full provenance graph in the Portal, and can incorporate the provenance without annotations in the MDOD. |
