Changes between Version 37 and Version 38 of netKarma/GEC14_report


Ignore:
Timestamp:
07/23/12 02:51:50 (9 years ago)
Author:
chsmall@grnoc.iu.edu
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • netKarma/GEC14_report

    v37 v38  
    7373[[Image(NetKarma_Portal_archive.png,50%)]]
    7474
    75 
    76 The production version of the NetKarma portal is available at [http://netkarma.incntre.iu.edu/portal/uploader http://netkarma.incntre.iu.edu/portal/uploader]
    7775[[BR]]
    78 The development version used in the demo is at [http://netkarma-demo.incntre.iu.edu/ http://netkarma-demo.incntre.iu.edu/]
    79 [[BR]]
    80 Source code for the portal is located at [https://github.com/InCNTRE/NetKarma_Portal https://github.com/InCNTRE/NetKarma_Portal]
     76 * The production version of the NetKarma portal is available at [http://netkarma.incntre.iu.edu/portal/uploader http://netkarma.incntre.iu.edu/portal/uploader]
     77 * The development version used in the demo is at [http://netkarma-demo.incntre.iu.edu/ http://netkarma-demo.incntre.iu.edu/]
     78 * Source code for the portal is located at [https://github.com/InCNTRE/NetKarma_Portal https://github.com/InCNTRE/NetKarma_Portal]
    8179[[BR]]
    8280
     
    127125[[Image(MDOD-LifeCycle.png,65%)]]
    128126
    129 Both the GEMINI and GIMI Instrumentation & Measurement projects are working towards a "GENI Experimenter Portal Service" that would allow an experimenter to setup measurements for an experiment and initialize the collection of measurements.  This is a natural source for the initial generation of the MDOD.  In some cases the measurement data and MDOD may be registered directly in the GENI Measurement Data Archive Service or the measurement data and MDOD could be uploaded with other logs, the manifest, and other data to the NetKarma Portal to capture the provenance, metadata, and data related to an experiment.  The NetKarma Portal generates a provenance graph through NetKarma based on the OPM standard, saving the full provenance graph in the Portal, and can incorporate the provenance without annotations in the MDOD.  The NetKarma Portal provides a means to create a hierarchy of the data, measurements, and provenance related to an experiment, so as this collection is bundled and submitted to the archive, the entire bundle can be described by an MDOD, using the portal-generated DOI as an ID for the bundle and including other MDODs describing measurement data by reference.  This MDOD bundle is depicted graphically as follows:
    130 
    131 [[Image(MDOD-Example-Structure.png,70%)]]
    132 
    133 == Project Participants ==
    134 During this period, active participants in the NetKarma project included: Beth Plale and Chris Small, as well as Scott Jensen, Postdoctoral Fellow in the Data To Insight Center, and students Peng Chen, Devarshi Ghoshal, and Yuan Luo. Robert Ping provided project management for the project.
    135 
    136 
    137 == Collaborations ==
    138 
    139  * Katherine Cameron (Clemson University) – ORBIT experiments on DDoS attacks and ORBIT configuration
    140  * Nilanjan Paul (Rutgers) – ORBIT experiment configuration
    141  * Fraida Fund (NYU-Poly WITest Lab) ORBIT reservation system
    142  * Martin Swany (Indiana University) and Ezra Kissel (University of Delaware) – Discussion of measurement metadata capture in the MDOD.  XSP-based experiment used in NetKarma tutorial
    143  * Harry Mussman (BBN) – Metadata capture for measurement data in the MDOD
    144  * Jeanne Ohren (BBN) – tutorial coordination and MDOD
    145  * Ahmet Babaoglu (North Carolina State University) capturing NetKarma notifications as events in IMF Messaging
    146 
    147 
    148 == Publications & Documents ==
    149 Posters at the GEC14 Poster and Demo Session: [[BR]]
    150  * NetKarma Reveals the Provenance of WiMAX Experiments on ORBIT [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Poster-NetKarma_Reveals_the_Provenance_of_WiMAX_Experiments_on_ORBIT.pdf PDF]
    151 
    152  * GENI Provenance, Instrumentation and Measurement: Integrating Provenance into the GENI Measurement Data Object Descriptor [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Poster-GENI%20Provenance_Instrumentation_and_Measurement.pdf PDF]
    153 
    154 Step-by-Step Instructions for the NetKarma Tutorial at GEC14: http://d2i.indiana.edu/wiki/NetKarma_Tutorial
    155 
    156 Slides from Presentation on NetKarma at the GEC14 Experimenter's Roundtable: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/Slides-NetKarma-GEC14_Experimenters_RoundTable.pdf slides]
    157 
    158 Proposed MDOD Schema for capturing the Metadata and Provenance of GENI Experiments: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/MDOD_Provenance_0.2.xsd MDOD_Provenance_0.2.xsd]
    159 
    160 Supporting schemas imported into the proposed MDOD schema:
    161  * Third-party DOI schema imported into the MDOD schema for the identifier: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/DOIMetadataKernel_v2.0_120308.xsd DOIMetadataKernel_v2.0_120308.xsd]
    162  * Third-party ISO schema required by the DOI schema: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/iso3166a2.xsd iso3166a2.xsd]
    163  * OPM schema imported into the MDOD for provenance: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/opm.1_1.xsd opm.1_1.xsd]
    164  * Karma extensions to the OPM schema: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/opm.1_1.ext.xsd opm.1_1.ext.xsd]
    165 
    166 Sample MDOD example based on capturing the metadata and provenance for an XSP experiment as used in the NetKarma tutorial: [http://groups.geni.net/geni/attachment/wiki/netKarma/GEC14_report/SampleMDOD-XSP.xml SampleMDOD-XSP.xml]
    167 
    168 
    169 == GENI Documents ==
    170 none
     127Both the GEMINI and GIMI Instrumentation & Measurement projects are working towards a "GENI Experimenter Portal Service" that would allow an experimenter to setup measurements for an experiment and initialize the collection of measurements.  This is a natural source for the initial generation of the MDOD.  In some cases the measurement data and MDOD may be registered directly in the GENI Measurement Data Archive Service or the measurement data and MDOD could be uploaded with other logs, the manifest, and other data to the NetKarma Portal to capture the provenance, metadata, and data related to an experiment.  The NetKarma Portal generates a provenance graph through NetKarma based on the OPM standard, saving the full provenance graph in the Portal, and can incorporate the provenance without annotations in the MDOD.