Changes between Version 35 and Version 36 of netKarma/GEC13_report


Ignore:
Timestamp:
04/01/12 19:03:26 (12 years ago)
Author:
Beth Plale
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • netKarma/GEC13_report

    v35 v36  
    1010== Summary ==
    1111
    12 For the quarter ending with GEC13, we released the NetKarma portal which allows experimentors to easily add and retrieve experimental data from the NetKarma provenance archive. The NetKarma Portal is integrated with the NetKarma Provenance System and provides a persistent service on servers at Indiana University to enable GENI experimentors to help understand the conditions of their experiment. NetKarma links the experiment workflow data obtained from tools such as GUSH to representations of the experiment's GENI topology, the GENI Instrumentation and Measurement systems, and log term data archives. NetKarma links all of these systems together to simplify the complexity of running an experiment on the GENI framework.
     12For the quarter ending with GEC13, our major outcomes are the release of the NetKarma portal, and a successful demonstration of the benefits of provenance for a GENI experiment on DDoS in a WiMAX network.  The NetKarma portal is a new web location where experimenters can go to add/retrieve from the archive experiment level data collected by the NetKarma provenance system. The NetKarma Portal is integrated with the NetKarma Provenance System and provides a persistent service on servers at Indiana University to enable GENI experimenters to help understand the conditions of their experiment. NetKarma links the experiment workflow data obtained from tools such as GUSH to representations of the experiment's GENI topology, and GENI Instrumentation and Measurement systems. NetKarma links all of these systems together to simplify the complexity of running an experiment on the GENI framework.
    1313
    14 In the plan for evaluating NetKarma we had identified experiments being performed in GENI by researchers at Clemson University on distributed denial of service (DDoS) attacks in WiMAX as a means to evaluate the provenance being captured by Karma.  Since GEC12 we have implemented their experiment, and using the standard trace log that is generated and an extension we added to capture the experiment topology, we are able to harvest detailed provenance about their experiment.  The DDoS experiments measure the change in throughput as a set of network parameters are varied, resulting in over 700 different configurations being tested.  Using the provenance captured from the logs for each packet that was successfully transferred, and the inferred provenance of packets that were dropped, the NetKarma visualization plug-in can be used to visualize the throughput and packets dropped and view the provenance at different levels of granularity as shown in our demo and poster at GEC13.  We shared the visualization plugin and provenance graphs generated with the researchers at Clemson and they noted that NetKarma allows them to visualize and compare individual runs whereas previously their analysis was based on ANOVA calculations at an aggregate level.  At GEC13 we presented a demo that visualized the provenance based on our runs of Clemson's experiment to show how provenance can be used to visualize results and is valuable for communicating the results of GENI experiments to other researchers.
     14The DDoS analysis on WiMAX experiment carried out by Clemson University is where we focused our attention to demonstrate the value of provenance capture. Since GEC12 we replicated the Clemson experiment at IU, and instrumented N2 to capture provenance.  Using the provenance captured from 700 distinct configurations, NetKarma visualizes the throughput and packets dropped and views the provenance at different levels of granularity as shown in our demo and poster at GEC13.  The Clemson researchers commented that with NetKarma they can visualize and compare individual runs whereas previously their analysis was based on ANOVA calculations at an aggregate level.  We have begun working with a second group to demonstrate provenance, the eXtensible Session Protocol (XSP) experiment, previously run out of UDelaware and now housed at IU.
    1515[[BR]]
    1616
    … …  
    1818
    1919__S4b.1 Demonstration of the provenance system being used with a GENI experiment identified in Milestone 1__
    20 Using the MiMAX DDoS experiments at Clemson which were identified as a case for evaluating the provenance captured and visualized using NetKarma we showed how the provenance of packets successfully transferred and the inferred provenance of packets dropped can be used to provide visualizations of individual experiment runs; providing network researchers with a new approach to analyzing their experiment results. At GEC13 we presented both a poster and a live demo of the provenance captured from the DDoS experiments we reran based on the research done by GENI researchers at Clemson University.  An additional outcome of this evaluation of NetKarma is a new NetKarma adaptor that can be used to capture provenance of experiments run on the NS2 simulator used in the Clemson experiments (and can be applied to any NS2 experiments).  An enhanced NetKarma plug-in for Cytoscape that contains new visualization algorithms for visualizing the provenance of NS2 experiments was also released (version 1.2.1).  Both the adaptor and visualization plug-in, along with updated software documentation, are available on the NetKarma wiki.
     20Using the WiMAX DDoS experiment from Clemson we show how the provenance of packets successfully transferred and the inferred provenance of packets dropped can be used to provide visualizations of individual experiment runs; providing network researchers with a new approach to analyzing their experiment results. At GEC13 we gave a demo with a poster of the resulting provenance from the WiMAX DDoS experiment.  An ancillary outcome of this work is the release of a new NetKarma adaptor that can be used to capture provenance of any experiment run on the NS2 simulator.  An enhanced NetKarma plug-in for Cytoscape that contains new visualization algorithms for visualizing the provenance of NS2 experiments was released (version 1.2.1).  Both the adaptor and visualization plug-in, along with updated software documentation, are available on the NetKarma wiki.
    2121[[BR]]
    22 We have utilized the work on the NetKarma Portal to greatly improve the usability and utility of the experimental data. From the portal the ingestion process just requires the experimentor drag the files related to there experiment and have the experimental data ingested into NetKarma in one easy step. In addition to the portal, the AXIS2 and RabbitMQ mechanisms for adapters are supported allowing for experimentors to automate the ingestion process if desired.
     22We have utilized the NetKarma Portal to greatly improve the usability and utility of the experimental data. From the portal the ingestion process just requires the experimenter drag the files related to there experiment and have the experimental data ingested into NetKarma in one easy step. In addition to the portal, the Axis2 and RabbitMQ mechanisms for adapters are supported allowing for experimenters to automate the ingestion process if desired.
    2323
    2424__S4b.2 Linking workflow provenance information to metadata__
    25 The NetKarma portal is designed to link metadata such as the metadata object descriptor to the workflow information and provide the experimentor a way to navigate between not only the metadata and provenance information but also provide a way to visualize the measurement data that any metadata refers to and provide links to additional sources of data such as GEMINI, GIMS or the GMOC. The NetKarma portal supports ingestion of the metadata object directly or reference. For example a reference to a resource in a UNIS or NMWG file could be linked directly to the measurement data collected for that resource on the GENI topology. NetKarma provides an experimenter focused view to the data collected for the entire experiment.
     25We developed the NetKarma portal to link metadata such as the metadata object descriptor to the workflow information and provide the experimenter a way to navigate between the metadata and provenance information but also provide a way to visualize the measurement data that any metadata refers to and provide links to additional sources of data such as GEMINI, GIMS or the GMOC. The NetKarma portal supports ingestion of the metadata object directly or reference. For example a reference to a resource in a UNIS or NMWG file could be linked directly to the measurement data collected for that resource on the GENI topology. NetKarma provides an experimenter focused view to the data collected for the entire experiment.
    2626
    2727__S4b.3 Written plan to work with a second experiment/experimenter for evaluation of the provenance system___
    28 We have identified the eXtensible Session Protocol (XSP) based on experiments by researchers at Indiana University and the University of Delaware for the second GENI project used to evaluate the provenance captured in NetKarma.  In comparison to the first project identified (WiMAX DDoS attacks based on research at Clemson), the XSP research presents a different and diverse set of issues.  Whereas the WiMAX experiments presented a high volume of provenance regarding similar data objects (packets being transferred and inferred packet loss), the XSP experiment presents the challenge of capturing and representing the provenance of events at different network layers.  The NetKarma evaluation plan has been updated to include the XSP experiment and is available [http://groups.geni.net/geni/attachment/wiki/netKarma/GENI%20-%20Provenance%20System%20Evaluation.pdf here] on the NetKarma wiki.
     28We have identified the eXtensible Session Protocol (XSP) experiment led by Martin Swany at Indiana University as the second GENI project used to evaluate the provenance captured in NetKarma.  In comparison to the first project we identified (i.e., WiMAX DDoS attacks based on research at Clemson), the XSP experiment has the challenge of capturing and representing the provenance of events at different network layers.  The NetKarma evaluation plan has been updated to include the XSP experiment and is available [http://groups.geni.net/geni/attachment/wiki/netKarma/GENI%20-%20Provenance%20System%20Evaluation.pdf here] on the NetKarma wiki.
    2929
    3030== Work Performed this Quarter ==
    … …  
    5353 
    5454
    55 __Experimental WorkFlow using the NetKarma Portal__
     55__Experimental Lifecycle using the NetKarma Portal__
    5656
    57 An experimentor creates an experimental handle to reference from the front page of the NetKarma portal. Any data products from the experiment can be uploaded to NetKarma. All are stored as archives but some supported file types are parsed and additional information gathered.
     57An experimenter creates an experimental handle to reference from the front page of the NetKarma portal. Any data products from the experiment can be uploaded to NetKarma. All are stored as archives but some supported file types are parsed and additional information gathered.
    5858
    5959Supported file types include:
    … …  
    8888[[Image(CytoscapeNS2ExperimentVisualizationParameters.png, 30%)]] [[BR]] 
    8989
    90 The visualization plug-in enhancements allow the packet transfers to be viewed at different levels of granularity as illustrated in the following screen capture from Cytoscape using the NetKarama plug-in and zoomed in on a few specific nodes in the topology for the experiment.  At this level of granularity, provenance for the individual packets that were successfully transferred or dropped can be viewed as well as additional detailed provenance annotations.
     90The visualization plug-in enhancements allow the packet transfers to be viewed at different levels of granularity as illustrated in the following screen capture from Cytoscape using the NetKarma plug-in and zoomed in on a few specific nodes in the topology for the experiment.  At this level of granularity, provenance for the individual packets that were successfully transferred or dropped can be viewed as well as additional detailed provenance annotations.
    9191
    9292[[Image(CytoscapeNS2ExperimentVisualizationZoomed.png, 40%)]] [[BR]]
    … …  
    9797== Project Participants ==
    9898
    99 During this time period, participants in the NetKarma project included: Beth Plale, PI of School of Informatics and Computing, Chris Small, Co-PI of InCNTRE, Scott Jensen, Postdoctoral Fellow, Devarshi Goshal, PhD student, Peng Chen, PhD student, You-Wei Cheah, PhD student, Yuan Luo, PhD student, Robert Ping, Project Manager in Data to Insight Center that Professor Plale directs.
     99During this period, active participants in the NetKarma project included: Beth Plale and Chris Small, as well as Scott Jensen, Postdoctoral Fellow in the Data To Insight Center, and students Peng Chen, Devarshi Ghoshal, and Yuan Luo.  Robert Ping provided project management for the project.
    100100 
    101101== Collaborations ==