Changes between Version 12 and Version 13 of netKarma/GEC13_report

03/21/12 21:13:10 (8 years ago)



  • netKarma/GEC13_report

    v12 v13  
    1212For the quarter ending with GEC13, we released the NetKarma portal which allows experimentors to easily add and retrieve experimental data from the NetKarma provenance archive. The NetKarma Portal is integrated with the NetKarma Provenance System and provides a persistent service on servers at Indiana University to enable GENI experimentors to help understand the conditions of their experiment. The NetKarma links the experiment workflow data obtained from tools such as GUSH to representations of the experiment's GENI topology, the GENI Instramentation and Measurement systems, and log term data archives. NetKarma links all of these systems together to simplify the complexity of running an experiment on the GENI framework.
    1415In the plan for evaluating NetKarma we had identified experiments being performed in GENI by researchers at Clemson University on distributed denial of service (DDoS) attacks in WiMAX as a means to evaluate the provenance being captured by Karma.  Since GEC12 we have implemented their experiment, and using the standard trace log that is generated and an extension we added to capture the experiment topology, we are able to harvest detailed provenance about their experiment.  The DDoS experiments measure the change in throughput as a set of network parameters are varied, resulting in over 700 different configurations being tested.  Using the provenance captured from the logs for each packet that was successfully transferred, and the inferred provenance of packets that were dropped, the NetKarma visualization plug-ins can be used to visualize the throughput and packets dropped as shown in Figure __ below.  In addition, the NetKarma visualization plug-n for Cytoscape enables researchers to view the provenance at different levels of granularity as shown in Figure __.  We shared the visualization plugin and provenance graphs generated with the researchers at Clemson and they noted that NetKarma allows them to visualize and compare individual runs whereas previously their analysis was based on ANOVA calculations at an aggregate level.  At GEC13 we presented a demo that visualized the provenance based on our runs of Clemson's experiment to show how provenance can be used to visualize results and is valuable for communicating the results of GENI experiments to other researchers.
    3839This also identified a need to revise the NetKarma deliverables planned for GEC14.  One of the deliverables is to show NetKarma generating and populating event records. Through discussions in the I&M group, the definition of the GENI event record has evolved.  As initially envisioned, the event record could possibly have been created based on provenance captured in the provenance record in NetKarma, but the event records would instead be lightweight messages published as an event occurs and in many cases would be valuable as provenance to be ingested into NetKarma instead of being generated by NetKarma.
    4042__NetKarma Portal__