Changes between Version 34 and Version 35 of netKarma/GEC13_report
- Timestamp:
- 03/27/12 10:46:48 (12 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
netKarma/GEC13_report
v34 v35 10 10 == Summary == 11 11 12 For the quarter ending with GEC13, we released the NetKarma portal which allows experimentors to easily add and retrieve experimental data from the NetKarma provenance archive. The NetKarma Portal is integrated with the NetKarma Provenance System and provides a persistent service on servers at Indiana University to enable GENI experimentors to help understand the conditions of their experiment. The NetKarma links the experiment workflow data obtained from tools such as GUSH to representations of the experiment's GENI topology, the GENI Instramentation and Measurement systems, and log term data archives. NetKarma links all of these systems together to simplify the complexity of running an experiment on the GENI framework.12 For the quarter ending with GEC13, we released the NetKarma portal which allows experimentors to easily add and retrieve experimental data from the NetKarma provenance archive. The NetKarma Portal is integrated with the NetKarma Provenance System and provides a persistent service on servers at Indiana University to enable GENI experimentors to help understand the conditions of their experiment. NetKarma links the experiment workflow data obtained from tools such as GUSH to representations of the experiment's GENI topology, the GENI Instrumentation and Measurement systems, and log term data archives. NetKarma links all of these systems together to simplify the complexity of running an experiment on the GENI framework. 13 13 14 14 In the plan for evaluating NetKarma we had identified experiments being performed in GENI by researchers at Clemson University on distributed denial of service (DDoS) attacks in WiMAX as a means to evaluate the provenance being captured by Karma. Since GEC12 we have implemented their experiment, and using the standard trace log that is generated and an extension we added to capture the experiment topology, we are able to harvest detailed provenance about their experiment. The DDoS experiments measure the change in throughput as a set of network parameters are varied, resulting in over 700 different configurations being tested. Using the provenance captured from the logs for each packet that was successfully transferred, and the inferred provenance of packets that were dropped, the NetKarma visualization plug-in can be used to visualize the throughput and packets dropped and view the provenance at different levels of granularity as shown in our demo and poster at GEC13. We shared the visualization plugin and provenance graphs generated with the researchers at Clemson and they noted that NetKarma allows them to visualize and compare individual runs whereas previously their analysis was based on ANOVA calculations at an aggregate level. At GEC13 we presented a demo that visualized the provenance based on our runs of Clemson's experiment to show how provenance can be used to visualize results and is valuable for communicating the results of GENI experiments to other researchers. … … 20 20 Using the MiMAX DDoS experiments at Clemson which were identified as a case for evaluating the provenance captured and visualized using NetKarma we showed how the provenance of packets successfully transferred and the inferred provenance of packets dropped can be used to provide visualizations of individual experiment runs; providing network researchers with a new approach to analyzing their experiment results. At GEC13 we presented both a poster and a live demo of the provenance captured from the DDoS experiments we reran based on the research done by GENI researchers at Clemson University. An additional outcome of this evaluation of NetKarma is a new NetKarma adaptor that can be used to capture provenance of experiments run on the NS2 simulator used in the Clemson experiments (and can be applied to any NS2 experiments). An enhanced NetKarma plug-in for Cytoscape that contains new visualization algorithms for visualizing the provenance of NS2 experiments was also released (version 1.2.1). Both the adaptor and visualization plug-in, along with updated software documentation, are available on the NetKarma wiki. 21 21 [[BR]] 22 We have utalised the work on the NetKarma Portal to greatly improve the usability and utility of the experimental data. From the portal the ingestion process becomes 23 just requires the experimentor drag the files related to there experiment and have the experimental data ingested into NetKarma in one easy step. In addition to the portal, the AXIS2 and RabbitMQ mechanisms for adapters are supported allowing for experimentors to automated the ingestion process if desired. 22 We have utilized the work on the NetKarma Portal to greatly improve the usability and utility of the experimental data. From the portal the ingestion process just requires the experimentor drag the files related to there experiment and have the experimental data ingested into NetKarma in one easy step. In addition to the portal, the AXIS2 and RabbitMQ mechanisms for adapters are supported allowing for experimentors to automate the ingestion process if desired. 24 23 25 24 __S4b.2 Linking workflow provenance information to metadata__ 26 The NetKarma portal is designed to link metadata such as the metadata object descriptor to the workflow information and provide the experimentor a way to navigate between not only the metadata and provenance information but also provide s a way to visualise the measurement data that any metadata refers to and provide links to additional sources of data such as GEMINI, GIMS or the GMOC. The NetKarma portal supports ingestion of the metadata object directly or reference. For example a reference to a resiurce in a UNIS or NMWG file could be linked directly to the measurement data collected for that resource on the GENI topology. NetKarma provides an experimenter focused view to the data collected for the entire experiment.25 The NetKarma portal is designed to link metadata such as the metadata object descriptor to the workflow information and provide the experimentor a way to navigate between not only the metadata and provenance information but also provide a way to visualize the measurement data that any metadata refers to and provide links to additional sources of data such as GEMINI, GIMS or the GMOC. The NetKarma portal supports ingestion of the metadata object directly or reference. For example a reference to a resource in a UNIS or NMWG file could be linked directly to the measurement data collected for that resource on the GENI topology. NetKarma provides an experimenter focused view to the data collected for the entire experiment. 27 26 28 27 __S4b.3 Written plan to work with a second experiment/experimenter for evaluation of the provenance system___ 29 28 We have identified the eXtensible Session Protocol (XSP) based on experiments by researchers at Indiana University and the University of Delaware for the second GENI project used to evaluate the provenance captured in NetKarma. In comparison to the first project identified (WiMAX DDoS attacks based on research at Clemson), the XSP research presents a different and diverse set of issues. Whereas the WiMAX experiments presented a high volume of provenance regarding similar data objects (packets being transferred and inferred packet loss), the XSP experiment presents the challenge of capturing and representing the provenance of events at different network layers. The NetKarma evaluation plan has been updated to include the XSP experiment and is available [http://groups.geni.net/geni/attachment/wiki/netKarma/GENI%20-%20Provenance%20System%20Evaluation.pdf here] on the NetKarma wiki. 30 29 31 == Work P reformed this Quarter ==30 == Work Performed this Quarter == 32 31 33 32 __S4b.4 Work with the GENI I&M community to define a standardized GENI event records__ … … 42 41 __NetKarma Portal__ 43 42 44 The NetKarma Portal provides a easy way for experimenters to:43 The NetKarma Portal provides an easy way for experimenters to: 45 44 46 * Create a new experiment, pointed to by a universial handle (DOI or ARK)45 * Create a new experiment, pointed to by a universal handle (DOI or ARK) 47 46 * Capture experiment workflow information from log files 48 47 * Integrate GENI topology information to an experiment 49 * Int igrate measurements from GENI I&M implementations to an experiment50 * Visuali se workflow, topology, measurement, status51 * Produce unified exper ment data representations such as a KML "movie"48 * Integrate measurements from GENI I&M implementations to an experiment 49 * Visualize workflow, topology, measurement, status 50 * Produce unified experiment data representations such as a KML "movie" 52 51 * Interface to archival services (local and iRODS) 53 52 * Browse the work of other experimenters (given proper permissions) … … 64 63 * GENI v3 RSpec files 65 64 66 Once the files are uploaded to NetKarma Provenance store through the portal the workflow can be visualized both on the portal itself and through the NetKarma plugin for the Cytoscape desktop application.67 Experimenters can visuali se the workflow of their experiments as an Open Provenance Model (OPM) graph inside the portal. Filters can be applied against attributes of the processes and artifacts to show for example a subset of time of each experimental run. Resources uploaded as Rspec or topology files can also be visualized both in logical or geographically based representations. Data products such as the GoogleEarth KML "tours" allow for combination of experimental workflow with GMOC status and time seres data. Finally a data access to local or remote (such as iRODS) data archive service is provided.65 Once the files are uploaded to the NetKarma Provenance store through the portal the workflow can be visualized both on the portal itself and through the NetKarma plugin for the Cytoscape desktop application. 66 Experimenters can visualize the workflow of their experiments as an Open Provenance Model (OPM) graph inside the portal. Filters can be applied against attributes of the processes and artifacts to show, for example, a subset of time of each experimental run. Resources uploaded as Rspec or topology files can also be visualized both in logical or geographically based representations. Data products such as the GoogleEarth KML "tours" allow for combinations of experimental workflow with GMOC status and time series data. Finally a data access to local or remote (such as iRODS) data archive service is provided. 68 67 69 68 [[Image(NetKarma_experiments.png, 40%)]] [[BR]]
