Changes between Initial Version and Version 1 of DICLOUD-4Q09-status

05/27/10 09:37:07 (9 years ago)



  • DICLOUD-4Q09-status

    v1 v1  
     3= !DiCloud Project Status Report =
     5Period: 4Q09
     6== I. Major accomplishments ==
     7The first quarter of the !DiCloud project includes the following major accomplishments:
     8  * In conjuction with the ViSE and DOME projects, !DiCloud has been working with BBN, NLR, and our Cluster D peers to enable VLAN connections. In the last quarter we successfully tested a VLAN connection to BBN’s offices in Cambridge
     9  * Participation to GEC6, presentations and discussions to manage EC2 resources within the Orca framework.
     10  * Study of options and cost implications for GENI network connectivity with Amazon EC2 cloud resources.
     11  * Testing and prototyping of various options to implement Orca handlers for EC2 resources.
     12The rest of this document describes in detail the major accomplishments above.
     14=== A. Milestones achieved ===
     15We achieved the following milestones in the 1st quarter as specified in our original Statement-of-
     17  * '''November 16, 2009.''' Collaborate with GPO and other projects in Cluster D, to complete a Spiral 2 plan for the setup of VLANs between aggregates, to be carried by the Internet 2(or NLR) backbone network between the aggregates.
     19During the quarter we were able to successfully test a static VLAN connection from our offices in
     20the Computer Science Department at UMass-Amherst to BBN’s offices in Cambridge,
     21Massachusetts. We are currently working with Kathy Benninger at NLR and the GPO to
     22determine the best way to deliver our traffic to NLR, since UMass-Amherst is not an active
     23member of NLR. The current plan is to apply to NLR to obtain a separate port at the Northern
     24Crossroads (NOX) in Boston for UMass GENI traffic. As a backup, we will use the BBN port at
     25the NOX to allow our traffic to get on NLR. We are also working with our Cluster D peers to
     26enable cross-site VLANs using Northwestern’s Starlite project.
     27  * '''December 23, 2009.''' Report on the options and cost implications for network connectivity with Amazon’s cloud, including the use of publicly addressable IPs, Amazon’s recently announced Virtual Private Cloud Service, and VLANs now and in the future. Pick initial approach for use in year 1.
     29Deliverable S2.b contains a description of the current options available to access Amazon EC2
     30cloud resources with their associated cost. By default, EC2 servers are provided with a public IP
     31address for generic access. Recently, a new service called Amazon Virtual Private Cloud (VPC)
     32has been added to provide layer 3 VLAN capabilities. This service is only available in beta for
     33specific software that is only available in 2 product brands. As no layer 2 solution is currently
     34available, we recommend the usage of a free software solution such as OpenVPN to run inside
     35the virtual machines hosted on EC2. We expect the Amazon offering to expand quickly over the
     36next year at which stage we will be able to offer a revised recommendation.
     37     '''Milestones in Progress'''
     38  * '''January 29, 2010.''' Develop 3 Orca handlers to allocate and revoke resources from Amazon’s Elastic Compute Cloud (EC2), Simple Storage Service (S3), and Elastic Block Store (EBS) cloud services. Explore the feasibility of integrating third-party handlers from either Eucalyptus or !OpenNebula into GENI/Orca. Note that the handlers interact with Amazon’s API perform allocation/authorization functions, but do not expose the Cloud API to slice controllers.
     40We have been prototyping different approaches to implement Orca handlers including Ant task or
     41direct invocations of the EC2 tools. While Eucalyptus and !OpenNebula offer interesting
     42alternatives to the EC2 native APIs they don’t offer the monitoring capabilities that will be
     43required in the future to estimate the cost of resource usage. We are leaning towards a solution
     44based on the EC2 native tools.
     46  * '''February 10, 2010.''' Develop a first-come first-served (FCFS) clearinghouse (broker)
     47policy that tracks the amount of resource time incurred by each cloud user. Note that this
     48policy does not track fine-grained usage costs, such as the number of I/Os (for EBS) or
     49the aggregate network traffic (for EC2/S3). The proxy will serve this function.
     51We have been thinking about various ways of exposing EC2 resources to the users. While EC2
     52instances can be registered and managed as a pool of servers, disk resources (S3 or EBS) can be
     53created dynamically, are likely to have a longer life/lease than one experiment and can potentially
     54be shared among multiple users. There is also a cost for persistent data even if it is not used and it
     55will be necessary to reclaim these resources after a certain expiration date.
     56=== B. Deliverables made ===
     57Deliverable S2.b has been produced on December 22, 2009. The document describes the current
     58network connectivity solutions available to access Amazon EC2 cloud resources. As no layer 2
     59solution is currently available, our recommendation for the first year is to use a free software
     60solution such as OpenVPN running inside the Amazon EC2 instances.
     62== II. Description of work performed during last quarter ==
     64=== A. Activities and findings ===
     65The primary work during the quarter, including our Activities and Findings, centered on
     66achieving the milestones described above and making progress toward our upcoming milestones.
     67We also attended GEC 6 where we presented our approach and discussed the specifics of EC2
     68resources within the Orca framework.
     70=== B. Project participants ===
     71The primary PI is Michael Zink. Co-PIs are Prashant Shenoy, and Jim Kurose. Research Staff is
     72David Irwin and Emmanuel Cecchet.
     74=== C. Publications (individual and organizational) ===
     75We did not submit any external publications besides the deliverable due during this quarter.
     77=== D. Outreach activities ===
     78As part of the ViSE project, we are teaching seminars and tutorials on GENI at the University of
     79Puerto Rico Mayaguez from January 11th to January 15th, 2010. As part of this lecture series and
     80the !DiCloud project, we are also including seminars on cloud resources from Amazon, including
     81EC2, S3, and EBS tutorials.
     82=== E. Collaborations ===
     83We are actively working with the GPO to connect our VLANs to NLR. In the last quarter, we
     84tested our VLAN from our offices to the BBN’s offices in Cambridge. Additionally, we are also
     85working with both RENCI and Northwestern on cross-site VLANs. Finally, we are having
     86ongoing conversations with CASA researchers on their experience running experiments in endto-
     87end sensor networks and that we plan to keep them informed about the activities and the
     88progress in !DiCloud.
     89=== F. Other Contributions ===