wiki:MillionNodeGENI

Version 23 (modified by Vic Thomas, 10 years ago) (diff)

--

Project Number

1645

Project Title

A Prototype of a Million Node GENI
a.k.a. MillionNodeGENI, MILNGENI

Technical Contacts

PI Thomas Anderson (mailto:tom@cs.washington.edu / 206 543 9348)
Co-PI Justin Cappos (mailto:justinc@cs.washington.edu / 206 685 4131)

Participating Organizations

University of Washington
Paul Allen Center for Computer Science and Engineering
Box 352350
Seattle WA 98195-2350

Scope

The scope of work on this project is to specify, build, and demonstrate a prototype end host deployment platform consisting of three components: a) a general-purpose yet safe execution environment for experimenter code running on end hosts, b) a light-weight, programmable and customizable proxy for end hosts for redirecting end-user traffic into GENI, and c) a clearinghouse for resources contributed by end users who have opted into the system. Specific development goals include:

  1. Development of a viable end-host virtual machine
  2. Control-plane integration, including resource discovery and reservation; experiment debug and control
  3. End-user configuration and management tools
  4. Deployment strategies such as inclusion in Bit Tyrant or web plug-in
  5. End-user policy & awareness issues and mechanisms

Diagram showing relationship between end-host VM, node manager and experiment manager.

Milestones

MilestoneDate(MillionNodeGeni: S2.a Installer v 0.1)? Installation scripts and simple packaging for Windows / Mac / Linux.
MilestoneDate(MillionNodeGeni: S2.b End hosts with intermitted connectivity)? Operation with end-hosts that have intermittent connectivity and/or are behind firewalls and NATs.
MilestoneDate(MillionNodeGeni: S2.c Implement example applications)? Example applications such as Chord and a web redirection service.
MilestoneDate(MillionNodeGeni: S2.d Create an example assignment)? Example assignment leveraging Seattle that an educator might use.
MilestoneDate(MillionNodeGeni: S2.e Integrate with ProtoGENI)? Calls to get resources & release resources work across both frameworks.
MilestoneDate(MillionNodeGeni: S2.f Clearinghouse API spec. for end-hosts)? Specification for Clearinghouse API for end-hosts.
MilestoneDate(MillionNodeGeni: S2.g v0.1 of end-host clearinghouse)? Reference implementation v0.1 of end-host clearinghouse.
MilestoneDate(MillionNodeGeni: S2.h Sprial 2 identify management mechanisms)? Integrate Sprial 2 identify management mechanisms.
MilestoneDate(MillionNodeGeni: S2.i Collaborate with O&M team)? Collaborate with O&M team on methods to share O&M data with other GENI groups.

Project Technical Documents

End Host VM Design Techniques

Node Manager Design (Check https://seattle.cs.washington.edu/wiki/NodeManagerDesign for updates.)

RSpecs in the Million Node GENI system

Software Deliverables

The node manager and repy (end host vm) are in the seattle_repy.tgz tarball that can be downloaded from https://seattlegeni.cs.washington.edu/geni/download/flibble/. Install the node manager on the local machine by running ./install.sh. Note that you should have Python 2.5.2 installed (but it may work with Python 2.5.X or 2.6).

The reference implementation of a trivial experiment manager (a test client for the node manager) can be downloaded from http://seattlegeni.cs.washington.edu/dist/demokit.zip. This contains seash.py which is a trivial PLuSH / GUSH-like experiment manager.

The installer is available at https://seattle.cs.washington.edu/wiki/BaseInstallers.

Quarterly Status Reports

December 2008 Report
April 2009 Report
June 2009 Report
September 2009 Report
December 2009 Report

Spiral 1 Connectivity

Part of the ProtoGENI cluster.

Connectivity issues need to be sorted out (NAT traversal, intermittent connectivity, etc). End user devices will already have IP addresses. Need to figure out how they connect to clearinghouses, etc.

GPO Liaison System Engineer

Vic Thomas mailto:vthomas@geni.net

Related Projects

Attachments (12)