wiki:TIEDClearinghouse

Version 14 (modified by faber@isi.edu, 10 years ago) (diff)

--

The TIED Clearinghouse

The TIED clearinghouse presents two primary services to users:

  • Experimenter Registration
  • Slice Management
  • Aggregate Management
  • Experimental tools

This page outlines those services and how an experimenter can make use of them. Most of these services are provided to one extent or another by DETER's fedd software. We describe the mapping to fedd as well.

Experimenter Registration

TIED currently makes access control decisions based on both the identity of a user and on the attributes that TIED knows about the user. The user's identity is encoded in a fedid, the TIED version of a GENI ID. A fedid can be created by any user using standard SSL commands, but the advantage of using the TIED experimenter registry is that it binds additional information to that identity. Specifically, this creates a three-level name for the experimenter. This allows the TIED federation daemon to negotiate different levels of access with the aggregates with which the TIED clearinghouse federates.

Slice Management

For TIED, slice management is the creation and manipulation of experiments that span multiple facilities. One can think of the facilities as aggregates, each of whaich controls access to a set of resources. Currently TIED supports creation of slices across testbeds with an Emulab interface and that run instances of fedd that act as aggregate managers. In addition ti the experimenter interface to slices, TIED provides interfaces that allow experimental tools to be used in the slice.

Component/Aggregate Management

The TIED clearinghouse manages the access control of multiple sites as aggregates. It provides a unified access control model across aggregates and provides a unified interface for alloacting resources from them. Currently Emulab-based testbeds are used as aggregates, but development is underway to access other systems through the same interfaces.

Experiment Tools

Most tools that use the Emulab testbed interfaces can be seamlessly used on TIED slices. In particular the DETER SEER tool can be used to transparently manipulate experiments inside TIED slices.

Using the TIED Clearinghouse

This brief tutorial will show how to register with TIED, create a slice, connect to it using SEER, and finally to terminate the slice.

Registering with TIED

Registering with TIED is a two phase process. An experimenter first joins a DETER project that is set aside for TIED/GENI users, and then fedd is configured with the additional attributes that allow slice operation. The experimenter sees only the step of joining the DETER group.

Joining the TIED project on DETER is just like joining a project on any Emulab-based testbed. If you are a DETER user, just log in and choose "Join an Existing Project" from the Experimentation menu. If not the detailed instructions follow.

Connect to http://www.isi.deterlab.net and click on the "Request Account" button and from the next screen the "Join an Existing Project" link. Fill out the form as instructed and be sure to enter "TIED" in the "Project Name" field. Shortly the TIED staff will approve you as a TIED member and also add appropriate configuration to the slice management portion of fedd to allow you to create slices. You will receive two e-mail messages, one stating you've been approved in the TIED group and one indicating that you've been granted the authority to create slices. Once you have received both messages, you can create slices.

(Incidentally, you also have a fully functional DETER account.)

Slice Management

TIED keeps a record of slices and allows users to recreate them or terminate running ones through a web interface. The current list is available from https://www.isi.deterlab.net/fedd_list.php3 (you must be logged in using your TIED account to view this page). An example is below.

The image is of the logical slice topology, it does not indicate which aggregates donated which nodes. The master testbed column indicates which testbed is exporting its user environment into the experiment. For TIED slices, this will usually be the DETER testbed. The project column will be TIED for TIED experimenters; it indicates that the DETER TIED project is being exported into the slice. The name of the slice is a mnemonic name attached to the slice. It also has a fedid this is not visible from this interface. Finally there are buttons to create or terminate this slice, active based on the current status of the slice.

Creation

One can create a slice either by activating one of the existing slice descriptions, which will create the slice based on its last configuration, or by going directly to the slice creation page and providing a slice description and a name. Slice descriptions are written in a modified ns2 language, extended to describe the embedding of nodes in the various aggregates. The language is briefly described in the fedd documentation. The configuration file used to describe each of the examples on the slice listing page is available from that page as a starting point.

Giving a slice a new name will create a new slice, specifying an existing name will overwrite an inactive slice.

Fedd's documentation on experiment creation provides detail on how experiments are created from the description. In reading that document from a GENI perspective, it helps to think of experiments as slices and testbeds as aggregates (the aggregate interface is provided by fedd).

Termination

The simplest way to return a slice's resources is to use the terminate button from the slice listing page, which is active when a slice is active. Only the experimenter who created the slice can delete it from the web interface, though the command line interface is more versatile. Alternatively, one can terminate a slice from the termination page, where one must type the slice name by hand.

Slice Status

Both the creation and termination pages give the experimenter an indication that their slice operation has begun, but do not provide ongoing updates on the status of that operation. Creation can be a lengthy process, especially if there are allocation or configuration errors in aggregates. Currently the only way to track progress of a slice creation is through the slice listing page. This is an area of ongoing improvement.

DETER resources in the slice

Access to the slice is through the DETER TIED account and the resources allocated on the DETER testbed. Those resources will be housed in an DETER experiment with the same name as the slice created. Information on the nodes allocated is available from the MyDETERLab selection from the experimentation interface when logged on to the DETER web site. An experimenter can access the allocated nodes on DETER and through them into the rest of the slice. The Emulab event system and SEER provide simpler ways of reaching into the slice.

Experiment Tools

The SEER experiment control tool is a useful way to manipulate a TIED experiment to both carry out the experiment and to examine real time data from the experiment. Other Emulab-style measurement gathering and event systems function as well, but SEER is a convenient, extensible system.

Once an slice is created that includes the SEER code - the SEER HOWTO explains the commands one must include in the experiment configuration language one must make to include the SEER base system - the SEER front end can be used. One can start the front end using the webstart link on the SEER page. Alternatively one can download the source from there and compile and run SEER locally, though we don't recommend it.

As a quick tour of SEER's capabilities, we show a 3-node slice, split across two aggregates, controlled by SEER. This is the TIED/one experiment listed on the slice listing page. The control node is a node dedicated to letting SEER see the whole slice, even though parts of it are remotely allocated. In TIED, control nodes are best allocated inside the DETER testbed.

After activating the webstart link, and replying to any of your browser's questions about starting the interface, the seer window and a dialog requesting the kind of interface to use will appear. Choose "Federated Emulab" from the list.

Next choose "Attach to Experiment" from the "Federation Interface" menu, which will bring up a dialog asking which experiment to attach. The project will be "TIED" and the experiment (slice) name is the one you chose. The image shows the "TIED/one" example slice.

The next dialog gets the information needed to talk to the controller inside DETER. The important fields are the hostname (users.isi.deterlab/net) and your DETER username. The SSH key file is optional. If you don't give it, another dialog asking for your DETER password will appear.

At this point SEER contacts the running fedd for logical information about the slice and populates the topology window. You can view that window by selecting the "Topology" tab. As before the image shows the two node TIED/one slice.

One can get a real time summary of traffic between nodes by selecting the node on the topology and requesting a graph. The graph appears under the "graphs" tab.

The controls dialog can be used to initiate actions on slice nodes. The screenshots show initiating a ping from node a to node b in the current experiment. The experimenter selects the ping traffic tool, creates an instance called "pingab", cnfigures the instance and starts the action.

Attachments (17)

Download all attachments as: .zip