wiki:GENIRacksHome/OpenGENIRacks/DellRackDetails

Version 3 (modified by lnevers@bbn.com, 10 years ago) (diff)

--

BBN-CAM OpenGENI Rack Installation and Configuration Details

This is an internal development rack. Not for public use.

Parts List

  • 3 Dell PowerEdge R620
  • 1 Dell PowerConnect 7048 switch
  • 1 Dell Force10 S4810P OpenFlow switch
  • 3 SFP cables
  • 9 Ethernet cables
  • 3 SFP-ethernet converters
  • 1 Serial cable
  • 230V UPS (Optional)
  • Rack Size - Width: 23.8" (605mm), Depth: 42.1" (1070mm), Weight: 298 lbs (135 kg)

Power Requirements

As for power, the racks will come with a 5600W, 230V UPS to power all the components. The power supply has the following technical specs:

  • Power Rating: 5600 Watts
  • Runtimes: 5.5 mins @ full load, 17 mins @ ½ load
  • Input Voltages: 220, 230, 240 VAC
  • Output Voltages: 220, 230, 240 VAC
  • Input Connection: Hardwired
  • Output Receptacles: IEC-60320 C13(X6), IEC-60320 C19(X4)
  • Physical Specs (w x h x d – wt): 17.2” x 6.75” x 31.1” – 158lbs
  • Heat Dissipation in Normal Mode BTU/hr: 956

Hardware Configuration

BOS is a rack consisting of the following hardware components:

  • 3 Dell PowerEdge R620 server hosts. Of these, we have configured
    • 1 as the OpenStack control node (bbn-cam-ctrl-1.bbn.com)
    • 2 as OpenStack compute nodes both act as VM servers (bbn-cam-cmpe-1.bbn.com, bbn-cam-cmpe-2.bbn.com).
  • 1 Dell PowerConnect 7048 Switch for access to the external internet Manual
  • 1 Dell Force10 S4810P OpenFlow switch. Manuals

There are no bare metal servers on this rack.

Network Configuration

We have established the following addresses for the different servers, and connected them to the following ports on the Force10 switch and PowerConnect 7048 switch:

HostControl Plane AddressPowerConnect Port (Control Plane)External AddressPowerConnect Port (External Plane)Management AddressPowerConnect Port (Management Plane)Data Plane AddressForce10 Port (Data Plane)
bbn-cam-ctrl-110.10.8.10013128.89.72.1122510.10.6.100110.10.5.1000
bbn-cam-cmpe-110.10.8.10114128.89.72.1132610.10.6.101210.10.5.1011
bbn-cam-cmpe-210.10.8.10215128.89.72.1142710.10.6.102310.10.5.1022

The management plane on the VMs use a 192.168.x.x address, which is a Quantum (OpenStack) network that is running within the management plane and physical network interface above. This network is used for port-forwarding of ssh traffic to/from the VMs. All VMs created will have an address in this network in addition to any interfaces requested.

The external gateway from the rack is at 128.89.72.1

We use the follow VLAN configuration to define the various networks:

Networkswitchports VLANs
management management 1, 2, 3 2500
control management 13, 14, 15, 16, 17, 18, 19, 20 200
external management 25,26,27, 29,37,48 300
data (local) OpenFlow 0, 1, 2 1000-2000
data (stitched) OpenFlow 0, 1, 2, 3 2001-2099

We have established the following control plane addresses for the different servers, the Force10 switch and connected them to the following ports on the PowerConnect 7048 switch:

HostControl Plane AddressPowerConnect Port (Control Plane)
bbn-cam-ctrl-iDRAC10.10.8.1018
bbn-cam-ctrl-iDRAC10.10.8.1119
bbn-cam-ctrl-iDRAC10.10.8.1220
Force10 OpenFlow Switch10.10.8.20016
PowerConnect 7048 Switch10.10.8.20117

The ports on the Dell Force10 switch used for transporting data plane traffic (0, 1, 2) are configured as tagged VLAN's 1000-2099.

!
interface Vlan 1000 of-instance 1
 no ip address
 tagged TenGigabitEthernet 0/0-2
 no shutdown
!
interface Vlan 1001 of-instance 1
 no ip address
 tagged TenGigabitEthernet 0/0-2
 no shutdown
!
......

OpenFlow Resources

Experimenters can use a POX controller running as a "Learning Switch" at 10.10.8.100:9000 The syntax for rspecs: <openflow:controller url="10.10.8.100:900"/>

Software Configuration

BBN-CAM has a standard GRAM configuration, with one control host (bbn-cam-ctrl-1) and two compute nodes (bbn-cam-cmpe-1, bbn-cam-cmpe-2). The configuration file (/etc/gram/config.json) represent this configuration with the external and control plane addresses and VLAN ranges as described above.

The BBN-CAM GRAM Rack is currently configured with the following versions of software:

Software Component Version
Ubuntu OS 12.04
Python 2.7.3
MySQL 14.14
Quantum 2.0
Nova 2013.1.3
Glance 2013.1.3
Keystone 2013.1.3
openVSwitch 1.4.0
Pox 0.1.0
gcf 2.4.1