wiki:WiMAXInteg/CampusInstallation

Version 84 (modified by hmussman@bbn.com, 14 years ago) (diff)

--

8. WiMAX Campus Installation and Deployment

The following sections outline the steps necessary to complete a campus installation, based on a WiMAX base station kit provided by Rutgers WINLAB and NEC.

The principal contents of the WiMAX base station kit provided by Rutgers WINLAB and NEC are listed here:

  • Antenna, dual-polarization, omnidirectional antenna, for operation in the 2.5GHz range. Technical specification in Sec 1.2 of NEC Sector Antenna Installation Manual
  • Base Station Outdoor Unit, for connection to one antenna. Technical specification in Sec 3.5 of the NEC Installation Manual for Base Station (IMN:BS)
  • Base Station Indoor Unit, equipped equipped for 1-Sector Configuration, with one Network Interface (NW INTFC) card and one Channel Card (CHC). Technical specification in Sec 2.6 of the NEC Installation Manual for Base Station (IMN:BS)
  • One Linux Server, including the ASN-GW and ORBIT Mangement Framework software, sufficient for checkout and initial deployment; may be sufficient for final depoyment configuration.

See Sec 6.9 for a complete, detailed list.

The principal items that the campus must provide are listed are:

  • Outdoor site, with pole for mounting of antenna and Base Station Outdoor Unit.
  • Indoor site, with racks, for mounting of Base Station Indoor Unit and Linux Servers.
  • Wiring between sites, preferably in conduit.
  • Zero to three Linux Servers, to accomodate desired final deployment configuration of the ASN-GW and ORBIT Mangement Framework software.
  • Ethernet switch for multiple VLANs.
  • -48VDC power supplies for Base Station Outdoor and Indoor Units.
  • 110VAC feed for Linux Servers, -48VDC power supplies and Ethernet Switch. Preferably,the 110VAC feed should be provided by a UPS that bridges at least short power gaps.

See Sec 6.9 for a complete, detailed list.

Once the WiMAX base station kit has been installed on the campus, and is operational, the GPO can arrange the transfer of ownership from the NSF to the university.

8.1 Identify Outdoor Site on Campus

An outdoor site (e.g., the roof of a building) should be identified on campus that meets these requirements:

  • High, to maximize range. Since throughput and coverage of WiMAX systems are highly influenced by the antenna location, care should be taken that the antenna is mounted so that siginificant portion of First Fresnel Zone is clear of obstructions. Ideally the antenna is mounted on the elevated structure providing clear line of sight to most of the intended coverage area.
  • NOTE: Antenna height is limited to 6 m above the roof of the building, for reasons of aircraft safety.
  • Capable of safely and securely supporting a pole that mounts antenna and Base Station Outdoor Unit. See Sec 6.1, 6.6 of the attachment:BS_INSTALLATION.pdf NEC Installation Manual for Base Station (IMN:BS)]
  • Access to building ground, for lightning protection, using a heavy ground cable.
  • Access to Indoor Equipment Room, for power and optical fiber (signal) cables. The use of a conduit is preferred, but otherwise the fiber (signal) cables must be mechanically protected.
  • Secure access, to prevent unauthorized people from disrupting operation, or receiving unhealthy electromagnetic exposure. For personnel safe area, see Sec 1.7 of the NEC Installation Manual for Base Station (IMN:BS)

IMPORTANT: It is suggested that this process be started IMMEDIATELY, to assure that an appropriate outdoor site can be identified and it's coordinates used for obtaining FCC Experimental License.

Sites can also identify multiple locations and apply for multi-site license in case they plan to deploy more BSs.

8.2 Obtain FCC License

Each campus must apply to the FCC and obtain a license (experimental authorization) to operate the WiMAX equipment at their location.

IMPORTANT: It is suggested that this process be started IMMEDIATELY following the selection of the outdoor location, to assure that a license can be obtained.

In a few cases, the university will have an "Educational Broadband Services" license that can be used for this equipment, depending upon university policy. In the other cases, an application must be made to use spectrum that is either available, or else reserved for commercial use (e.g., Sprint/Clearwire) that has not yet started.

Per Ivan Seskar, Rutgers has obtained a license to operate at two locations (WINLAB and Bush Campus), utilizing spectrum reserved for commercial use by Sprint/Clearwire, that has not yet started. Because of this:

  • The Rutgers/WINLAB license states: "Licensee must get consent from Educational Broadband Services and Broadband Radio Services licensees in the immediate vicinity of the tests."
  • When Sprint/ClearWire stsrts commercial service in the area, Rutgers will have to shut down their WiMAX base stations, or else find other spectrum that is available.
  • Furthermore, the license expires in 2 years, and can only be renewed with another application.

Suggestions from Tony Michel on the application process are at http://groups.geni.net/geni/attachment/wiki/WIMXBBN/020810%20%20license-HOWTO.pdf. He recommends:

  • Consider Educational Broadband Services and Broadband Radio Services range of 2496 - 2690 MHz.
  • Checking the FCC database to learn which spectrum in your area is available, and which has been assigned.
  • Furthermore, he suggests using an antenna and a spectrum analyzer to determine which assigned spectrum is actually being used in your area.
  • As a first choice, you should apply for spectrum that is available.
  • As a second choice, you should apply for spectrum that has been assigned for commercial use (e.g., Sprint/Clearwire) that has not yet started.

The person submitting the application needs to obtain either a personal or institution FCC Registration Number (FRN). If one is not available, it can be obtained through FCC's COmmission REgistration System (CORES) registration.

With the FRN, an applicant can start the application process by filling out Form 442. Required information for filling up the form includes:

  • Frequency: [specify 10MHz range near 2.5GHz]
  • Frequency tolerance: 0.00002 %
  • Power: 20 W [or specify 32 W, which is the maximum allowed]
  • Radius: 5 km
  • Location: [use Google Earth/Maps to find out latitude/longitude of the location where you plan to install the antenna]
  • Emission designator: W7D
  • Contracting Agency: National Science Foundation
  • Contract Number: 0944089

It is a good strategy to request multiple sites, to allow flexibility in your installation, and/or to allow the eventual installation of two base stations to support handover experiments, etc. Note that WINALB/Rutgers license lists two sites. You may apply for one, two or three sites.

It should be noted that this license (experimental authorization) "is to be used for fulfilling the requirements of a U.S. government contract".

Each application should attach a project overview, including details of NSF contract (award) in the filing process. to increase the likelihood of license issuance and to expedite the process.

At the end of the application process, the applicant must pay the $60 application fee. The fastest method of payment is by credit card. The FCC has a site for testing the application process.

Suggestions from Mark Corner on the application process:

  • Write down any reference numbers, file numbers, confirmation numbers, correspondence numbers as you go. Most of them can't ever be retrieved without calling someone. And there a lot of them.
  • The application website is very linear. Meaning that you really can't go back and edit anything, look up anything you already did, or go backwards.

Once application process is completed and assuming there are no issues with the particular location, FCC will issue a WIMAX license after 4-8 weeks. It is best to keep checking the FCC database to see when the assignment has been made, because it appears that it takes a long time for the FCC to mail out confirmation of the assignment.

Here is a sample license, the WINLAB Rutgers WiMAX license received from the FCC. Items of note include:

  • Two sites were requested and received, which might permit handover experiments.
  • Both requested a 10MHz band around center frequesncies of 2590 (2586-2595) MHz and 2610 (2605-2615) MHz
  • Both requested the maximum allowable Effective Radiated Power of 32 W, even though the NEC equipment is limited to 20 W.

Here is a 2nd sample license, the BBN Technologies license, received from the FCC on 2/24/10.

ISSUE: The Rutgers/WINLAB and BBN licenses state: "Licensee must get consent from Educational Broadband Services and Broadband Radio Services licensees in the immediate vicinity of the tests." This must be done at each site. Could it be done for all sites by contacting Sprint/ClearWire on behalf of GENI?

ISSUE: In the Rutgers/WINLAB case, and probably for others, the base station will have to shut down (or find available spectrum) when Sprint/ClearWire starts commercial service in the area. Can we determine when might this be expected for each of the affected areas?

8.3 Identify Indoor Equipment Room on Campus

An indoor site (e.g., an IT equipment room) should be identified on campus that meets the requirements listed in Section 1.3 of the NEC Installation Manual for Base Station (IMN:BS), and particularly the following requirements:

  • Equipment rack space to mount Base Station Indoor Unit.
  • Equipment rack space to mount Linux Servers, 1 - 4 servers.
  • Access to Outdoor Site, for power and fiber (signal) cables. The use of a conduit is preferred, but otherwise the optical fiber (signal) cables must be mechanically protected.
  • Access to building ground, to ground equipment racks and mounted equipment.
  • Access to 110VAC feeds for Linux Servers, and -48VDC power supplies. If possible, the 110VAC feeds should be protected with an Uninterruptible Power Supply (UPS) that bridges short power gaps, to prevent disrupting the WiMAX testbed from the most common (short) power gaps.
  • Access to available Ethernet (VLAN) switching capacity, if possible.
  • Access to backbone network Layer 2 connection.
  • Secure access, to prevent unauthorized people from disrupting operation.

IMPORTANT: It is suggested that this process be started IMMEDIATELY, to assure that an appropriate indoor equipment room can be identifed.

8.4 Install Wiring at Outdoor Site and to Indoor Equipment Room

The following cables must be run at the Outdoor Site and between the Outdoor Site and the Indoor Equipment Room:

ISSUE: Does your site require a PE to certify proper grounding?

  • One -48VDC power cable, from (one) Outdoor Unit to indoor equipment room. See Sec 3.4.1, Fig 4-1 and Sec 6.3 of the NEC Installation Manual for Base Station (IMN:BS)
  • Option: If there is a weathertight enclosure on the roof with 110VAC supply, you may run the -48VDC power cable to the enclosure, and mount the -48VDC power supply there.
  • One dual optical fiber signal cables, from (one) Outdoor Unit to indoor equipment room. See Sec 3.4.1, Fig 4-1 and Sec 6.4 of the NEC Installation Manual for Base Station (IMN:BS)

Ivan Seskar: slides
Ivan on 3/1: Cables from roof to equipment room include: dual fiber; power; GPS receiver coax; within 1" dimaeter.

8.5 Install Pole at Outdoor Site and Ground

A pole must be provided and mounted at the outdoor site to safely and securely mount the Antenna and Base Station Outdoor Unit.

ISSUE: Does your site require a PE to certify the safety of the pole mounting?

ISSUE: Should the pole be placed to allow for the possible addition of a second or even third antenna?

8.6 Install Antennas at Outdoor Site

Non-Penetrating Roof Antenna Mounting Example The base station kit includes one dual-polarization, omnidirectional antenna, for operation in the 2.5GHz range.
To install the antenna:

  • Follow Sec 1 - 5 of the NEC Sector Antenna Installation Manual
  • Antenna height is limited to 6 m above the roof of the building, for reasons of aircraft safety.
  • Since throughput and coverage of WiMAX systems are highly influenced by the antenna location, care should be taken that the antenna is mounted so that significant portion of First Fresnel Zone is clear of obstructions. Ideally the antenna is mounted on the elevated structure providing clear line of sight to most of the intended coverage area.

ISSUE: On which side of the pole should the antenna be mounted? How should it be tilted? How do these influence the coverage pattern?

8.7 Install Base Station Outdoor Unit

The Base Station Outdoor Unit (ODU) is mounted outdoors, near the antenna.

It connects to the antenna with a coaxial cable, and connects to the Indoor Unit (IDU) with a dual optical fiber cable. In addition, it requires a -48VDC power feed and a protection ground.

The installation should follow the instructions in Sec 3.1 - 3.3 of the NEC Installation Manual for Base Station (IMN:BS)

8.8 Complete Wiring at Outdoor Site and to Indoor Equipment Room

8.9 Install Indoor Equipment Racks and Ground

Install (or identify) indoor equipment racks in the indoor equipment room, per Sec 2.3.3 of the NEC Installation Manual for Base Station (IMN:BS), with sufficient space to mount:

  • Base Station Indoor Unit (5U).
  • Multiple Linux Servers (1U), 1 - 4.
  • Ethernet (VLAN) switch (typically 1U), or utilize existing Ethernet switch capacity.

These racks must be connected to building ground.

8.10 Install 120VAC feeds and -48VDC Power Supplies

  • Provide 110VAC feeds for Linux Servers, Ethernet switch (if provided), and -48VDC power supplies.
  • If possible, the 110VAC feeds should be protected with an Uninterruptible Power Supply (UPS) that bridges short power gaps, to prevent disrupting the WiMAX testbed from the most common (short) power gaps.
  • Install -48VDC power supplies for Base Station Outdoor Unit (max 4A) and Base Station Indoor Unit (max 8.3A), and connect them to 110VAC feeds.
  • Connect -48VDC power cable from Outdoor Unit (ODU) to power supply.

8.11 Install Base Station Indoor Unit

Install the Base Station Indoor Unit (IDU) on the indoor equipment racks, per Sec 2.3 of the NEC Installation Manual for Base Station (IMN:BS)

The IDU in the kit is equipped for 1-Sector Configuration, per Fig 2-3 of NEC Installation Manual for Base Station (IMN:BS), and includes:

  • One NW INTFC unit.
  • One CHC unit.

The NW INTFC unit:

  • Connects to a -48VDC power feed and a protection ground, and supplies power to the entire Indoor Unit. See Sec 2.2.2 and Fig 2-4 of NEC Installation Manual for Base Station (IMN:BS)
  • Connects to the ASN-GW function, supported on the Linux servers, using an ethernet cable that connects to the Ethernet switch, that provides the necessary VLAN.

Each CHC unit:

ISSUE: Optionally, each CHC unit can support two Outdoor Units and Sector Antennas. Would we want to do this? Why?

ISSUE: Optionally, two additional CHC units could be installed. Would we want to do this to serve multiple sectors?

8.12 Complete Wiring of Base Station Indoor Unit

Complete external connections to the Base Station Indoor Unit as explained in Sec 2.4.1 of NEC Installation Manual for Base Station (IMN:BS)

8.13 Initial Check-Out of Antenna and Base Station Outdoor and Indoor Units

  • Turn power ON to the Base Station Indoor and Outdoor Units, per Sec 5 of NEC Installation Manual for Base Station (IMN:BS)
  • Complete initial checkout of the of the antenna and Base Station Outdoor and Indoor Units.
  • The base station has a web interface to facilitate setup and monitoring.

ISSUE: What could be done without an ASN-GW? What could be done with a rudimentary ASN-GW?

ISSUE: Should an RF spectrum scanner system (e.g., antenna and spectrum analyzer) be used to verify operation within assigned spectrum? Should an RF RF spectrum scanner system be permanently deployed? How could it be built? Could it become a GENI measurement node?

8.14 Install Ethernet (VLAN) Switch, or Identify Existing Capacity

8.15 Install Linux Server(s) and Software

8.16 Connect Backbone Network

8.17 Provide Reference Client Platform

8.18 Inital Check-Out of Campus WiMAX Testbed

8.19 Campus Installation and Deployment Checklist

Campus Installation Checklist, for each site

Contact(s):

Step Description Planned Started Completed Comment
1 Identify Outdoor Site on Campus - - -
2 Obtain FCC License - - -
3 Identify Indoor Equipment Room on Campus - - -
4 Install Wiring at Outdoor Site and to Indoor Equipment Room - - -
5 Install Pole at Outdoor Site and Ground - - -
6 Install Antenna at Outdoor Site - - -
7 Install Base Station Outdoor Unit - - -
8 Complete Wiring at Outdoor Site and to Indoor Equipment Room - - -
9 Install Indoor Equipment Racks and Ground - - -
10 Install 120VAC and -48VDC Power Feeds and/or Supplies - - -
11 Install Base Station Indoor Unit - - -
12 Complete Wiring of Base Station Indoor Unit - - -
13 Initial Check-Out of Antenna and Base Station Outdoor and Indoor Units - - -
14 Install Ethernet (VLAN) Switch, or Identify Existing Capacity - - -
15 Install Linux Server(s) and Software - - -
16 Connect Backbone Network - - -
17 Provide Reference Client Platform - - -
18 Initial Check-Out of Campus WiMAX Testbed - - -

8.20 Campus Bill of Materials

8.21 Campus Deployment Plan

The GENI D&P WiMAX Infrastructure Buildout summarizes the entire plan.

It includes a map of the participating campuses.

And a list of involved researchers and IT leaders.

The WiMAX Kit Project (1753) outlined the usage plans for each campus.

Current campus deployment status:

Step Description Stanford Rutgers WINLAB Rutgers Bush NEC Columbia Poly NYU UCLA Colorado UMass Wisc BBN
1 Identify Outdoor Site on Campus - Completed Completed - Completed Completed Started Started Completed Completed Completed 1/28/10
2 Obtain FCC License - Completed Completed - Applied 2/25 Applied 2/22 Started Started Completed 3/2010 Completed 1st Started 2nd Completed 1st 2/24/10 Applied 2nd 1/14/10
3 Identify Indoor Equipment Room on Campus - Completed - - - Completed - - Completed - Completed 7/09
4 Install Wiring at Outdoor Site and to Indoor Equipment Room - Completed - - - - - - - - -
5 Install Pole at Outdoor Site and Ground - Completed - - - - - - - -
6 Install Antenna at Outdoor Site - Completed - - - - - - - - -
7 Install Base Station Outdoor Unit - Completed - - - - - - - - -
8 Complete Wiring at Outdoor Site and to Indoor Equipment Room - Completed - - - - - - - - -
9 Install Indoor Equipment Racks and Ground - Completed - - - - - - - - -
10 Install 120VAC and -48VDC Power Feeds and/or Supplies - Completed - - - - - - - - -
11 Install Base Station Indoor Unit - Completed - - - - - - - - -
12 Complete Wiring of Base Station Indoor Unit - Completed - - - - - - - - -
13 Initial Check-Out of Antenna and Base Station Outdoor and Indoor Units - Completed - - - - - - - - -
14 Install Ethernet (VLAN) Switch, or Identify Existing Capacity - Completed - - - - - - - - -
15 Install Linux Server(s) and Software - Completed - - - - - - - - -
16 Connect Backbone Network - Started - - - - - - - - -
17 Provide Reference Client Platform - Completed - - - - - - - - -
18 Initial Check-Out of Campus WiMAX Testbed - Completed - - - - - - - - -

Columbia University (1770) PI: Henning Schulzrinne
Henning on 2/8: Starting application process with IT. Likely site to be on engineering building, near amateur radio station.
Ivan on 3/1: Application completed.
ISSUE: Verify current status with Henning, antenna 360 or 120 degree?
ISSUE: Harry on 3/30: Concern about Clearwire rollout in NYC; see below.
NOTE: Stanford agreement with Clearwire to utilize 5MHz of their spectrum for on-campus service.

Polytechnic Institute of NYU (1751) PI: Thanasis Korakis
Thanasis on 2/8: Starting applciation process. Likely site on EE building.
Thanasis on 3/1: Application completed 2/22, for two sites: EE and Admin buildings. Equipment expected in EE building.
Ivan on 3/1: Cables from roof to equipment room include: dual fiber; power; GPS receiver coax; within 1" dimaeter.
Thanasis on 3/16: Equipment in EE building 100m from antenna
Antenna 360 degree
ISSUE: Harry on 3/30: Concern about Clearwire rollout in NYC; see below.
NOTE: Stanford agreement with Clearwire to utilize 5MHz of their spectrum for on-campus service.
UCLA (1797) PI: Mario Gerla, Giovanni Pau
Giovanni on 3/1: Applying for license. Likely site is top of student housing building, on a hill.
Giovanni on 3/16: Applying for license next week, up to 6 locations.
Expects to need 300m from antenna to equipment.
Antenna, 120 degree

Wisconsin (1724) PI: Suman Banerjee
Suman on 2/8: Have license, using it with current Cisco base station, owned by Educational Communications Board. Will be applying for a second license.
Have three good sites: one for Cisco, one for this kit, and would like to get a second kit for third site.
Suman on 3/1: Plan to apply for second license this week.
Suman on 3/16: Have agreement to purchase a 2nd kit from NEC. With this, will have three base stations, enough to cover the campus.
Antenna, 120 degree

UMass Amherst (1731) PI: Mark Corner, Brian Lynn
Brian on 2/8: IT has license that they want to retain. Mark has applied for a second license; pending.
Three possible sites: Top of library building, 20 stories, with equipment room in building. Top of graduate research center building, few stories, with equipment room in building. Top of CS building, few stories, without a good equipment room.
Brian on 3/1: Same as above; no news on license application.
Brian on 3/16: Received license last week! Need to pick site.
Antenna 360 or 120?
Need to virtualize clients, using zen

Colorado: (1768) PI: Dirk Grunwald, Gary Yee Univ. of Colorado, Boulder
Dirk on 2/8: Have eight sites with 802.11 antennas, ranging from high (6 km range) to low (within clutter of buildings). Another group on campus runs a WiMAX system inside a lab. Starting application process for experimental license. University has leased license to Clearwire, but may some use may still be possible.
Dirk on 3/1: Trying to understand how might use university license. Plan to apply for license this week. Have site and equipment room on Williams Village Building, less than 10m apart.
Gary on 3/16: Getting started on license.
Clearwire expected to begin service in Denver area May, 2010.
Also expect Clearwire to begin service in other areas by the end of 2010; see below.
Antenna 360 or 120 degree? Dirk and Gary on 3/26: In Denver area, Clearwire using E&F bands.
Expect Univ Colorado to lease 34MHz A1-3,B1-3 blocks to Clearwire near campus, and beyond.
Negotiating with Univ Colorado for 12MHz A4/B4 blocks near campus, but expect them to be leased to Clearwire beyond campus.
Applying for experimental license in C&D bands today
Working with campus IT on getting VLANs to Internet2
Turnup in early June, 2010 is possible.
Will contact Sprint/Clearwire, to ask about cooperation with GENI, and perhaps info on their 2010 and beyond roadmap

BBN Technologies, Cambridge MA
Tony Michel is our radio expert; Chaos Golubitsky is responsible for our testbed.
Tony on 2/8: See above and wiki page. Have applied for two licenses; pending. Site survey completed.
Tony on 3/1: Have received first license, 10MHz overlapping Sprint/Clearwire. Applied 1/12, received 2/24. Need to change emission designator.
Tony on 3/16: 360 degree antenna. Tony on 3/29: Received second license, 5MHz band, not overlapping with Clearwire

Stanford Univ
Masayoshi Kobayashi on 3/16: Currently, WiMAX site is indoors only, in the Gates building.
Have new agreement with Clearwire to utilize 5MHz of their spectrum for on-campus service.

NEC America
On 3/16: Currently indoors only.

8.22 Campus Installation Drawings

8.22 Campus Deployment Issues

No Issue Opened Resolved Resolution Note
1 Consent: The Rutgers/WINLAB license states: "Licensee must get consent from Educational Broadband Services and Broadband Radio Services licensees in the immediate vicinity of the tests." This must be done at each site. Could it be done for all sites by contacting Sprint/ClearWire on behalf of GENI? - - - -
2 Commercial service: In the Rutgers/WINLAB case, and probably for others, the base station will have to shut down (or find available spectrum) when Sprint/ClearWire starts commercial service in the area. Can we determine when might this be expected for each of the affected areas? - - - -
3 PE for grounding: Does your site require a PE to certify proper grounding? - - - -
4 PE for pole/antenna: Does your site require a PE to certify the safety of the pole mounting? - - - -
5 Pole placement: Should the pole be placed to allow for the possible addition of a second or even third antenna? - - - -
6 Antenna placement: On which side of the pole should the antenna be mounted? How should it be tilted? How do these influence the coverage pattern? - - - -
7 Multiple ODUs/antennas per CHC: Optionally, each CHC unit can support two Outdoor Units and Sector Antennas. Would we want to do this? Why? - - - -
8 Additional CHCs: Optionally, two additional CHC units could be installed. Would we want to do this to serve multiple sectors? - - - -
9 Initial checkout: What could be done without an ASN-GW? What could be done with a rudimentary ASN-GW? - - - -
10 RF spectrum scanner: Should an RF spectrum scanner system (e.g., antenna and spectrum analyzer) be used to verify operation within assigned spectrum? Should an RF RF spectrum scanner system be permanently deployed? How could it be built? Could it become a GENI measurement node? - - - -
11 - - - - -

Attachments (5)