IBM Ethernet Switch B24X

IBM Redbooks Product Guide

Note: This is publication is now archived. For reference only.

Published 11 November 2010

More options

Rate and comment

Authors: Jon Tate

Abstract

With the introduction of increasingly powerful servers such as the new eX5 enterprise systems, more virtual machines and transaction-heavy databases can be hosted on a single system, resulting in exploding I/O usage. To alleviate connectivity bottlenecks, a high-bandwidth 10 Gbps Ethernet solution is required that includes 10 Gbps Network Interface Cards in these high-performance servers and IBM Ethernet Switch B24X for network connectivity.

Contents

The IBM Ethernet Switch B24X is a compact, high-performance, high-availability, and high-density 10 GbE solution that meets mission-critical data center and High Performance Computer (HPC) requirements. It can support 1 GbE servers until they are upgraded to 10 GbE-capable Network Interface Cards (NICs), simplifying migration to 10 GbE server farms.

In addition, the B24X is a fully featured switch with IPv4 Layer 3 capabilities that can provide cost-efficient 10 GbE network aggregation for 1 GbE access switches. The switch runs a feature-rich and mature IronWare Operating System with an industry-standard command-line interface (CLI), minimizing re-training and operational costs. Supporting a full range of Request for Comments (RFC) and Institute of Electrical and Electronics Engineers (IEEE) standards for interoperability, along with compatibility for vendor-specific protocols such as Cisco Discovery Protocol (CDP) and Per-VLAN Rapid Spanning Tree Plus (PVRST+), the B24X integrates seamlessly into existing network infrastructures.



Figure 1. IBM Ethernet Switch B24X (front view)


Figure 2. IBM Ethernet Switch B24X (back view)


Did you know

The IBM Ethernet Switch B24X is the most power-efficient 10 Gbps switch in its class at 176 watts per twenty-four 10 GbE ports. This saves customers up to 56% in power and cooling costs over competing switches. In addition, the high-performance, cut-through, full-mesh non-oversubscribed (1:1) architecture of the B24X offers up to twice the performance with lower latencies and uses up to 2 - 3 times less rack space.

The no-compromise B24X also features data center class network resiliency and hardware availability features to support non-stop networking, making the switch ideal as an all-purpose Top of Rack switch providing network connectivity to servers within a rack, or as a compute node interconnect in HPC environments. Complemented by a full Ethernet and IP product portfolio available from IBM System Networking, IBM B24X can also be part of a standardized network infrastructure running on the proven IronWare Operating System.


Part number information

Table 1 lists the orderable part numbers for the B24X and associated options through System x.

Table 1. IBM part numbers and feature codes for ordering


Description

Part number

Feature code

IBM Ethernet Switch B24X

0563-012

0563-HC5

300 W AC Power Supply (for 1+1 redundancy)

69Y0373

4774

10 GbE 300 m, SFP+, 10GBASE-SR (duplex LC, MMF, 850 nm, OM)

69Y0389

6416
Note: OM = Optical Monitoring supported. SMF = single-mode fiber. MMF = multi-mode fiber. MMF distance supported depends on cabling type. Use OM3 50 ìm (2000 MHz*km) MMF to support the farthest distances.

IBM Ethernet Switch B24X (0563-012 / 0563-HC5) ships with the following:
  • One IBM Ethernet Switch B24X, which includes:
      • Twenty-four 10/1 GbE SFP+ ports plus four 10/100/1000 MbE RJ-45 ports
      • One out-of-band 10/100/1000 MbE RJ-45 management port
      • One DB9 male serial console port
      • One hot-swappable triple-fan tray
      • One (of two) 300 W AC hot-swappable power supply
  • One 1.5 m DB9 female-to-DB9 female straight-through serial console cable
  • Rack mount brackets for mounting into an EIA-310D compliant rack
  • IBM Ethernet Switch x-series Installation and User Guide
  • Statement of limited warranty
  • Brocade end user license agreement
  • Safety and regulatory notices
  • CD-ROM with manuals and environmental notices

Note: Qualified SFP+ or SFP transceivers are required for each SFP+ port and are not included.

Power cords are not included and must be specified at the time of order. The B24X has a C14 inlet to receive a C13 power plug. Table 2 lists the available power cable options.

Table 2. Power cord options

Description

Part number

Line cord – 2.8 m, 10A/230V, C13 to CEE7-VII (Europe)

39Y7917

Line cord – 2.8 m, 10A/250V, C13 to DK2-5a (Denmark)

39Y7918

Line cord – 2.8 m, 10A/250V, C13 to SEV 1011-S24507 (Swiss)

39Y7919

Line cord – 2.8 m, 10A/250V, C13 to SI 32 (Israel)

39Y7920

Line cord – 2.8 m, 10A/250V, C13 to SABS 164 (S. Africa)

39Y7922

Line cord – 2.8 m, 10A/250V, C13 to BS 1363/A (UK)

39Y7923

Line cord – 2.8 m, 10A/250V, C13 to AS/NZ 3112 (Australia/NZ)

39Y7924

Line cord – 2.8 m, 220-240V, C13 to KETI (S. Korea)

39Y7925

Line cord – 2.8 m, 10A/250V, C13 to (2P+Gnd) (India)

39Y7927

Line cord – 2.8 m, 220-240V, C13 to GB 2099.1 (China)

39Y7928

Line cord – 2.8m, 125V, C13 to NBR 6147 (Brazil)

39Y7929

Line cord – 2.8 m, 10A/250V, C13 to IRAM 2073 (Australia)

39Y7930

Line cord – 4.3 m, 10A/125V, C13 to NEMA 5-15P (US)

39Y7931

Line cord – 4.3 m, 10A/100-250V, C13 to IEC 320-C14

39Y7932

Line cord – 1.5 m, 10A/100-250V, C13 to IEC 320-C14

39Y7937

Each SFP+ optical transceiver, such as the 10GBASE-SR SFP+, requires fiber optic cabling with duplex LC connectors to connect to another optical transceiver. See the “Network cabling requirements” section for additional details.

Each 10/100/1000 MbE RJ-45 port or the 1 GbE copper SFP transceiver (1000BASE-T) requires copper CAT 5e or higher cabling for connectivity. Table 3 lists the available copper cable options.

Table 3. Ethernet copper cable (RJ-45) options
DescriptionIBM part number
0.6 m Ethernet cable (blue)40K5679
1.5 m Ethernet cable (blue)40K8785
3 m Ethernet cable (blue)40K5581
10 m Ethernet cable (blue)40K8927
25 m Ethernet cable (blue)40K8930

Additional options are available through IBM System Networking HVEC channels. Table 4 lists the orderable part numbers for these additional options.

Table 4. IBM part numbers and feature codes for ordering (System Networking HVEC)
DescriptionIBM part numberIBM feature code
10 GbE Direct Attach SFP+, 1 m, Active TwinAx copper cable45W23982711
10 GbE Direct Attach SFP+, 3 m, Active TwinAx copper cable45W24082731
10 GbE Direct Attach SFP+, 5 m, Active TwinAx copper cable45W30392751
1 GbE 100 m SFP, 1000BASE-T (RJ-45, connects to CAT5 or higher cabling)45W28132202
1 GbE 550 m SFP, 1000BASE-SX (duplex LC, MMF, 850 nm, OM)45W28152211
1 GbE 10 km SFP, 1000BASE-LX (duplex LC, SMF, 1310 nm, OM)45W28162212
1 GbE 70 km SFP, 1000BASE-LHA (duplex LC, SMF, 1550 nm, OM)45W28172213
10 GbE 10 km, SFP+, 10GBASE-LR (duplex LC, SMF, 1310 nm, OM) 45W4264 2131
Note: OM = Optical Monitoring supported. SMF = single-mode fiber. MMF = multi-mode fiber. MMF distance supported depends on cabling type. Use OM3 50 ìm (2000 MHz*km) MMF to support the farthest distances.

The B24X has twenty-four dual-speed 10/1 GbE SFP+ ports enabling customers to seamlessly transition their 1 GbE devices to 10 GbE speeds by upgrading the transceiver. Qualified SFP+ or SFP transceivers are required for each SFP+ port and are not included. Up to twenty-four 10 GbE SFP+ or 1 GbE SFP transceivers are supported on each IBM Ethernet Switch B24X.

10 GbE SFP+ optical –SR (10GBASE-SR) transceivers support distances up to 300 m, which is ideal for connectivity within a data center. 10 GbE SFP+ optical –LR (10GBASE-LR) transceivers support extended distances up to 10 km.


Figure 3. SFP+/SFP optical transceiver - Receives duplex LC connectors

For cost-effective server connectivity within a rack, 10 GbE copper direct attach SFP+ active TwinAx cables are available. These cables have two 10 GbE SFP+ transceivers attached on either end of the cable and have been tested for compatibility with the Brocade 10Gb CNA, QLogic 10Gb CNA, and Emulex 10Gb Virtual Fabric Adapter for IBM System x. Compatibility with other 10 GbE server adapters and network devices is up to the user to determine.


Figure 4. 10 GbE Direct Attach SFP+ TwinAx cable


Features and benefits

The features and benefits are:

  • Comprehensive standards support: Supporting a wide range of open IEEE and RFC standards, the B24X is fully interoperable with existing network environments. In addition, the B24X supports vendor-specific protocols such as Cisco Discovery Protocol (CDP), native support for Per-VLAN Rapid Spanning Tree Plus (PVRST+), and static trunks to EtherChannel for further supportability.
  • Built for the data center: The B24X features front-to-back airflow, allowing installation into racks with a hot-cold aisle design without the need for complicated air baffles. All ports are found on the front side of the switch for easy serviceability.
  • Flexible deployment: Dynamic Layer 3 routing allows the B24X to support multiple deployment options, including a Top of Rack access switch supporting inter-VLAN routing within a rack or a cost-effective aggregation switch.
  • High availability: Hot-swappable and redundant power supplies and fan trays reduce downtime and allow you to meet your service level agreements by increasing switch availability.
  • Best-in-class power efficiency: At only 176 W per twenty-four 10 GbE ports, the low power consumption reduces operational costs tied to power and cooling and allows data centers running out of power to deploy more assets.
  • High performance: Supporting full-line rate traffic on all ports with no over-subscription and 488 Gbps of internal forwarding performance, the B24X also uses an advanced cut-through forwarding architecture featuring low latencies to support time-sensitive applications such as real-time video and market trading/exchange applications.
  • Industry-standard CLI: Minimize re-training and personnel costs while increasing operational efficiencies by utilizing a management interface with which the network team is already familiar.
  • Mature operating system: The feature-rich and time-tested IronWare Operating System running on the B24X and all IBM b-type system networking devices provides a consistent experience across the network.
  • Upgrade without rip-and-replace: With dual-speed 10/1 GbE SFP+ ports plus four additional 1 GbE RJ-45 ports, the B24X supports a mix of 10 GbE and 1 GbE servers on the same switch without needing to force upgrades of existing systems.
  • Granular network visibility: Hardware-based sFlow v5 provides packet sampling for analysis, trending, and application of automated policies based on thresholds using industry applications such as Brocade Ironview Network Manager.
  • Cost competitive: The B24X includes all software capabilities and a 3-year warranty of the base product, simplifying ordering while being priced extremely competitively compared with other vendors.


Specifications

The IBM Ethernet Switch B24X supports the following specifications when running IronWare R04.2.x and higher. Be aware that Layer 3 capabilities are supported on IronWare R04.2.x and higher, and further details can be found by navigating the IBM Support website:

http://www.ibm.com/support/entry/portal/Overview/Hardware/Systems/System_x/Network_Solutions/0563
  • Form-factor
      • 1 RU; 43.5 cm (17.1 in.) width x 4.28 cm (1.7 in.) height x 39.4 cm (15.5 in.) depth
      • Rack-mount into 19” EIA-310D compliant rack, Telco rack, or table-top
  • Ports (data)
      • Twenty-four dual-speed 10/1 GbE SFP+ ports
      • Four 10/100/1000 MbE RJ-45 ports
  • Ports (management, out-of-band)
      • One10/100/1000 MbE RJ-45 port
      • One DB9 male serial console port
  • Power supplies, fans, and airflow
      • Two 300 W AC hot-swappable power supplies supported for 1+1 redundancy (base switch comes with one)
      • One hot-swappable fan tray with three 2+1 redundant fans
      • Front-to-back airflow supporting data center hot-cold aisle deployments
  • Performance
      • 488 Gbps line speed full-duplex throughput
      • 363 Mpps forwarding capacity
      • 1.5 micro-second latency
  • Jumbo frames
      • Supported: up to 9216-byte Ethernet frame sizes
  • Media (transceivers)
      • 10 GbE SFP+ -SR transceivers and direct attach copper TwinAx cables available
  • VLANs
      • Up to 4096 maximum VLANs
      • 802.1Q tagging
      • 802.1Q-in-Q tagging
      • Dual-mode VLANs (tagged and untagged traffic across same port)
      • Port-based VLANs
      • VLAN groups
      • Private VLANs
  • Link aggregation
      • Up to eight links per group, 28 link groups per switch
      • Static trunks compatible with Cisco EtherChannel
      • 802.3ad Link Aggregation Control Protocol (LACP) for dynamic trunk groups
  • Quality of service (QoS) and rate shaping
      • Eight queues per port with strict priority (SP), weighted round robin (WRR), and combined SP/WRR schedulers
      • 802.1p Class of Service (CoS)
      • IP DSCP/DiffServ (Type of Service) to priority mapping
      • ACL, port, and static MAC address to priority mapping
      • Layer 2 CoS and Layer 3 DSCP re-marking
      • Outbound rate shaping
  • Layer 2
      • Up to 32,000 MAC addresses.
      • Per-VLAN Rapid Spanning Tree Protocol Plus (PVST/PVST+/PVRST+) compatibility in default configuration supports smooth implementation into Cisco Layer 2 environments.
      • 802.1d Spanning tree Protocol (STP).
      • 802.1w Rapid Spanning Tree Protocol (RSTP).
      • 802.1s Multiple Spanning Tree Protocol (MSTP) enables multiple STP instances and forwarding paths for more efficient traffic distribution.
      • Virtual Switch Redundancy Protocol (VSRP) alternative to STP and includes sub-second convergence and Layer 2 redundancy based on the VRRPE protocol.
      • Metro Ring Protocol (MRP) v1/v2 enables fast, sub-second convergence in ring topologies. IGMPv1/v2/v3 Snooping and PIM-SM Snooping reduce multicast flooding in a Layer 2 network.
      • Root Guard prevents rogue devices from hijacking STP root.
      • BPDU Guard prevents rogue devices from participating in STP.
      • DHCP Assist helps DHCP servers respond correctly to devices in a different subnet than the DHCP server.
  • Layer 3
      • Up to 12,000 IPv4 routes
      • Routing Information Protocol (RIP) v1/v2
      • Open Shortest Path First (OSPF) v2
      • Internet Group Management Protocol (IGMP) v1/v2/v3
      • Protocol Independent Multicast Dense Mode (PIM-DM) v1/v2 and Sparse Mode (PIM-SM) v2
      • Equal Cost Multi Path (ECMP) for load balancing across up to eight paths
      • Virtual Router Redundancy Protocol (VRRP) and VRRP-E (Enhanced)
  • Security
      • 802.1x authentication, accounting, port security, and dynamic assignment for ACLs, MAC filtering, and VLANs
      • Up to 1,534 inbound, rule-based (hardware-based) access control list (ACL) entries
      • Standard ACLs based on source IP address
      • Extended ACLs based on source and destination IP addresses or IP protocol information
      • Authorization, Authentication, and Accounting (AAA) support on RADIUS, TACACS, and TACACS+
      • Multi-device authentication, which validates and applies security policies based on MAC address information from a RADIUS server
      • AES encryption for SSHv2
      • Denial of Service protection against Smurf (ICMP) and TCP SYN attacks in hardware
  • Management
      • Industry-standard CLI via Telnet and SSHv2
      • Fault management integration with IBM Systems Director v6.2
      • Network-wide management of all IBM b-type system networking switches using Brocade Ironview Network Manager (INM)
      • Simple Network Management Protocol (SNMP) v1/v2/v3
      • sFlow v5 for hardware-based packet sampling
          • Ties into industry tools such as Brocade INM and InMon products for trend analysis and automated policy application
      • Remote Monitoring (RMON) protocol
      • Link Layer Discovery Protocol (LLDP), Cisco Discovery Protocol (CDP), and Foundry Discovery Protocol (FDP)
      • Simple Network Time Protocol (SNTP)
      • Firmware image update via TFTP and SCP
  • Monitoring
      • Syslog support of up to six Syslog servers for centralized log collection and analysis.
      • Port mirroring of inbound and outbound traffic.
      • Digital optical monitoring monitors power levels and temperatures of optical transceivers and sends an alert if operating out of specification.
      • Temperature monitoring sends alerts if the temperature exceeds a certain threshold and shuts down the device after an extended period of time.
      • Port flap dampening increases network resiliency by limiting the number of port state transitions on an interface.
      • Link Fault Signaling (LFS) detects and reports fault conditions on 10 GbE ports.
      • Uni-Directional Link Detection (UDLD) monitors the link between two devices and brings the port down if the link goes down on either end.


Connectivity options

The B24X supports a wide variety of industry IEEE and RFC standards and should interoperate with any network device that supports industry standard Ethernet connectivity. This includes servers, other Ethernet switches, iSCSI Storage Area Network (SAN) arrays, Network-Attached Storage (NAS) arrays, and other network devices. Figure 5 shows the IBM Ethernet Switch B24X (front view with port labeling).


Figure 5. IBM Ethernet Switch B24X (front view with port labeling)

Table 5 lists the methods that the B24X can use to connect to another device.

Table 5. Connectivity options
On the B24XOn the device to be connected
SFP+ port using 10 GbE SFP+ optical transceiver: 69Y0389: 10GBASE-SR

This optical transceiver receives a duplex LC connector.
The optic on the device being connected can be another form-factor (that is, XFP transceiver, X2 module, or integrated into NIC), but must have a matching optical transmission type.

For example, a 10GBASE-SR XFP optical transceiver on the device being connected must match a 10GBASE-SR SFP+ optical transceiver on the B24X within the proper wavelength and power specifications.

Multi-mode or single-mode fiber as specified required for connectivity. See the "Network cabling requirements" section.
SFP+ port using 10 GbE Direct Attach SFP+ Active TwinAx cable:
  • 45W2398 or 45W2401: 1 meter
  • 45W2408 or 45W2409: 3 meter
  • 45W3039 or 45W3042: 5 meter

Direct Attach Cables (DACs) are copper cables with two SFP+ transceivers attached to either end of the cable.
It is up to the user to decide whether the interface on the device being connected supports the IBM DAC used with the B24X.

Below is a list of IBM server adapters that have been tested for compatibility with the part numbers in the left-hand column. If a product is not listed, that does not necessarily mean that it is incompatible--it simply has not been tested.

IBM server adapters:
  • 42C1820: Brocade 10Gb Converged Network Adapter for IBM System x
  • 49Y4250: Emulex 10Gb Virtual Fabric Adapter for IBM System x
  • 42C1800: QLogic 10 Gb CNA for IBM System x
10/100/1000 MbE RJ-45 port: Auto-sensing, auto-negotiating, auto-MDI/MDIX.Connect to any RJ-45 port or TX adapter supporting 10, 100, or 1000 Mbps Ethernet over CAT5 or higher cabling up to 100 meters.


Connectivity to IBM System servers

The B24X can be deployed as a Top of Rack access switch to provide connectivity to servers within a rack. This includes servers from IBM System x, System p, and System i.
IBM System x servers typically come with on-board 1 Gbps Ethernet RJ-45 ports. Additional 1 GbE NICs can be installed to increase connectivity. These NICs might have RJ-45 ports, SFP ports requiring a transceiver, or integrated optical transceivers. Follow the guidelines in Table 5 for connectivity.

10 Gbps Ethernet connectivity is not standard in most System x servers, and a 10 GbE NIC or 10 GbE CNA must be installed. Only the IBM System x3850/3950 X5 series (except for the ARx model) come standard with a customized Emulex Virtual Fabric Adapter. Table 6 lists the 10 GbE adapters that are available for IBM System x servers.

Table 6. 10 Gbps adapters for IBM System x servers
System x rack and tower
server adapter models
x3200 M3x3250 M3x3400 M2x3400 M3x3500 M2x3500 M3x3550 M3x3550 M3x3620 M3x3650 M2x3650 M3
    x3850/3950 M2
x3850/3950 X5
Brocade 10Gb CNA (42C1820)N0.226NYNYNYYYYNYYYYYY
QLogic 10Gb CNA (42C1800)YYYNYNYYYYNYYYYYY
Emulex Virtual Fabric Adapter (49Y4250)YYYYYYYYYYYYYYYYY
NetXtreme II 10 GigE Express Fiber SR Adapter (42C1790)NNYYYYYYYYYYYYYYY
    The Brocade 10Gb CNA [42C1820], QLogic 10Gb CNA [42C1800], and Emulex Virtual Fabric Adapter [49Y4250] each have two SFP+ ports and can be connected to the B24X using:
    • The adapter’s supported 10GBASE-SR SFP+ transceiver connected to the B24X 10GBASE-SR SFP+ transceiver [69Y0389] over multi-mode fiber cable.
    • The Direct Attach SFP+ Active TwinAx copper cables listed in Table 4.

    The NetXtreme II 10 GigE Express Fiber SR Adapter (42C1790) has a single integrated 10GBASE-SR optic. This port can be connected to the B24X 10GBASE-SR SFP+ transceiver [69Y0389] over a multi-mode fiber cable.


    Connectivity to IBM BladeCenter

    The B24X can be deployed as an aggregation switch to provide connectivity between down-stream switches. This includes IBM System Networking switches, BladeCenter Ethernet embedded switches, and Ethernet switches from other vendors

    IBM BladeCenter Ethernet Switch Modules are available with 1 Gbps and 10 Gbps Ethernet uplinks. Table 7 lists the various IBM BladeCenter Ethernet Switch Modules that can be used to connect to the B24X.

    Table 7. IBM BladeCenter Ethernet Switch Modules (ESM)
    BladeCenter Ethernet Switch Module models
    Part #
    Ext. 1 GbE ports
    Ext. 10 GbE ports
    BC H
    BC HT
    BC E
    BC T
    BC S
    BNT Virtual Fabric 10Gb ESM
    46C7191
    10 dual-speed SFP+
    Y
    Y
    N
    N
    N
    Cisco Nexus 4001I ESM
    46M6071
    6 dual-speed SFP+
    Y
    Y
    N
    N
    N
    Cisco Catalyst 3110X ESM
    41Y8522
    0
    1 X21
    Y
    Y
    Y
    Y
    N
    10Gb Ethernet Pass-Thru Module
    46M6181
    0
    14 SFP+
    Y
    Y
    N
    N
    N
    BNT 1/10Gb Uplink ESM
    44W4404
    6 RJ-45
    3 SFP+
    Y
    Y
    Y
    Y
    Y
    BNT Layer 2/3 Copper ESM
    32R1860
    6 RJ-45
    0
    Y
    Y
    Y
    Y
    Y
    BNT Layer 2/3 Fiber ESM
    32R1861
    6 SFP
    0
    Y
    Y
    Y
    Y
    Y
    BNT Layer 2-7 Gigabit ESM
    32R1859
    4 RJ-45
    0
    Y
    Y
    Y
    Y
    Y
    Cisco Catalyst 3012 ESM
    43W4395
    4 RJ-45
    0
    Y
    Y
    Y
    Y
    Y
    Cisco Catalyst 3110G ESM
    41Y8523
    4 RJ-45
    0
    Y
    Y
    Y
    Y
    N
    Server Connectivity Module
    39Y9324
    6 RJ-45
    0
    Y
    Y
    Y
    Y
    Y
    Intelligent Copper Pass-Thru Module
    44W4483
    14 RJ-45
    0
    Y
    Y
    Y
    Y
    Y
    Note 1: X2 modules have duplex SC connectors. An SC-to-LC fiber cable is required to connect to a SFP+ transceiver with duplex LC connectors.

    For Ethernet Switch Modules with SFP+ or X2 ports see the respective IBM Redbooks at-a-glance guide to locate transceivers supported. Review Table 5 for guidance on how to connect the Ethernet Switch Module to the B24X.


    Popular configurations

    This section illustrates how the IBM Ethernet Switch B24X can be used in various configurations.


    Top of Rack switch

    An access or edge switch is a switch that connects directly to the end devices requiring network connectivity, most commonly servers and storage arrays in the data center. A switch that is 1 or 2 RU in height that acts as the access switch for devices within a rack is commonly called a Top of Rack switch.

    The B24X is ideal for deployment as an all-purpose Top of Rack switch in demanding network environments due to its high-performance, resilient hardware characteristics and comprehensive network features support. The B24X can also be used to support NAS or iSCSI SAN storage in a shared or dedicated network environment (Figure 6).

    IBM Ethernet Switch B24X as Top of Rack switch with server and storage connections
    Figure 6. IBM Ethernet Switch B24X as Top of Rack switch with server and storage connections

    Table 8 outlines the components used in Figure 6.

    Table 8. Components used in reference to Figure 6
    Diagram referencePart number/ machine typeDescriptionQuantity
    1
    0563-012
    IBM Ethernet Switch B24X
    2
    2
    Varies
    IBM System x server with 10 GbE NIC/CNAs
    • See Table 5 for additional details.
    • Other vendor servers can be used.
    16
    3
    Varies
    NAS array
    Varies
    4
    Varies
    Existing network infrastructure, which can include IBM Systems Networking devices and other standards-compliant Ethernet/IP switches and routers
    -
    5
    0563-012
    IBM Ethernet Switch B24X
    2
    6
    Varies
    iSCSI SAN array
    Varies

    Solution details are:
    • Forty-one rack units (with two RU servers)
    • 1:1 subscription ratio within rack
    • 2.43:1 over-subscription ratio to rest of network
    • Connectivity to NAS or iSCSI SAN (or both) for mid-range scalable storage

    In the solution shown in Figure 6 we have two IBM Ethernet Switch B24Xs providing connectivity to all devices within a single rack. Within the rack we have a mix of servers with 10 GbE connections to each B24X for redundancy. The B24X can also be used to connect to NAS arrays for scale-out file sharing and also to a separate iSCSI SAN for dedicated storage access as bandwidth and security needs require.


    Network device connections

    Figure 7 shows an example of the types of options that can be used to connect separate devices to the IBM Ethernet Switch B24X

    Figure 7. IBM Ethernet Switch B24X device connections

    Table 9 outlines the components used in Figure 7.

    Table 9. Components used in reference to Figure 7

    Diagram reference
    Part number/
    machine type
    Description
    Quantity
    1
    0563-012
    IBM Ethernet Switch B24X
    2
    2
    Varies
    IBM x3850/x3960 X5 (except ARx model)
    • Comes with 2-port 10 GbE (SFP+) Emulex Virtual Fabric Adapter.
    • Use a single Direct Attach cable (TwinAx) to connect to B24X, available in 1, 3, or 5 meters. (See Table 4.)
    -
    3
    Varies
    NAS or iSCSI storage array
    Varies
    4
    41Y8522
    Cisco Catalyst 3110X Ethernet Switch Module
    • On 3110X, use X2-10GB-SR= (10GBASE-SR X2 module).
    • On B24X, use 69Y0389 (10GBASE-SR SFP+).
    • Connect over multi-mode fiber. (Note: The X2 module has a SC connector, whereas the SFP+ has a LC connector.)
    2
    5
    46C7191
    BNT Virtual Fabric 10Gb Ethernet Switch Module
    • On BNT ESM, use 44W4408 (10GBASE-SR SFP+).
    • On B24X, use 69Y0389 (10GBASE-SR SFP+).
    • Connect over multi-mode fiber.
    2
    6
    Varies
    IBM System x server
    • On System x server with Brocade 10Gb CNA [42C1820], QLogic 10Gb CNA [42C1800], or Emulex Virtual Fabric Adapter [49Y4250], connect using a single Direct Attach cable (TwinAx), available in 1, 3, or 5 meters. (See Table 4.)
    • On System x server with NetXtreme II 10 GigE Express Fiber SR Adapter (42C1790), use 69Y0389 (10GBASE-SR SFP+) on B24X and connect over multi-mode fiber.
    • See Table 6 for server adapter details.
    -
    7
    Varies
    Other servers
    • If 10GBASE-SR, connect to B24X using 69Y0389 (10GBASE-SR SFP+) over multi-mode fiber.
    • If 1 GbE, most 1 GbE NICs are RJ-45. Connect to one of the B24X’s four RJ-45 ports over CAT5 cable.
    -


    Interoperating in existing network environments

    The IBM Ethernet Switch B24X interoperates seamlessly in existing network environments utilizing standards-based protocols. IBM Ethernet Switch B24X leverages the proven IronWare Operating System with an industry-standard CLI so network administrators can utilize their existing skill sets.

    Figure 8 shows an example of the B24X used as an access and aggregation switch.


    Figure 8. IBM Ethernet Switch B24X connecting to the network infrastructure

    Table 10 outlines the components used in Figure 8.

    Table 10. The components used in Figure 8
    Diagram Reference
    Part number/
    machine type
    Description
    Quantity
    1
    0563-012
    IBM Ethernet Switch B24X
    1
    2
    4003-M16
    IBM Ethernet Switch B16M
    • On B16M, use FC1711 (4-port 10 GbE XFP module) and FC2110 (10GBASE-SR XFP).
    • On B24X, use 69Y0389 (10GBASE-SR SFP+).
    • Connect over multi-mode fiber.
    1
    3
    N/A
    Cisco Catalyst 6509-E
    • On 6509, use 8-port 10 GbE Fiber module with X2-10GB-SR (10GBASE-SR X2 module).
    • Connect over multi-mode fiber. (Note: The X2 module has a SC connector, whereas the SFP+ has a LC connector.)
    1
    4
    0563-HCF
    IBM Ethernet Switch B48Y (Data Center model)
    • On B48Y, use 81Y1455 (4-port 10 GbE SFP+ module).
    • Use a single Direct Attach cable (TwinAx) to connect to B24X, available in 1, 3, or 5 meters if length permits.
    • Otherwise, on B24X use 69Y0389 (10GBASE-SR SFP+) and connect over multi-mode fiber.
    1
    5
    N/A
    Cisco Catalyst Nexus 4948-10GE
    • On the Catalyst use the 10GBASE-SR X2 module.
    • On B24X, use 69Y0389 (10GBASE-SR SFP+).
    • Connect over multi-mode fiber
    1


    Power supplies and fans

    The IBM Ethernet Switch B24X comes with one 300 W AC power supply and supports a second power supply for 1+1 redundancy. The power supplies are hot-swappable, auto-sensing, auto-switching, and load sharing, with a universal input (90 VAC to 264 VAC). The power supply has an IEC-C14 inlet that connects to a C13 power connector. Power cords are not included with the switch and must be provided separately.

    The IBM Ethernet Switch B24X also comes with a single fan tray consisting of three variable-speed fans. If one fan within the fan tray fails it does not affect the operation of the other fans in the unit. The fan tray is hot-swappable, increasing device availability and serviceability.


    Figure 9. IBM Ethernet Switch B24X rear view (fans and power supply)

    The airflow of the switch is primarily port/side (front) to non-port (back) side. Air is drawn into the system from vents on the front and front sides of the switch and expelled out the rear. The cooling characteristics of the system allow it to be deployed in server racks featuring hot-cold aisle containment without the need of special baffling.

    IBM Ethernet Switch B24X airflow
    Figure 10. IBM Ethernet Switch B24X airflow


    Installation

    The IBM Ethernet Switch B24X comes with two rack-mount brackets affixed to each side for installation into an EIA-310D compliant rack. Screws for mounting the B24X to the rack are not included with the switch. Allow at least 3 inches of space at the front, back, and sides of the device for proper cabling and cooling

    IBM Ethernet Switch B24X rack mount kit
    Figure 11. IBM Ethernet Switch B24X rack mount kit


    Network cabling requirements

    The network cables required for the IBM Ethernet Switch B24X are:
    • 10GBASE-SR SFP+ transceiver [69Y0389]
        • 840 to 860 nm wavelength using multi-mode fiber cable, LC duplex connector. Operating distance supported depends on the multi-mode fiber cable used. See Table 11.
    • 1000BASE-T (built-in 10/100/1000 MbE RJ-45 ports) and 1000BASE-TX SFP transceiver: up to 100 m over UTP Category 5e or higher cabling, RJ-45 connector.
    • DB9 male serial console port: DB9 female-to-DB9 female straight-through serial console cable that comes with the switch.

    Table 11. Multi-mode fiber cable distances supported
    Multi-mode fiber cable
    Distance
    Loss
    62.5 ìm (160 MHz*km)
    26 m
    1.6 dBm
    62.5 ìm (200 MHz*km)
    33 m
    1.6 dBm
    50 ìm (400 MHz*km)
    66 m
    1.7 dBm
    50 ìm (500 MHz*km)
    82 m
    1.8 dBm
    50 ìm (2000 MHz*km)
    300 m
    2.6 dBm


    Related links

    For more information, see the following resources:
    · http://www.redbooks.ibm.com/abstracts/sg247785.html?Open

    Others who read this publication also read



    Special Notices

    This material has not been submitted to any formal IBM test and is published AS IS. It has not been the subject of rigorous review. IBM assumes no responsibility for its accuracy or completeness. The use of this information or the implementation of any of these techniques is a client responsibility and depends upon the client's ability to evaluate and integrate them into the client's operational environment.

    Follow IBM Redbooks

    Follow IBM Redbooks