Английская Википедия:100 Gigabit Ethernet

Материал из Онлайн справочника
Перейти к навигацииПерейти к поиску

Шаблон:Short description 40 Gigabit Ethernet (40GbE) and 100 Gigabit Ethernet (100GbE) are groups of computer networking technologies for transmitting Ethernet frames at rates of 40 and 100 gigabits per second (Gbit/s), respectively. These technologies offer significantly higher speeds than 10 Gigabit Ethernet. The technology was first defined by the IEEE 802.3ba-2010 standard[1] and later by the 802.3bg-2011, 802.3bj-2014,[2] 802.3bm-2015,[3] and 802.3cd-2018 standards. The first succeeding Terabit Ethernet specifications were approved in 2017.[4]

The standards define numerous port types with different optical and electrical interfaces and different numbers of optical fiber strands per port. Short distances (e.g. 7 m) over twinaxial cable are supported while standards for fiber reach up to 80 km.

Шаблон:TOC limit

Standards development

On July 18, 2006, a call for interest for a High Speed Study Group (HSSG) to investigate new standards for high speed Ethernet was held at the IEEE 802.3 plenary meeting in San Diego.[5]

The first 802.3 HSSG study group meeting was held in September 2006.[6] In June 2007, a trade group called "Road to 100G" was formed after the NXTcomm trade show in Chicago.[7]

On December 5, 2007, the Project Authorization Request (PAR) for the P802.3ba 40 Gbit/s and 100 Gbit/s Ethernet Task Force was approved with the following project scope:[8]

The purpose of this project is to extend the 802.3 protocol to operating speeds of 40 Gbit/s and 100 Gbit/s in order to provide a significant increase in bandwidth while maintaining maximum compatibility with the installed base of 802.3 interfaces, previous investment in research and development, and principles of network operation and management. The project is to provide for the interconnection of equipment satisfying the distance requirements of the intended applications.

The 802.3ba task force met for the first time in January 2008.[9] This standard was approved at the June 2010 IEEE Standards Board meeting under the name IEEE Std 802.3ba-2010.[10]

The first 40 Gbit/s Ethernet Single-mode Fibre PMD study group meeting was held in January 2010 and on March 25, 2010, the P802.3bg Single-mode Fibre PMD Task Force was approved for the 40 Gbit/s serial SMF PMD.

The scope of this project is to add a single-mode fiber Physical Medium Dependent (PMD) option for serial 40 Gbit/s operation by specifying additions to, and appropriate modifications of, IEEE Std 802.3-2008 as amended by the IEEE P802.3ba project (and any other approved amendment or corrigendum).

On June 17, 2010, the IEEE 802.3ba standard was approved.[1][11] In March 2011, the IEEE 802.3bg standard was approved.[12] On September 10, 2011, the P802.3bj 100 Gbit/s Backplane and Copper Cable task force was approved.[2]

The scope of this project is to specify additions to and appropriate modifications of IEEE Std 802.3 to add 100 Gbit/s 4-lane Physical Layer (PHY) specifications and management parameters for operation on backplanes and twinaxial copper cables, and specify optional Energy Efficient Ethernet (EEE) for 40 Gbit/s and 100 Gbit/s operation over backplanes and copper cables.

On May 10, 2013, the P802.3bm 40 Gbit/s and 100 Gbit/s Fiber Optic Task Force was approved.[3]

This project is to specify additions to and appropriate modifications of IEEE Std 802.3 to add 100 Gbit/s Physical Layer (PHY) specifications and management parameters, using a four-lane electrical interface for operation on multimode and single-mode fiber optic cables, and to specify optional Energy Efficient Ethernet (EEE) for 40 Gbit/s and 100 Gbit/s operation over fiber optic cables. In addition, to add 40 Gbit/s Physical Layer (PHY) specifications and management parameters for operation on extended reach (>10 km) single-mode fiber optic cables.

Also on May 10, 2013, the P802.3bq 40GBASE-T Task Force was approved.[13]

Specify a Physical Layer (PHY) for operation at 40 Gbit/s on balanced twisted-pair copper cabling, using existing Media Access Control, and with extensions to the appropriate physical layer management parameters.

On June 12, 2014, the IEEE 802.3bj standard was approved.[2]

On February 16, 2015, the IEEE 802.3bm standard was approved.[14]

On May 12, 2016, the IEEE P802.3cd Task Force started working to define next generation two-lane 100 Gbit/s PHY.[15]

On May 14, 2018, the PAR for the IEEE P802.3ck Task Force was approved. The scope of this project is to specify additions to and appropriate modifications of IEEE Std 802.3 to add Physical Layer specifications and Management Parameters for 100 Gbit/s, 200 Gbit/s, and 400 Gbit/s electrical interfaces based on 100 Gbit/s signaling.[16]

On December 5, 2018, the IEEE-SA Board approved the IEEE 802.3cd standard.

On November 12, 2018, the IEEE P802.3ct Task Force started working to define PHY supporting 100 Gbit/s operation on a single wavelength capable of at least 80 km over a DWDM system (using a combination of phase and amplitude modulation with coherent detection).[17]

In May 2019, the IEEE P802.3cu Task Force started working to define single-wavelength 100 Gbit/s PHYs for operation over SMF (Single-Mode Fiber) with lengths up to at least 2 km (100GBASE-FR1) and 10 km (100GBASE-LR1).[18]

In June 2020, the IEEE P802.3db Task Force started working to define a physical layer specification that supports 100 Gbit/s operation over 1 pair of MMF with lengths up to at least 50 m.[19]

On February 11, 2021, the IEEE-SA Board approved the IEEE 802.3cu standard.[20]

On June 16, 2021, the IEEE-SA Board approved the IEEE 802.3ct standard.[21]

On September 21, 2022, the IEEE-SA Board approved the IEEE 802.3ck and 802.3db standards.[22]

Early products

Optical signal transmission over a nonlinear medium is principally an analog design problem. As such, it has evolved slower than digital circuit lithography (which generally progressed in step with Moore's law). This explains why 10 Gbit/s transport systems existed since the mid-1990s, while the first forays into 100 Gbit/s transmission happened about 15 years later – a 10x speed increase over 15 years is far slower than the 2x speed per 1.5 years typically cited for Moore's law.

Nevertheless, at least five firms (Ciena, Alcatel-Lucent, MRV, ADVA Optical and Huawei) made customer announcements for 100 Gbit/s transport systems by August 2011, with varying degrees of capabilities.[23] Although vendors claimed that 100 Gbit/s light paths could use existing analog optical infrastructure, deployment of high-speed technology was tightly controlled and extensive interoperability tests were required before moving them into service.

Designing routers or switches which support 100 Gbit/s interfaces is difficult. The need to process a 100 Gbit/s stream of packets at line rate without reordering within IP/MPLS microflows is one reason for this.

Шаблон:As of, most components in the 100 Gbit/s packet processing path (PHY chips, NPUs, memories) were not readily available off-the-shelf or require extensive qualification and co-design. Another problem is related to the low-output production of 100 Gbit/s optical components, which were also not easily availableШаблон:Sndespecially in pluggable, long-reach or tunable laser flavors.

Backplane

NetLogic Microsystems announced backplane modules in October 2010.[24]

Multimode fiber

In 2009, Mellanox[25] and Reflex Photonics[26] announced modules based on the CFP agreement.

Single mode fiber

Finisar,[27] Sumitomo Electric Industries,[28] and OpNext[29] all demonstrated singlemode 40 or 100 Gbit/s Ethernet modules based on the C form-factor pluggable (CFP) agreement at the European Conference and Exhibition on Optical Communication in 2009.

Compatibility

Optical fiber IEEE 802.3ba implementations were not compatible with the numerous 40 and 100 Gbit/s line rate transport systems because they had different optical layer and modulation formats as the IEEE 802.3ba interface types show. In particular, existing 40 Gbit/s transport solutions that used dense wavelength-division multiplexing to pack four 10 Gbit/s signals into one optical medium were not compatible with the IEEE 802.3ba standard, which used either coarse WDM in 1310 nm wavelength region with four 25 Gbit/s or ten 10 Gbit/s channels, or parallel optics with four or ten optical fibers per direction.

Test and measurement

  • Quellan announced a test board in 2009.[30]
  • Ixia developed Physical Coding Sublayer Lanes[31] and demonstrated a working 100GbE link through a test setup at NXTcomm in June 2008.[32] Ixia announced test equipment in November 2008.[33][34]
  • Discovery Semiconductors introduced optoelectronics converters for 100 Gbit/s testing of the 10 km and 40 km Ethernet standards in February 2009.[35]
  • JDS Uniphase (now VIAVI Solutions) introduced test and measurement products for 40 and 100 Gbit/s Ethernet in August 2009.[36]
  • Spirent Communications introduced test and measurement products in September 2009.[37]
  • EXFO demonstrated interoperability in January 2010.[38]
  • Xena Networks demonstrated test equipment at the Technical University of Denmark in January 2011.[39][40]
  • Calnex Solutions introduced 100GbE Synchronous Ethernet synchronisation test equipment in November 2014.[41]
  • Spirent Communications introduced the Attero-100G for 100GbE and 40GbE impairment emulation in April 2015.[42][43]
  • VeEX[44] introduced its CFP-based UX400-100GE and 40GE test and measurement platform in 2012,[45] followed by CFP2, CFP4, QSFP28 and QSFP+ versions in 2015.[46][47]

Mellanox Technologies

Mellanox Technologies introduced the ConnectX-4 100GbE single and dual port adapter in November 2014.[48] In the same period, Mellanox introduced availability of 100GbE copper and fiber cables.[49] In June 2015, Mellanox introduced the Spectrum 10, 25, 40, 50 and 100GbE switch models.[50]

Aitia

Aitia International introduced the C-GEP FPGA-based switching platform in February 2013.[51] Aitia also produce 100G/40G Ethernet PCS/PMA+MAC IP cores for FPGA developers and academic researchers.[52]

Arista

Arista Networks introduced the 7500E switch (with up to 96 100GbE ports) in April 2013.[53] In July 2014, Arista introduced the 7280E switch (the world's first top-of-rack switch with 100G uplink ports).[54]

Extreme Networks

Extreme Networks introduced a four-port 100GbE module for the BlackDiamond X8 core switch in November 2012.[55]

Dell

Dell's Force10 switches support 40 Gbit/s interfaces. These 40 Gbit/s fiber-optical interfaces using QSFP+ transceivers can be found on the Z9000 distributed core switches, S4810 and S4820[56] as well as the blade-switches MXL and the IO-Aggregator. The Dell PowerConnect 8100 series switches also offer 40 Gbit/s QSFP+ interfaces.[57]

Chelsio

Chelsio Communications introduced 40 Gbit/s Ethernet network adapters (based on the fifth generation of its Terminator architecture) in June 2013.[58]

Telesoft Technologies Ltd

Telesoft Technologies announced the dual 100G PCIe accelerator card, part of the MPAC-IP series.[59] Telesoft also announced the STR 400G (Segmented Traffic Router)[60] and the 100G MCE (Media Converter and Extension).[61]

Commercial trials and deployments

Unlike the "race to 10 Gbit/s" that was driven by the imminent need to address growth pains of the Internet in the late 1990s, customer interest in 100 Gbit/s technologies was mostly driven by economic factors. The common reasons to adopt the higher speeds were:[62]

  • to reduce the number of optical wavelengths ("lambdas") used and the need to light new fiber
  • to utilize bandwidth more efficiently than 10 Gbit/s link aggregate groups
  • to provide cheaper wholesale, internet peering and data center connectivity
  • to skip the relatively expensive 40 Gbit/s technology and move directly from 10 to 100 Gbit/s

Alcatel-Lucent

In November 2007, Alcatel-Lucent held the first field trial of 100 Gbit/s optical transmission. Completed over a live, in-service 504 kilometre portion of the Verizon network, it connected the Florida cities of Tampa and Miami.[63]

100GbE interfaces for the 7450 ESS/7750 SR service routing platform were first announced in June 2009, with field trials with Verizon,[64] T-Systems and Portugal Telecom taking place in June–September 2010. In September 2009, Alcatel-Lucent combined the 100G capabilities of its IP routing and optical transport portfolio in an integrated solution called Converged Backbone Transformation.[65]

In June 2011, Alcatel-Lucent introduced a packet processing architecture known as FP3, advertised for 400 Gbit/s rates.[66] Alcatel-Lucent announced the XRS 7950 core router (based on the FP3) in May 2012.[67][68]

Brocade

Brocade Communications Systems introduced their first 100GbE products (based on the former Foundry Networks MLXe hardware) in September 2010.[69] In June 2011, the new product went live at the AMS-IX traffic exchange point in Amsterdam.[70]

Cisco

Cisco Systems and Comcast announced their 100GbE trials in June 2008.[71] However, it is doubtful that this transmission could approach 100 Gbit/s speeds when using a 40 Gbit/s per slot CRS-1 platform for packet processing. Cisco's first deployment of 100GbE at AT&T and Comcast took place in April 2011.[72] In the same year, Cisco tested the 100GbE interface between CRS-3 and a new generation of their ASR9K edge router model.[73] In 2017, Cisco announced a 32 port 100GbE Cisco Catalyst 9500 Series switch [74] and in 2019 the modular Catalyst 9600 Series switch with a 100GbE line card [75]

Huawei

In October 2008, Huawei presented their first 100GbE interface for their NE5000e router.[76] In September 2009, Huawei also demonstrated an end-to-end 100 Gbit/s link.[77] It was mentioned that Huawei's products had the self-developed NPU "Solar 2.0 PFE2A" onboard and was using pluggable optics in CFP.

In a mid-2010 product brief, the NE5000e linecards were given the commercial name LPUF-100 and credited with using two Solar-2.0 NPUs per 100GbE port in opposite (ingress/egress) configuration.[78] Nevertheless, in October 2010, the company referenced shipments of NE5000e to Russian cell operator "Megafon" as "40GBPS/slot" solution, with "scalability up to" 100 Gbit/s.[79]

In April 2011, Huawei announced that the NE5000e was updated to carry 2x100GbE interfaces per slot using LPU-200 linecards.[80] In a related solution brief, Huawei reported 120 thousand Solar 1.0 integrated circuits shipped to customers, but no Solar 2.0 numbers were given.[81] Following the August 2011 trial in Russia, Huawei reported paying 100 Gbit/s DWDM customers, but no 100GbE shipments on NE5000e.[82]

Juniper

Juniper Networks announced 100GbE for its T-series routers in June 2009.[83] The 1x100GbE option followed in Nov 2010, when a joint press release with academic backbone network Internet2 marked the first production 100GbE interfaces going live in real network.[84]

In the same year, Juniper demonstrated 100GbE operation between core (T-series) and edge (MX 3D) routers.[85] Juniper, in March 2011, announced first shipments of 100GbE interfaces to a major North American service provider (Verizon[86]).

In April 2011, Juniper deployed a 100GbE system on the UK education network JANET.[87] In July 2011, Juniper announced 100GbE with Australian ISP iiNet on their T1600 routing platform.[88] Juniper started shipping the MPC3E line card for the MX router, a 100GbE CFP MIC, and a 100GbE LR4 CFP optics in March 2012Шаблон:Citation needed. In Spring 2013, Juniper Networks announced the availability of the MPC4E line card for the MX router that includes 2 100GbE CFP slots and 8 10GbE SFP+ interfacesШаблон:Citation needed.

In June 2015, Juniper Networks announced the availability of its CFP-100GBASE-ZR module which is a plug & play solution that brings 80 km 100GbE to MX & PTX based networks.[89] The CFP-100GBASE-ZR module uses DP-QPSK modulation and coherent receiver technology with an optimized DSP and FEC implementation. The low-power module can be directly retrofitted into existing CFP sockets on MX and PTX routers.

Standards

The IEEE 802.3 working group is concerned with the maintenance and extension of the Ethernet data communications standard. Additions to the 802.3 standard[90] are performed by task forces which are designated by one or two letters. For example, the 802.3z task force drafted the original Gigabit Ethernet standard.

802.3ba is the designation given to the higher speed Ethernet task force which completed its work to modify the 802.3 standard to support speeds higher than 10 Gbit/s in 2010.

The speeds chosen by 802.3ba were 40 and 100 Gbit/s to support both end-point and link aggregation needs respectively. This was the first time two different Ethernet speeds were specified in a single standard. The decision to include both speeds came from pressure to support the 40 Gbit/s rate for local server applications and the 100 Gbit/s rate for internet backbones. The standard was announced in July 2007[91] and was ratified on June 17, 2010.[10]

Файл:QSFP-40G-SR4 Transceiver.jpg
A 40G-SR4 transceiver in the QSFP form factor

The 40/100 Gigabit Ethernet standards encompass a number of different Ethernet physical layer (PHY) specifications. A networking device may support different PHY types by means of pluggable modules. Optical modules are not standardized by any official standards body but are in multi-source agreements (MSAs). One agreement that supports 40 and 100 Gigabit Ethernet is the CFP MSA[92] which was adopted for distances of 100+ meters. QSFP and CXP connector modules support shorter distances.[93]

The standard supports only full-duplex operation.[94] Other objectives include:

  • Preserve the 802.3 Ethernet frame format utilizing the 802.3 MAC
  • Preserve minimum and maximum frame size of current 802.3 standard
  • Support a bit error rate (BER) better than or equal to 10−12 at the MAC/PLS service interface
  • Provide appropriate support for OTN
  • Support MAC data rates of 40 and 100 Gbit/s
  • Provide physical layer specifications (PHY) for operation over single-mode optical fiber (SMF), laser optimized multi-mode optical fiber (MMF) OM3 and OM4, copper cable assembly, and backplane.

The following nomenclature is used for the physical layers:[2][3][95]

Physical layer 40 Gigabit Ethernet 100 Gigabit Ethernet
Backplane Шаблон:N/a 100GBASE-KP4
Improved Backplane 40GBASE-KR4 100GBASE-KR4
100GBASE-KR2
7 m over twinax copper cable 40GBASE-CR4 100GBASE-CR10
100GBASE-CR4
100GBASE-CR2
30 m over Category 8 twisted pair 40GBASE-T Шаблон:N/a
100 m over OM3 MMF 40GBASE-SR4 100GBASE-SR10
100GBASE-SR4
100GBASE-SR2
125 m over OM4 MMF[93]
500 m over SMF, serial Шаблон:N/a 100GBASE-DR
2 km over SMF, serial 40GBASE-FR 100GBASE-FR1
10 km over SMF 40GBASE-LR4 100GBASE-LR4
100GBASE-LR1
40 km over SMF Шаблон:Vanchor Шаблон:Vanchor
80 km over SMF Шаблон:N/a 100GBASE-ZR

The 100 m laser-optimized multi-mode fiber (OM3) objective was met by parallel ribbon cable with 850 nm wavelength 10GBASE-SR like optics (40GBASE-SR4 and 100GBASE-SR10). The backplane objective with 4 lanes of 10GBASE-KR type PHYs (40GBASE-KR4). The copper cable objective is met with 4 or 10 differential lanes using SFF-8642 and SFF-8436 connectors. The 10 and 40 km 100 Gbit/s objectives with four wavelengths (around 1310 nm) of 25 Gbit/s optics (100GBASE-LR4 and 100GBASE-ER4) and the 10 km 40 Gbit/s objective with four wavelengths (around 1310 nm) of 10 Gbit/s optics (40GBASE-LR4).[96]

In January 2010 another IEEE project authorization started a task force to define a 40 Gbit/s serial single-mode optical fiber standard (40GBASE-FR). This was approved as standard 802.3bg in March 2011.[12] It used 1550 nm optics, had a reach of 2 km and was capable of receiving 1550 nm and 1310 nm wavelengths of light. The capability to receive 1310 nm light allows it to inter-operate with a longer reach 1310 nm PHY should one ever be developed. 1550 nm was chosen as the wavelength for 802.3bg transmission to make it compatible with existing test equipment and infrastructure.[97]

In December 2010, a 10x10 multi-source agreement (10x10 MSA) began to define an optical Physical Medium Dependent (PMD) sublayer and establish compatible sources of low-cost, low-power, pluggable optical transceivers based on 10 optical lanes at 10 Gbit/s each.[98] The 10x10 MSA was intended as a lower cost alternative to 100GBASE-LR4 for applications which do not require a link length longer than 2 km. It was intended for use with standard single mode G.652.C/D type low water peak cable with ten wavelengths ranging from 1523 to 1595 nm. The founding members were Google, Brocade Communications, JDSU and Santur.[99] Other member companies of the 10x10 MSA included MRV, Enablence, Cyoptics, AFOP, oplink, Hitachi Cable America, AMS-IX, EXFO, Huawei, Kotura, Facebook and Effdon when the 2 km specification was announced in March 2011.[100] The 10X10 MSA modules were intended to be the same size as the CFP specifications.

On June 12, 2014, the 802.3bj standard was approved. The 802.3bj standard specifies 100 Gbit/s 4x25G PHYs - 100GBASE-KR4, 100GBASE-KP4 and 100GBASE-CR4 - for backplane and twin-ax cable.

On February 16, 2015, the 802.3bm standard was approved. The 802.3bm standard specifies a lower-cost optical 100GBASE-SR4 PHY for MMF and a four-lane chip-to-module and chip-to-chip electrical specification (CAUI-4). The detailed objectives for the 802.3bm project can be found on the 802.3 website.

On May 14, 2018, the 802.3ck project was approved. This has objectives to:[101]

  • Define a single-lane 100 Gbit/s Attachment Unit interface (AUI) for chip-to-module applications, compatible with PMDs based on 100 Gbit/s per lane optical signaling (100GAUI-1 C2M)
  • Define a single-lane 100 Gbit/s Attachment Unit Interface (AUI) for chip-to-chip applications (100GAUI-1 C2C)
  • Define a single-lane 100 Gbit/s PHY for operation over electrical backplanes supporting an insertion loss ≤ 28 dB at 26.56 GHz (100GBASE-KR1).
  • Define a single-lane 100 Gbit/s PHY for operation over twin-axial copper cables with lengths up to at least 2 m (100GBASE-CR1).

On November 12, 2018, the IEEE P802.3ct Task Force started working to define PHY supporting 100 Gbit/s operation on a single wavelength capable of at least 80 km over a DWDM system (100GBASE-ZR) (using a combination of phase and amplitude modulation with coherent detection).

On December 5, 2018, the 802.3cd standard was approved. The 802.3cd standard specifies PHYs using 50Gbit/s lanes - 100GBASE-KR2 for backplane, 100GBASE-CR2 for twin-ax cable, 100GBASE-SR2 for MMF and using 100Gbit/s signalling 100GBASE-DR for SMF.

In June 2020, the IEEE P802.3db Task Force started working to define a physical layer specification that supports 100 Gbit/s operation over 1 pair of MMF with lengths up to at least 50 m.[19]

On February 11, 2021, the IEEE 802.3cu standard was approved. The IEEE 802.3cu standard defines single-wavelength 100 Gbit/s PHYs for operation over SMF (Single-Mode Fiber) with lengths up to at least 2 km (100GBASE-FR1) and 10 km (100GBASE-LR1).

100G interface types

Шаблон:Fibre legend

Name Standard Status Media Connector Transceiver
Module 		Reach
in m 		#
Шаблон:Tooltip
(⇆) 		#
Шаблон:Tooltip
(→) 		#
Шаблон:Tooltip
(→) 		Notes
colspan="11" Шаблон:Partial [102][103][104]
Шаблон:Nowrap
Шаблон:Nowrap 		Шаблон:Nowrap
(CL85) 		Шаблон:Partial Шаблон:Terminated Шаблон:Terminated CXP
CFP2
CFP4
QSFP+ 		7 20 N/A 10 Data centres (inter-rack);
CXP connector uses center 10 out of 12 channels.
Шаблон:Nowrap Шаблон:Nowrap
(CL82/86) 		rowspan="2" Шаблон:Partial rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest CXP
CFP
CFP2
CFP4
CPAK 		Шаблон:Nowrap 20 1 10
Шаблон:Nowrap
Шаблон:Nowrap Шаблон:Partial Шаблон:Partial Шаблон:CGuest Шаблон:CGuest CFP Шаблон:Nowrap 2 10 10 WDM
Multi-vendor standard[105]
colspan="11" Шаблон:Success [102][103][104][106]
Шаблон:Nowrap Шаблон:Nowrap
(CL93) 		Шаблон:Active Шаблон:Terminated Шаблон:N/A Шаблон:N/A 1 8 N/A 4 PCBs;
total insertion loss of up to 35 dB at 12.9 GHz
Шаблон:Nowrap Шаблон:Nowrap
(CL94) 		Шаблон:Active Шаблон:Terminated Шаблон:N/A Шаблон:N/A 1 8 N/A 4 PCBs;
Line code: RS-FEC(544,514) × PAM4
× 92/90 framing and 31320/31280 lane identification
Line rate: 4x 13.59375 GBd = 54.375 GBd
total insertion loss of up to 33 dB at 7 GHz
Шаблон:Nowrap
Шаблон:Nowrap 		Шаблон:Nowrap
(CL92) 		Шаблон:Active Шаблон:Terminated Шаблон:Terminated Шаблон:N/A 5 8 N/A 4 Data centres (inter-rack)
Шаблон:Nowrap Шаблон:Nowrap
(CL95) 		rowspan="2" Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP28
CFP2
CFP4
CPAK 		Шаблон:Nowrap 8 1 4
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap 		rowspan="3" Шаблон:Partial rowspan="3" Шаблон:Active rowspan="3" Шаблон:CGuest rowspan="3" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 2 2 WDM
Line rate: 2x (2x 26.5625 GBd with PAM4)
Duplex fiber with both being used to transmit and receive;
The major selling point of this variant is its ability to run over existing LC multi-mode fiber (allowing easy migration from 10G/25G to 100G).
Not to be confused with (and not compatible with) 100GBASE-SR1.2 (see below).
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap rowspan="3" Шаблон:Partial rowspan="3" Шаблон:Active rowspan="3" Шаблон:CGuest rowspan="3" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 4 4 SWDM[107]
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap Шаблон:Nowrap
(CL88) 		Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP28
CFP
CFP2
CFP4
CPAK 		Шаблон:Nowrap 2 4 4 WDM
Line code: 64b/66b × NRZ
Шаблон:Nowrap Шаблон:Nowrap
(CL88) 		Шаблон:Active QSFP28
CFP
CFP2 		Шаблон:Nowrap 2 4 4 WDM
Line code: 64b/66b × NRZ
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28
CFP4 		Шаблон:Nowrap 8 1 4 Data centres;
Line code: 64b/66b × NRZ or 256b/257b × RS-FEC(528,514) × NRZ
Multi-vendor standard [108]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="5" Шаблон:CGuest QSFP28
CFP2
CFP4 		Шаблон:Nowrap 2 4 4 Data centres;
WDM
Multi-vendor standard[109][110]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active QSFP28
CFP4 		Шаблон:Nowrap 2 4 4 WDM
Multi-vendor standard[111]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active rowspan="2" Шаблон:CGuest Шаблон:Nowrap WDM
Multi-vendor standard[112]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:Nowrap WDM
Multi-vendor standard[112]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active rowspan="1" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 4 4 Data centres;
WDM
Line code: 64b/66b × NRZ or 256b/257b × RS-FEC(528,514) × NRZ
Interoperable with 100GBASE-CWDM4 when using RS-FEC;
Multi-vendor standard[109][113]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 4 4 Data centres;
WDM
Line code: 64b/66b × NRZ or 256b/257b × RS-FEC(528,514) × NRZ
Derived from 100GBASE-CWDM4 to allow cheaper transceivers;
Multi-vendor standard[114]
colspan="11" Шаблон:Success [103][104]
Шаблон:Nowrap Шаблон:Nowrap
(CL137) 		Шаблон:Active Шаблон:Terminated Шаблон:N/A Шаблон:N/A 1 4 N/A 2 PCBs
Шаблон:Nowrap Шаблон:Nowrap
(CL136) 		Шаблон:Active Шаблон:Terminated Шаблон:Terminated Шаблон:N/A 3 4 N/A 2 Data centres (in-rack)
Шаблон:Nowrap Шаблон:Nowrap
(CL138) 		rowspan="2" Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP28 Шаблон:Nowrap 4 1 2
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap 		Шаблон:Nowrap rowspan="3" Шаблон:Active rowspan="3" Шаблон:CGuest rowspan="3" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 2 2 WDM
Line rate: 2x (2x 26.5625 GBd with PAM4)[115]
Duplex fiber with both being used to transmit and receive;
The major selling point of this variant is its ability to run over existing LC multi-mode fiber (allowing easy migration from 10G/25G to 100G). This BiDi variant is compatible with breakout from 400GBASE-4.2 but is not compatible with 100G-SR2-BiDi (see above).[116]
Шаблон:Nowrap
Шаблон:Nowrap
colspan="11" Шаблон:Success
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Active Шаблон:Terminated Шаблон:N/A Шаблон:N/A 2 N/A 1 total insertion loss ≤ 28 dB at 26.56 GHz.
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Active Шаблон:Terminated Шаблон:Terminated Шаблон:N/A 2 2 N/A 1
Шаблон:Nowrap Шаблон:Nowrap
(CL167) 		rowspan="2" Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1
Шаблон:Nowrap
Шаблон:Nowrap Шаблон:Nowrap
(CL167) 		rowspan="2" Шаблон:Active rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1
Шаблон:Nowrap
Шаблон:Nowrap Шаблон:Nowrap
(CL140) 		Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1 Multi-vendor standard[117]
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1 Multi-vendor standard[117]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1 Multi-vendor standard[118]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1 Multi-vendor standard[118]
Шаблон:Nowrap Шаблон:Partial Шаблон:Active Шаблон:CGuest Шаблон:CGuest QSFP28 Шаблон:Nowrap 2 1 1 Multi-vendor standard[118]
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Active Шаблон:CGuest Шаблон:CGuest CFP Шаблон:Nowrap 2 1 1 Line code: DP-DQPSK × SC-FEC
Line rate: 27.9525 GBd
Reduced bandwidth and line rate for ultra long distances.[119]

Шаблон:Notelist

Coding schemes

10.3125 Gbaud with NRZ ("PAM2") and 64b66b on 10 lanes per direction
One of the earliest coding used, this widens the coding scheme used in single lane 10GE and quad lane 40G to use 10 lanes. Due to the low symbol rate, relatively long ranges can be achieved at the cost of using a lot of cabling.
This also allows breakout to 10×10GE, provided that the hardware supports splitting the port.
25.78125 Gbaud with NRZ ("PAM2") and 64b66b on 4 lanes per direction
A sped-up variant of the above, this directly corresponds to 10GE/40GE signalling at 2.5× speed. The higher symbol rate makes links more susceptible to errors.
If the device and transceiver support dual-speed operation, it is possible to reconfigure an 100G port to downspeed to 40G or 4×10G. There is no autonegotiation protocol for this, thus manual configuration is necessary. Similarly, a port can be broken into 4×25G if implemented in the hardware. This is applicable even for CWDM4, if a CWDM demultiplexer and CWDM 25G optics are used appropriately.
25.78125 Gbaud with NRZ ("PAM2") and RS-FEC(528,514) on 4 lanes per direction
To address the higher susceptibility to errors at these symbol rates, an application of Reed–Solomon error correction was defined in IEEE 802.3bj / Clause 91. This replaces the 64b66b encoding with a 256b257b encoding followed by the RS-FEC application, which combines to the exact same overhead as 64b66b. To the optical transceiver or cable, there is no distinction between this and 64b66b; some interface types (e.g. CWDM4) are defined "with or without FEC."
26.5625 Gbaud with PAM4 and RS-FEC(544,514) on 2 lanes per direction
This achieves a further doubling in bandwidth per lane (used to halve the number of lanes) by employing pulse-amplitude modulation with 4 distinct analog levels, making each symbol carry 2 bits. To keep up error margins, the FEC overhead is doubled from 2.7% to 5.8%, which explains the slight rise in symbol rate.
53.125 Gbaud with PAM4 and RS-FEC(544,514) on 1 lane per direction
Further pushing silicon limits, this is a double rate variant of the previous, giving full 100GE operation over 1 medium lane.
30.14475 Gbaud with DP-DQPSK and SD-FEC on 1 lane per direction
Mirroring OTN4 developments, DP-DQPSK (dual polarization differential quadrature phase shift keying) employs polarization to carry one axis of the DP-QPSK constellation. Additionally, new soft decision FEC algorithms take additional information on analog signal levels as input to the error correction procedure.
13.59375 Gbaud with PAM4, KP4 specific coding and RS-FEC(544,514) on 4 lanes per direction
A half-speed variant of 26.5625 Gbaud with RS-FEC, with a 31320/31280 step encoding the lane number into the signal, and further 92/90 framing.

Шаблон:Anchor40G interface types

Шаблон:Fibre legend

Name Standard Status Media Connector Transceiver
Module 		Reach
in m 		#
Шаблон:Tooltip
(⇆) 		#
Шаблон:Tooltip
(→) 		#
Шаблон:Tooltip
(→) 		Notes
colspan="11" Шаблон:Partial [102][103][120][121]
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Partial Шаблон:Terminated Шаблон:N/A Шаблон:N/A 1 8 N/A 4 PCBs;
possible breakout / lane separation to 4x 10G
through splitter cable (QSFP+ to 4x SFP+);
involves CL73 for auto-negotiation, and CL72 for link training.
Шаблон:Nowrap
Шаблон:Nowrap 		Шаблон:Nowrap Шаблон:Partial Шаблон:Terminated Шаблон:Terminated QSFP+ 10 8 N/A 4 Data centres (inter-rack)
possible breakout / lane separation to 4x 10G
through splitter cable (QSFP+ to 4x SFP+);
involves CL73 for auto-negotiation and CL72 for link training.
Шаблон:Nowrap Шаблон:Nowrap rowspan="2" Шаблон:Partial rowspan="4" Шаблон:CGuest rowspan="4" Шаблон:CGuest CFP
QSFP+ 		Шаблон:Nowrap 8 1 4 possible breakout / lane separation to 4x 10G
through splitter cable (MPO/MTP to 4x LC-pairs).
Шаблон:Nowrap
Шаблон:Nowrap rowspan="2" Шаблон:Partial rowspan="2" Шаблон:Partial QSFP+ Шаблон:Nowrap possible breakout / lane separation to 4x 10G
through splitter cable (MPO/MTP to 4x LC-pairs).
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap 		rowspan="2" Шаблон:Partial rowspan="2" Шаблон:Partial rowspan="2" Шаблон:CGuest rowspan="2" Шаблон:CGuest QSFP+ Шаблон:Nowrap 2 2 2 WDM
duplex fiber each used to transmit and receive on two wavelengths;
The major selling point of this variant is its ability to run over existing 10G multi-mode fiber (i.e. allowing easy migration from 10G to 40G).
Шаблон:Nowrap
Шаблон:Nowrap rowspan="3" Шаблон:Partial rowspan="3" Шаблон:Partial rowspan="3" Шаблон:CGuest rowspan="3" Шаблон:CGuest QSFP+ Шаблон:Nowrap 2 4 4 SWDM[107]
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Partial rowspan="5" Шаблон:CGuest rowspan="5" Шаблон:CGuest CFP
QSFP+ 		Шаблон:Nowrap 2 4 4 WDM
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Partial QSFP+ Шаблон:Nowrap WDM
Шаблон:Nowrap / -LM4 rowspan="3" Шаблон:Partial rowspan="3" Шаблон:Partial QSFP+ Шаблон:Nowrap WDM
as primarily designed for single mode (-LR4), this mode of operation is out of specification for some transceivers.
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap
Шаблон:Nowrap 		Шаблон:Partial Шаблон:Partial Шаблон:CGuest Шаблон:CGuest QSFP+ Шаблон:Nowrap 8 1 4 possible breakout / lane separation to 4x 10G
through splitter cable (MPO/MTP to 4x LC-pairs).
Шаблон:Nowrap Шаблон:Nowrap Шаблон:Partial Шаблон:CGuest Шаблон:CGuest CFP Шаблон:Nowrap 2 1 1 Line rate: 41.25 GBd
capability to receive 1310 nm light besides 1550 nm;
allows inter-operation with a longer reach 1310 nm PHY (TBD);
use of 1550 nm implies compatibility with existing test equipment and infrastructure.
Шаблон:Visible anchor

CL73 allows communication between the 2 PHYs to exchange technical capability pages, and both PHYs come to a common speed and media type. Completion of CL73 initiates CL72. CL72 allows each of the 4 lanes' transmitters to adjust pre-emphasis via feedback from the link partner.

Шаблон:Visible anchor
40GBASE-T is a port type for 4-pair balanced twisted-pair Cat.8 copper cabling up to 30 m defined in IEEE 802.3bq.[122] IEEE 802.3bq-2016 standard was approved by The IEEE-SA Standards Board on June 30, 2016.[123] It uses 16-level PAM signaling over four lanes at 3,200 MBd each, scaled up from 10GBASE-T.
Comparison of twisted-pair-based Ethernet physical transport layers (TP-PHYs)[124]
Name Standard Status Speed (Mbit/s) Pairs required Lanes per direction Bits per hertz Line code Symbol rate per lane (MBd) Bandwidth Max distance (m) Cable Cable rating (MHz) Usage
Шаблон:Nowrap Шаблон:Nowrap (CL113) Шаблон:Active 40000 4 4 6.25 PAM-16 RS-FEC (192, 186) LDPC 3200 1600 30 Cat 8 2000 LAN, Data centres

Chip-to-chip/chip-to-module interfaces

Шаблон:Visible anchor
CAUI-10 is a 100 Gbit/s 10-lane electrical interface defined in 802.3ba.[1]
Шаблон:Visible anchor
CAUI-4 is a 100 Gbit/s 4-lane electrical interface defined in 802.3bm Annex 83E with a nominal signaling rate for each lane of 25.78125 GBd using NRZ modulation.[3]
Шаблон:Visible anchor
100GAUI-4 is a 100 Gbit/s 4-lane electrical interface defined in 802.3cd Annex 135D/E with a nominal signaling rate for each lane of 26.5625 GBd using NRZ modulation and RS-FEC(544,514) so suitable for use with 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 100GBASE-DR, 100GBASE-FR1, 100GBASE-LR1 PHYs.
Шаблон:Visible anchor
100GAUI-2 is a 100 Gbit/s 2-lane electrical interface defined in 802.3cd Annex 135F/G with a nominal signaling rate for each lane of 26.5625 GBd using PAM4 modulation and RS-FEC(544,514) so suitable for use with 100GBASE-CR2, 100GBASE-KR2, 100GBASE-SR2, 100GBASE-DR, 100GBASE-FR1, 100GBASE-LR1 PHYs.
Шаблон:Visible anchor
100GAUI-1 is a 100 Gbit/s 1-lane electrical interface defined in 802.3ck Annex 120F/G with a nominal signaling rate for each lane of 53.125 GBd using PAM4 modulation and RS-FEC(544,514) so suitable for use with 100GBASE-CR1, 100GBASE-KR1, 100GBASE-SR1, 100GBASE-DR, 100GBASE-FR1, 100GBASE-LR1 PHYs.

Pluggable optics standards

Шаблон:Visible anchor
The QSFP+ form factor is specified for use with the 40 Gigabit Ethernet. Copper direct attached cable (DAC) or optical modules are supported, see Figure 85–20 in the 802.3 spec. QSFP+ modules at 40Gbit/s can also be used to provide four independent ports of 10 gigabit Ethernet.[1]
Шаблон:Visible anchor
CFP modules use the 10-lane CAUI-10 electrical interface.
CFP2 modules use the 10-lane CAUI-10 electrical interface or the 4-lane CAUI-4 electrical interface.
CFP4 modules use the 4-lane CAUI-4 electrical interface.[125]
QSFP28 modules use the CAUI-4 electrical interface.
SFP-DD or Small Form-factor Pluggable – Double Density modules use the 100GAUI-2 electrical interface.
Cisco's CPAK optical module uses the four lane CEI-28G-VSR electrical interface.[126][127]
There are also CXP and HD module standards.[128] CXP modules use the CAUI-10 electrical interface.

Optical connectors

Short reach interfaces use Multiple-Fiber Push-On/Pull-off (MPO) optical connectors.[1]Шаблон:Rp 40GBASE-SR4 and 100GBASE-SR4 use MPO-12 while 100GBASE-SR10 uses MPO-24 with one optical lane per fiber strand.

Long reach interfaces use duplex LC connectors with all optical lanes multiplexed with WDM.

See also

Шаблон:Div col

Шаблон:Div col end

References

Шаблон:Reflist

Further reading

Шаблон:Refbegin

Шаблон:Refend

External links

Шаблон:Ethernet

Партнерские ресурсы
Криптовалюты
Магазины
Хостинг
Разное

  1. ↑ 1,0 1,1 1,2 1,3 1,4 Шаблон:Cite web
  2. ↑ 2,0 2,1 2,2 2,3 Шаблон:Cite web
  3. ↑ 3,0 3,1 3,2 3,3 Шаблон:Cite web
  4. ↑ such as IEEE 802.3bs-2017
  5. ↑ Шаблон:Cite web
  6. ↑ Шаблон:Cite web
  7. ↑ Шаблон:Cite news
  8. ↑ Шаблон:Cite web
  9. ↑ Шаблон:Cite web
  10. ↑ 10,0 10,1 Шаблон:Cite web
  11. ↑ Шаблон:Cite web
  12. ↑ 12,0 12,1 Шаблон:Cite web
  13. ↑ Шаблон:Cite web
  14. ↑ Шаблон:Cite web
  15. ↑ Шаблон:Cite web
  16. ↑ Шаблон:Cite web
  17. ↑ Шаблон:Cite web
  18. ↑ Шаблон:Cite web
  19. ↑ 19,0 19,1 Шаблон:Cite web
  20. ↑ Шаблон:Cite web
  21. ↑ Шаблон:Cite web
  22. ↑ Шаблон:Cite web
  23. ↑ Шаблон:Cite web
  24. ↑ Шаблон:Cite press release
  25. ↑ Шаблон:Cite web
  26. ↑ Шаблон:Cite web
  27. ↑ Шаблон:Cite web
  28. ↑ Шаблон:Cite web
  29. ↑ Шаблон:Cite web
  30. ↑ Шаблон:Cite web
  31. ↑ Шаблон:Cite web
  32. ↑ Шаблон:Cite web
  33. ↑ Шаблон:Cite news
  34. ↑ Шаблон:Cite web
  35. ↑ Шаблон:Cite web
  36. ↑ Шаблон:Cite web
  37. ↑ Шаблон:Cite web
  38. ↑ Шаблон:Cite news
  39. ↑ Шаблон:Cite news
  40. ↑ Шаблон:Cite news (Danish)
  41. ↑ Шаблон:Cite web
  42. ↑ Шаблон:Cite web
  43. ↑ Шаблон:Cite web
  44. ↑ Шаблон:Cite web
  45. ↑ Шаблон:Cite web
  46. ↑ Шаблон:Cite web
  47. ↑ Шаблон:Cite web
  48. ↑ Шаблон:Cite web
  49. ↑ Шаблон:Cite web
  50. ↑ Шаблон:Cite web
  51. ↑ Шаблон:Cite news
  52. ↑ Шаблон:Cite news
  53. ↑ Шаблон:Cite news
  54. ↑ Шаблон:Cite news
  55. ↑ Шаблон:Cite web
  56. ↑ Шаблон:Cite web
  57. ↑ Шаблон:Cite web
  58. ↑ Шаблон:Cite web
  59. ↑ Шаблон:Cite web
  60. ↑ Шаблон:Cite web
  61. ↑ Шаблон:Cite web
  62. ↑ Шаблон:Cite web
  63. ↑ Шаблон:Cite web
  64. ↑ Шаблон:Cite web
  65. ↑ Шаблон:Cite web
  66. ↑ Шаблон:Cite news
  67. ↑ Шаблон:Cite news
  68. ↑ Шаблон:Cite web
  69. ↑ Шаблон:Cite web
  70. ↑ Шаблон:Cite web
  71. ↑ Шаблон:Cite web
  72. ↑ Шаблон:Cite web
  73. ↑ Шаблон:Cite web
  74. ↑ Шаблон:Cite web
  75. ↑ Шаблон:Cite web
  76. ↑ Шаблон:Cite web
  77. ↑ Шаблон:Cite web
  78. ↑ Шаблон:Cite web
  79. ↑ Шаблон:Cite web
  80. ↑ Шаблон:Cite web
  81. ↑ Шаблон:Cite web
  82. ↑ Шаблон:Cite web
  83. ↑ Шаблон:Cite web
  84. ↑ Шаблон:Cite web
  85. ↑ Шаблон:Cite web
  86. ↑ Шаблон:Cite web
  87. ↑ Шаблон:Cite web
  88. ↑ Шаблон:Cite web
  89. ↑ Шаблон:Cite web
  90. ↑ Шаблон:Cite web
  91. ↑ Шаблон:Cite web
  92. ↑ Шаблон:Cite web
  93. ↑ 93,0 93,1 Шаблон:Cite web
  94. ↑ Шаблон:Cite web
  95. ↑ Шаблон:Cite web
  96. ↑ Шаблон:Cite web
  97. ↑ Шаблон:Cite web
  98. ↑ Шаблон:Cite web
  99. ↑ Шаблон:Cite news
  100. ↑ Шаблон:Cite news
  101. ↑ Шаблон:Cite web
  102. ↑ 102,0 102,1 102,2 Шаблон:Cite web
  103. ↑ 103,0 103,1 103,2 103,3 Шаблон:Cite web
  104. ↑ 104,0 104,1 104,2 Шаблон:Cite web
  105. ↑ Шаблон:Cite web
  106. ↑ 107,0 107,1 Шаблон:Cite web
  107. ↑ Шаблон:Cite web
  108. ↑ 109,0 109,1 Шаблон:Cite web
  109. ↑ Шаблон:Cite web
  110. ↑ Шаблон:Cite web
  111. ↑ 112,0 112,1 Шаблон:Cite web
  112. ↑ Шаблон:Cite web
  113. ↑ Шаблон:Cite web
  114. ↑ Шаблон:Cite web
  115. ↑ Шаблон:Cite web
  116. ↑ 117,0 117,1 Шаблон:Cite web
  117. ↑ 118,0 118,1 118,2 Шаблон:Cite web
  118. ↑ Шаблон:Cite web
  119. ↑ Шаблон:Cite web
  120. ↑ Шаблон:Cite web
  121. ↑ Шаблон:Cite web
  122. ↑ Шаблон:Cite web
  123. ↑ Шаблон:Cite book
  124. ↑ Шаблон:Cite web
  125. ↑ Шаблон:Cite web
  126. ↑ Шаблон:Cite web
  127. ↑ Шаблон:Cite web
Источник — http://wikihandbk.com/ruwiki/index.php?title=Английская_Википедия:100_Gigabit_Ethernet&oldid=12483892