Nexus9000系列

CiscoNexus9000系列交换机CiscoNX-OS模型March2014CiscoConfidential‹#›C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000系列交换机的介绍Nexus9500Nexus9300FEX对Nexus9000支持NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›CiscoNexus9000SeriesSwitchesHigh-Performance10Gbps/40Gbps/100GbpsSwitchFamilyFLEXIBLEFORMFACTORSCANENABLEVARIABLEDATACENTERDESIGNANDSCALINGNexus®9300Nexus9500481/10GSFP+&12QSFP+SCALABLE1GE/10Gbps/40Gbps/100GEPERFORMANCEPERFORMANCEPORTSPRICEPROGRAMMABILITYPOWER961/10G-T&8QSFP+12-portQSFP+GEMACIReadyLeafLineCard481/10G-T&4QSFP+ACI-readyLeaflinecard481/10GSFP+&4QSFP+Aggregationlinecard3640GQSFP+C95008-SlotC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000SeriesSwitchesIntroductionNexus9500Nexus9300FEXSupportonNexus9000NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500架构平台概述Highportdensity高密度的端口288x40Gbps/Nexus95081152x10Gbps/Nexus9508Layer2andLayer3line-rateperformanceonallportsandallpacketsizesLowlatency低延迟Upto3.5useconthe36x40GEQSFPlinecard(N9K-X9636PQ)Powerefficiency电源功率Platinum-ratedpowersupplies;90-94%powerefficiencyacrossallworkloads3.5W/10Gbpsport14W/40GbpsportFirstmodularchassiswithoutamid-planeUnobstructedfront-to-backairflowVXLANbridging,gateway,routingHighlyintegratedswitchandbufferfunctionalityOnly2to4ASICsperlinecardNobufferbloatMixof28nmCisco®and40nmBroadcomASICsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500PlatformArchitecture8-SlotModularChassisNexus®9508前视图Nexus9508后视图8行卡插槽每个接口最大3.84TB全双工冗余的管理引擎支持3000WAC电源2+0,2+1,2+2redundancySupportsupto8powersuppliesRedundantsystemcontrollercards3or6fabricmodules(behindfantrays)3fantrays,front-to-backairflowNomid-planeforLC-to-FMconnectivityDesignedforPowerandCoolingEfficiencyDesignedforReliabilityDesignedforFutureScaleChassisDimensions:13RUx30in.x17.5in(HxWxD)C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500PlatformArchitecture电源模块和风扇3000WACPSUSingle20Ainput–220VSupportforarangeofinternationalcablingoptionsRangeofPSUconfigurations最少1个电源模块2PSUforafully-loadedchassisN+1redundancyN+Ngridredundancy2timestheheadroomforfutureportdensities,bandwidth,andopticsUpto8PStotal3fantrays3dualfanspertrayDynamicspeedcontroldrivenbytemperaturesensorsStraightairflowacrosslinecardsandfabricmodulesN+1redundancypertrayC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500PlatformArchitectureSupervisorModuleRedundanthalf-widthsupervisorenginePerformance-andscale-focusedRangeofmanagementinterfacesExternalclockinput(PPS)SupervisorModuleProcessorRomley,1.8GHz,4coreSystemMemory16GB,upgradableto48GBRS-232SerialPortsOne(RJ-45)10/100/1000ManagementPortsOne(RJ-45)USB2.0InterfaceTwoSSDStorage64GB64GBSSD16GBDRAM(Upgradableto48GB)10/100/1000mgmtportDualUSBportsConsoleportPPSclockinputLatestquad-coreIntelSandyBridgeProcessorRedundantpathstosystemcontrollersC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›架构平台系统控制模型冗余设计的半宽系统控制器OffloadssupervisorfromdevicemanagementtasksIncreasedsystemresiliencyIncreasedscalePerformance-andscale-focusedDualcoreARMprocessor,1.3GHzCentralpoint-of-chassiscontrolEthernetOutofBandChannel(EOBC)switch:1Gbpsswitchforintra-nodecontrolplanecommunication(devicemanagement)EthernetProtocolChannel(EPC)switch:1Gbpsswitchforintra-nodedataplanecommunication(protocolpackets)Powersuppliesthroughsystemmanagementbus(SMB)FantraysC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500FabricModuleFabricsModulesInterconnectI/OmoduleslotsInstalledattherearofthechassisUsesBroadcomTridentIIASICsasthenetworkforwardingengine(NFE)3.84Tbpsduplexperlinecardslot(6fabriccards)1.92Tbpsduplexperlinecardslot(3fabriccards)AllfabriccardsareactiveandcarrytrafficC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500FabricModuleDataPlaneScalingFor8-SlotChassisEachfabricmoduleforthe8-slotchassiscanprovideupto320GbpstoeachI/OmoduleslotWith6fabricmodules,eachI/Omoduleslotcanhaveupto1.92TbpsforwardingbandwidthineachdirectionNFEFabric1NFE320Gbps(8x40Gbps)NFEFabric2NFE320Gbps(8x40Gbps)NFEFabric3NFE320Gbps(8x40Gbps)NFEFabric4NFE320Gbps(8x40Gbps)NFEFabric5NFE320Gbps(8x40Gbps)NFEFabric6NFE320Gbps(8x40Gbps)LineCardSlot320Gbps640Gbps960Gbps1.28Tbps1.60Tbps1.92TbpsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›CiscoNexus9500LineCardsN9K-X9636PQA36-port,40GbpsQSFP+linecardneeds6fabricmodulestooperateatlinerateonall36portsandforallpacketsizes.36x40GbpsQSFPports2.88Tbpsfull-duplexfabricconnectivityLayer2and3line-rateperformanceonallportsforallpacketsizesSupports4x10Gbpsbreak-outmodeCisco®NX-OSmodeonlyC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500LineCardN9K-X9636PQThreenetworkforwardingengines(NFE)EachNFEhas12x40Gbpslinkstothefrontpaneland12x40GbpsinternallinkstothefabricmodulesNFE112x40Gbps12x40GbpsEthernetNFE212x40Gbps12x40GbpsEthernetNFE312x40Gbps12x40GbpsEthernetEach36-port,40GbpsQSFP+linecardneeds6fabricmodulestooperateatlinerateonall36ports.ConnecttoFabricModulesFront-PanelPortsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500LineCardsN9K-X9636PQFabricConnectivityAllportsonthelinecardcanoperateatlinerateforanypacketsizeswith6fabricmodulesEachofthe3NFEsonthelinecardhas12x40Gbpslinkstofabricmodules-onetoeachFabricTridentIIASICNFENFE12x40Gbps12x40GbpsNFE12x40GbpsNFEFabric1NFENFEFabric2NFENFEFabric3NFENFEFabric4NFENFEFabric5NFENFEFabric6NFE1x40Gbps1x40Gbps36-port40GbpsQSFP+C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500LineCardsN9K-X9564PXAndN9K-X9564TXN9K-X9564PX481/10GSFP+ports+440GQSFP+portsN9K-X9564TX481/10GBase-Tports+440GQSFP+ports1.92TbpsduplexfabricconnectivityLayer2and3line-rateperformanceonallportsforallpacketsizesCisco®NX-OSandApplicationCentricInfrastructure(ACI)mode48-port1/10GSFP+4-port40G4x40Gor16x10G48-port1/10G-T+4-port40G4x40Gor16x10GC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500LineCardsN9K-X9564PXAndN9K-X9564TXNFE1ALE112x40Gbps48x1/10GSFP/SFP+ALE212x40Gbps4x40GQSFP+NetworkInterfacesNFE2NetworkInterfaces12x40Gbps12x40Gbps12x40GbpsEthernet6x40GbpsEthernet48x1/10GBase-TConnecttoFabricModulesConnecttoHostsorNetwork2networkforwardingengines(NFEs)2applicationleafengines(ALEs)foradditionalbufferingandpackethandlingC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500LineCardsN9K-X9564PXAndN9K-X9564TXFabricConnectivityMinimumof3fabricmodulestogetallline-rateportsNFEASIC1Fabric1NFEASIC2NFEASIC1Fabric2NFEASIC2NFEASICNSNSNFEASIC1Fabric3NFEASIC2NFEASIC2x40Gbps2x40Gbps48-port1/10GSFP+and4-port40GQSFP+48-port1/10G-Tand4-port40GQSFP+C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›OpticalInnovation:Removing40GbBarriersProblem40Gbopticsareasignificantportionofcapitalexpenditures(CAPEX)40GbopticsrequirenewcablingRe-useexisting10GbMMFcablinginfrastructureRe-usepatchcables(sameLCconnector)SolutionQSFP,MSA-compliantDualLCconnectorSupportfor100monOM3andupto150monOM4TX/RXontwowavelengthsat20GbeachCisco®40GbSR-BiDiQSFPAvailableendofCY13andsupportedacrossallCiscoQSFPportsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›QSFP-BIDIvs.QSFP-40G-SR412-Fibervs.DuplexMultimodeFiberTXRXTX/RXTX/RX4x10G4x10G2x20G2x20G12-FiberribboncablewithMPOconnectorsatbothendsDuplexmultimodefiberwithDuplexLCconnectorsatbothends12-FiberinfrastructureDuplexMultimodeFiberHighercosttoupgradefrom10Gto40Gdueto12-FiberinfrastructureUseofduplexmultimodefiberlowerscostofupgradingfrom10Gto40Gbyleveragingexisting10GmultimodeinfrastructureQSFP-BIDIQSFPSR12-FiberinfrastructureDuplexMultimodeFiberQSFP-BIDIQSFPSRC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500SeriesLineCardsN9K-X9636PQN9K-X9564PXN9K-X9564TX1/10GbSFP/SFP+Ports--48--1/10GbBaseTPorts----4840GbQSFPPorts3644MaximumNumberof1GbPorts--4848MaximumNumberof10GEPorts1446464MaximumNumberof40GEPorts3644MinimumNumberofFabricModulesforFullLine-RatePerformance633C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500SystemScalabilitiesInStandaloneMode(NX-OS) Nexus®9500LPMRoutes128KIPHostEntries88KMACAddressEntries160KMulticastRoutes32K*(hardwarecapableof72K)MulticastFanOuts8K(novPC)IGMPSnoopingGroups32K*(hardwarecapableof72K)ACLTCAMHardware:Ingress:4KperNFE;upto96KpersystemEgress:1KperNFE;upto24KpersystemAvailabletousers:Ingress:3KperNFE;upto72KpersystemEgress:768perNFE;upto18.4KpersystemVRF1000MaximumLinksinPortChannel32MaximumECMPPaths64MaximumvPCPortChannels528MaximumActiveSPANSessions4MaximumRPVSTInstances507MaximumHSRPGroups490MaximumVLANs4KSPAN/ERSPAN4activesessionsVXLAN10KlocalVXLANhosts+VTEPs*SharedwithIPhostsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9000SeriesFullLine-RateThroughputPerformanceUnprecedented,FullLine-RatePerformance:ProvenwithRFC2544,RFC2889,RFC3918throughputtestsResultsweretakenusingafullyloadedNexus®9508switchwith28840GEports:Allportsarelinerateat100%unicasttrafficloadAllportsarelinerateat100%multicasttrafficloadFulllinerateforallpacketsizes(64toapprox.9216Bytes)1.2E+0121.0E+0120.0E+0122.0E+0124.0E+0126.0E+0128.0E+012(frames)C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9000SeriesLow-LatencyPerformanceLowLatency(SameforBothUnicastandMulticast)ProvenwithRFC2544,RFC2889,RFC3918throughputtestsResultsweretakenusingafully-loadedNexus®9508switchwith28840GEports:Unicastlatencyat100%trafficload:1.6usec(64-Bytepackets)3.5usec(9216-Bytepackets)Multicastlatencyat100%trafficload:1.6usec(64-Bytepackets)3.5usec(9216-Bytepackets)C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000SeriesSwitchesIntroductionNexus9500Nexus9300FEXSupportonNexus9000NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9300PlatformArchitectureNexus®9396PQ960G48-port1/10GbSFP+and12-port40GbQSFP+2RUNexus9396TX(future)960G48-port1/10GBaseT&12-port40GbQSFP+2RUNexus93128TX1,280G96-port1/10G-Tand8-port40GbQSFP+3RUNexus9300-CommonRedundantfanandpowersupplyFront-to-backandback-to-frontairflowDual-coreCPUwithdefault64GBSDDUplinkModule12-port40GbQSFP+Additional40MBbufferFullVXLANgateway,bridgingandroutingcapabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9300PlatformArchitecture2RUheight481GbSFP/10GbpsSFP+ports1240GbpsQSFPports(onGEMmodule)1100/1000baseTmanagementport1RS232consoleport2USB2.0portsFront-to-backandback-to-frontairflowoptions1+1redundantpowersupplyoptions2+1redundantfansNo-blockingarchitecturewithline-rateperformanceonallportsforallpacketsizesCiscoNexus®9396PXConsoleManagementPortUSBPorts481GbpsSFP/10GbpsSFP+portsGEMmodulewith1240GbpsQSFP+portsPowersupplyPowersupply(2+1)fantraysC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9300PlatformArchitecture3RUheight961/10GbpsBaseTports840GbpsQSFPports(onGEMmodule)1100/1000baseTmanagementport1RS232consoleport2USB2.0portsFront-to-backandback-to-frontairflowoptions1+1redundantpowersupplyoptions2+1redundantfansCiscoNexus®93128TXConsolemanagementportUSBports961GBaseT/10GBaseTportsGEMmodulewith1240GbpsQSFP+ports(8activeuplinks)PowersupplyPowersupply(2+1)fantraysC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9300SystemBlockDiagramNFEALENetworkInterfaces12x40GbHi-Gig212x40GbEthernetFrontPanel48x1GE/10GEPortsGEM12x40GEQSFP+UplinksNexus®9396PQ/Nexus9396TXNexus93128TXNFEALENetworkInterfaces8x40Gb24x40GbEthernetFrontPanel96x1GE/10GEPortsGEM12x40GEQSFP+Uplinks(only8portsareactive)C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9300SystemScalabilitiesInStandaloneMode Nexus9300Layer2TemplateLayer3TemplateLPMRoutes16K128KIPHostEntries88K16KMACAddressEntries160K32KMulticastRoutes32K*(hardwarecapableof72K)8K*MulticastFanOuts8K(novPC)8K(novPC)IGMPSnoopingGroups32K*(hardwarecapableof72K)8K*ACLTCAMHardware:4Kingress,1KegressAvailabletouser:3Kingress,768egressHardware:4Kingress,1KegressAvailabletouser:3Kingress,768egressVRF10001000MaxLinksinPortChannel3232MaxECMPPaths6464MaxvPCPortChannels528528MaxActiveSPANSessions44MaxRPVSTInstances507507MaxHSRPGroups490490MAXVLANs4K4KSPAN/ERSPAN4activesessions4activesessionsVXLAN10K(localVXLANhosts+VTEPs)10K(localVXLANhosts+VTEPs)*SharedwithIPhostsC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000SeriesSwitchesIntroductionNexus9500Nexus9300FEXSupportonNexus9000NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500/9300InvestmentProtectionNexus2200FEXSupportInvestmentprotectionCost-effective100Mbps/1GbpsserveraccessFEXsupportscalabilityUpto32FEXsperNexus®9500Upto16FEXsperNexus9300Nexus2248TPNexus2248TP-ENexus2232PP-10GbpsNexus2232TMNexus2232TM-ENexus2248PQNexusB22-HPNexusB22-DellC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Nexus9500/9300InvestmentProtectionNexus2000FEXSupportSupportedFEXTopology:Single-homedFEXvPCportchanneltohostsact/stdyC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000SeriesSwitchesIntroductionNexus9500Nexus9300FEXSupportonNexus9000NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›CollapsedAggregationAndAccessOption1:Layer2and3boundaryisonthecorevPCbetweenaggregationandcoreNexus9500canbeEoRwithFEXintheracksNexus9300canbeMoRandEoRwithFEXintheracksOption2:Layer3allthewaytoaccessECMPbetweenaccessandaggregationNexus9500canbeEoRwithFEXintheracksNexus9300canbeMoRandEoRwithFEXintheracksConfigurationOptionsNexus®7000DCEdgeDCCoreDCAggr./AccessCollapsedAggregationandAccessDCAccessRacks/RowsFabricExtendersFabricExtendersN9300N9300N9300N9300N9500N9500N9500N9500N9500N9500C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›Traditional3-TierNetworkDesignOption1:Layer2or3boundaryisonaggregationvPCbetweenaccessandaggregationNexus9500canbeEoRNexus9300canbeToRorMoROption2:Layer2or3boundaryisonaggregationvPCbetweenaccessandaggregationNexus9500canbeEoRNexus9300canbeToRorMoRConfigurationOptionsNexus®7000DCEdgeDCCorePoDNDCAccessDCAggr.Traditional3-TierNetworkPoD1DCAccessDCAggr.Racks/RowsFabricExtendersFabricExtendersN9300N9300N9300N9300N9500N9500N9500N9500N9500N9500N9500N9500N9500N9500C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›ConfigurationOptions:Layer3IPfabricLayer3allthewaytoaccessLayer2extensibilitycanbeprovidedbyVXLANNexus®9500canbeEoRNexus9300canbeToRandMoRSpineLeafDCEdgeFabricExtenders2-TierFabricRoutingLeafsSpine-LeafFabricDesignN9500N9500N9500N9500N9300N9300N9300N9300N9300N9300N9300N9500N9500C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›AgendaCiscoNexus9000SeriesSwitchesIntroductionNexus9500Nexus9300FEXSupportonNexus9000NetworkDesignandScalingwithNexus9000EnhancedNX-OSAutomationandProgrammabilityC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›OptimizedCiscoNX-OSPurpose-BuiltDataCenterOSModern:64-bitLinux3.4.10Kernel;singleimageforNexus®9500and9300;combinedkick-startandsystemimageComprehensive:Purpose-builtdatacenterfeatureset,includingLayer2,Layer3,andVXLANModular:CoderunsinDRAMonlywheninvokedFaultcontainment:CompleteprocessisolationforbothfeaturesandservicesResiliency:Restartable,user-spacenetworkstackanddrivers;supportforISSU(modular)andOSpatchabilityManagementinfrastructure:CLI,SNMP,NetConf/XML,CiscoonePK™,OpenContainers,JSONC97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›CiscoNX-OSProgrammability,Visibility,AndAutomationSuiteSNMP(v1,v2,v3),Syslog,NETCONF,RMON,CLIProgrammableNX-APIXML,JSON,REST,RPC,NetConfPythonscriptingBASHaccessandLinuxcontainersBroadcomshellaccessOpenFlowsupportCiscoonePK™CustomizableCLIsAutomationandOrchestrationPuppet/ChefintegrationXMPPsupportOpenStacknetworkpluginOpenDaylightintegrationVisibilityvTrackerDynamicbuffermonitoringFlowmonitoringEnhancedWiresharkSMTPemail“pipe”outputEmbeddedEventManager(EEM)C97-730019​-01©2013Ciscoand/oritsaffiliates.Allrightsreserved.CiscoConfidential‹#›