Cisco 7008P - SFS InfiniBand Server Switch Manual de usuario Pagina 1

© 2007 Cisco Systems, Inc. All rights reserved.Cisco University1Cisco InfiniBand and Server VirtualizationBryan BradleySr. Systems EngineerServer Virt

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID10Sources of overhead in Datacenter ServersCPUNICSystemMemoryTCP Buff

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID11RDMA: Remote Direct Memory Access RDMA enables data to be moved be

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID12Remote Direct Memory Access (RDMA) and Kernel BypassHardwareApplica

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID13Traditional Server I/O architecture Bus Based architecture with I/

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID14RDMA I/O Architecture Compute resource on one server can access ap

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID15InfiniBand Subnet Manager InfiniBand Fabric is called an InfiniBan

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID16IP over InfiniBand (IPoIB) IETF Standard (RFC 4931 / 4932) IP ove

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID17Sockets Direct Protocol (SDP) Provides a compatible sockets interf

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID18Message Passing Interface (MPI) MPI is message-passing middlewareA

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID19SCSI RDMA Protocol (SRP) Intended to run SCSI protocol to run over

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID2AgendaIntroduction to InfiniBand Technology Introduction to Infini

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID20InfiniBand Protocol SummaryHPC applications. Low latency protocol u

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID21InfiniBand PerformanceMeasured Results25%25%28%27%26%23%25%9%CPU135

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID22The Cisco SFS Product Line:InfiniBand for High Performance Computin

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID23Virtual I/O Basics

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID24InfiniBand – Accelerating Applications in the Data Center InfiniBa

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID25SFS Ethernet Gateway Technology 3000 Series InfiniBand to Ethernet

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID26InfiniBand-to-Ethernet Gateway Features IP-Only protocols 802.1Q

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID27SFS Fibre Channel Gateway 3000 Series InfiniBand to Fibre Channel

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID28InfiniBand-to-Fibre Channel Gateway Ensures seamless integration w

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID29Physical vs. Logical ViewPhysical View Servers connected via IB S

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID3Server Networking Challenges Growing Bandwidth Demands Highly di

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID30InfiniBand Cabling OptionsSuperflex and Optical Interconnect Option

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID31Cisco IOS IntegrationConsistent Configuration & Management Com

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID32CiscoWorks LMS Support for Infiniband Single network management ap

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID33Ethernet Defining Clustered ServersHigh Performance Computing Clust

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID34HPC InfiniBand Networking Optimized for interprocessor communicati

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID35How the HPC Network is UsedMaster NodeCompute NodesParallel File Sy

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID36HPC - Application AreasComputational Fluid Dynamics•Fluent•Star-CD•

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID37Application Classes and Characteristics Tightly coupled applicatio

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID38HPC Inter-Process Communications Networking HPC cluster performanc

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID39HPC for Financial Sector Performance for Market Data DistributionL

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID4Cisco Data Center ProductsData Center SwitchingData Center SecurityA

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID40HPC in Manufacturing  Large clusters have been deployed with Infin

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID41HPC in Energy Sector Seismic Processing for Oil Exploration is a k

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID42HPC in Academia & Research Labs Large “Petascale” Systems10,00

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID43HPC Applications: InfiniBand Storage for Lower Cost and Higher I/O

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID44Enterprise HPC switch features Enterprise class management feature

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID45Server Virtualization?What is VFrame™ Cisco’s data center-wide vir

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID46Three Categories of Server Virtualization Virtual Machine: Splits

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID47Compute Networking and Virtualization —How Does It Work?Virtual Ser

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID48Current Enterprise Server Provisioning SysAdmin racks new serverLoa

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID49VFrame Enterprise Service ProvisioningVFrame net-boots the server t

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID5InfiniBand Overview Standards-based interconnect (since 2001) Chan

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID50CSM Load BalancerServersVFrame identifies right App / OS ImageFrom

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID51VFrame Benefits Manage the data center from a service-oriented, ap

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID52Cisco HPC and Top Tier Server Vendors Cisco has built relationship

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID53InfiniBand – Who uses it today?1. Oracle database used for billing

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID54Case Study: Large Wall Street BankEnterprise Grid Computing Applic

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID55Oracle RAC 10g: Scope of IB BenefitsSniffer Servermonitori ng/analy

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID56Bio-Informatics Cluster:1,066 Node SupercomputerFault Tolerant Core

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID57Sandia National Labs – 4600 Nodes Cluster Application: High Perfor

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID58Key Takeaways Cisco provides most complete HPC solution encompassi

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID59

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID6InfiniBand Bandwidth

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID7Where to use Infiniband? Cost-Effective 10 Gbps to the Server/Deskt

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID8Distributed Applications & Systems Networking High-Performance

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID9Architecture of an InfiniBand Solution