NVMe SSD Classification White Paper（英文）行業(yè)資料

RevisedFebruary2023

NVMeSSDClassification

CameronBrett

MarkCarlsonSNIACMSISolidStateDriveSpecialInterestGroup

NVMeSSDClassification

ii?SNIA.AllRightsReserved.

TableofContents

Introduction

1

EnterpriseServer

1

Applications/UseCases

1

FormFactors

1

Power

1

Performance

1

Latency

2

Endurance

2

Capacity

2

Management

2

Features

2

EnterpriseStorage

2

Applications/UseCases

2

FormFactors

2

Power

3

Performance

3

Latency

3

Endurance

3

Capacity

3

Management

3

Features

3

LowLatencySSDs

4

Applications/UseCases

4

FormFactors

4

Power

4

Performance

4

Latency

5

Endurance

5

Capacity

5

iii?SNIA.AllRightsReserved.

Management

5

Features

5

DataCenter/HyperscaleServer

5

Applications/UseCases

6

FormFactors

6

Power

6

Performance

6

Latency

6

Endurance

6

Capacity

6

Management

7

Features

7

DataCenter/HyperscaleStorage

7

Applications/UseCases

7

FormFactors

7

Power

7

Performance

7

Latency

8

Endurance

8

Capacity

8

Management

8

Features

8

NVMeSSDClassification

1of12?SNIA.AllRightsReserved.

Introduction

NVMExpresstechnologyisdrivingthenextgenerationofSSDsfordatacenters.NVMe?SSDsarenotlimitedbylegacyformfactorsorprotocols,andtheycanbetteraddresstheneedsofserversandstorageinenterpriseandhyperscaledatacenters.WiththevariedanddedicatedusecasesforNVMeSSDs,therearetwoclassificationsthatgenerallydefineandsegmenttheseclasses:Enterpriseand

DataCenter.

ThiswhitepaperdescribesusecasesforNVMeSSDsusedinenterpriseservers,enterprisestorage,lowlatencySSD,datacenter/hyperscaleservers,anddatacenter/hyperscalestorageenvironments.Eachoftheseusecaseshasdistinctrequirementsandapplicationenvironments,whicharecoveredinrequirementsforformfactors,power,performance,latency,endurance,capacity,management,andfeatures.Therewillalwaysbeexceptionstotheseguidelines,butthesearegenerallyfitprofilesforNVMeSSDclassification

ThepaperisdesignedasacompaniontotheNVMeSSDClassificationtableontheSNIA.orgwebsiteat

/technology-focus-areas/physical-storage/nvme-ssd-classification

.

EnterpriseServer

Anenterprisecomprisesallaspectsofanorganization’sassets,systems,services,andfunctions.Aserverisan

intelligentdevice

,usuallyacomputer,thatprovidesservicestootherintelligentdevices,usuallyothercomputersorappliances.SomerecentexamplesofenterpriseserversareDellEMCPowerEdge,HPEProLiant,andLenovoThinkServers.

Applications/UseCases

Standaloneorrackserversandtheirapplicationsarecommonlyused.ExampleapplicationsincludeOnlineTransactionalProcessing(OLTP),whichisI/Ointensive;andlargeblock,whichincludesimagesandvideofilesaswellasmulti-serverenvironments,suchasclusterservers.

FormFactors

FormfactorsforNVMeSSDsinenterpriseserverenvironmentsincludeM.2transitioningtoE1.Sforboot,2.5-inch(U.2),E3.S,andE3.Lfordataandcaching.Moreinformationonformfactorscanbefoundat

/forums/cmsi/knowledge/formfactors

Power

PowerrequirementsforNVMeSSDsinenterpriseserversare8.25-11WforM.2,12-25Wfor2.5-inch(U.2),and25-40WforEDSFF.

Performance

PerformanceforNVMeSSDsinenterpriseserverstypicallyareamongthehighestavailablewiththelowestlatencies.ItiscommontoneedboththehighestInput/Outputoperationspersecond(IOPS)andthroughputsincevirtualizedenvironmentstendtohaveamixofIOPSandthroughputdemands.

2of12?SNIA.AllRightsReserved.

Latency

Inenterpriseservers,lowlatencyisimportant,especiallyforI/Ointensiveapplicationswherethelowerlatencythebetter.Qualityofservice(QoS)isnotasimportantaslowestlatencypossible.

Endurance

Inenterpriseserverenvironments,lookforoneDriveWriteperDay(DWPD)forread-intensiveenvironments,threeDWPDformixed-useenvironments,andfivetotenDWPDforwrite-intensiveenvironments.

Capacity

TypicalcapacityforNVMeSSDsinenterpriseserverenvironmentsare1-15.36TB.

Management

Enterpriseserversareplacedinenvironmentswherethecustomercontrolswhatsoftwareisrunningontheirserver.Theydeployabaseboardmanagementcontroller(BMC)tomanagetheserverdevicesoveraninternalmanagementbus.Managementofstorageattachedonanetworkneedstotakeplaceonthesamenetwork,asitistheonlyconnectiontothedevice.InanenvironmentwithNVMeSSDsamanagementproductusingSNIASwordfishTMshouldbeused.ASNIASwordfishclientwouldmanagethestoragethroughtheBMC’sexternalinterface.

Features

TypicalfeaturesfoundinNVMeSSDsinenterpriseserverenvironmentsaresecurity/encryption,manageability,single-port,andRAID.

EnterpriseStorage

Enterprisestorageenvironmentscontaincentralizedrepositoriesforbusinessinformationthatprovidecommondatamanagement,protection,anddatasharingfunctionsthroughconnectionstocomputersystems.

Applications/UseCases

Traditionalstorageboxesarecommonlyusedinenterprisestorage.Applicationsincludeall-flasharrayswhereNVMeSSDsareusedforbothcacheaswellasdatastorageconnectedbyatraditionalStorageAreaNetwork(SAN)orNVMe-over-Fabrics(NVMe-oF).

FormFactors

ExampleFormfactorsforNVMeSSDsinenterprisestorageenvironmentsinclude2.5-inch(U.2),E3,

andE1.Moreinformationonformfactorscanbefoundat

/forums/cmsi/knowledge/formfactors

3of12?SNIA.AllRightsReserved.

Power

PowerrequirementsforNVMeSSDsinenterprisestorageare8.25-11WforM.2,12-25Wfor2.5-inch(U.2),and25-40WforE3andE1.

Performance

PerformanceforNVMeSSDsinenterprisestoragetypicallyareamongthehighestavailablewiththelowestlatencies.ItiscommontoneedboththehighestInput/Outputoperationspersecond(IOPS)andthroughputsincevirtualizedenvironmentstendtohaveamixofIOPSandthroughputdemands.

Latency

Forenterprisestorage,QualityofService(QoS)orconsistentlatencybecomesmoreimportantasmoreapplicationsusethestorage.Lowerlatencyisbetter,butreliableandconsistentlatencyiscritical.

Endurance

Inenterprisestorageenvironments,lookforoneDriveWriteperDay(DWPD)forread-intensiveenvironmentsandthreeDWPDformixed-useenvironments.

Capacity

TypicalcapacityforNVMeSSDsinenterprisestorageenvironmentsare1.92-30.72TB.

Management

Liketheenterpriseserverenvironment,enterprisestoragemaybemanagedthroughaBMCattachedtoacontroller.ThisBMCmaybethepointofmanagementforalltheNVMeSSDdrives.ThenetworkconnectionalsoallowsahosttomanagethestoragethroughSwordfish,andtheBMCthroughtheNVMeManagementInterface(NVMe-MI).SNIASwordfishmayalsobeusedtomanagemultiplestoragesystemsinadatacenter.

Features

TypicalfeaturesfoundinNVMeSSDsinenterprisestorageenvironmentsaredual-portx8/16PCIeAIC,higherprices(greaterthanSANs)andcapacitiesupto30.72TB.

4of12?SNIA.AllRightsReserved.

LowLatencySSDs

LowlatencySSDscanfulfillthenichewherepersistentmemoryistargeted,sittingbetweenDRAMand

Flashinthecost/performance“pyramid”.

Theyareusuallyaccessedbyinfrastructuresuchascaches,filesystems,hypervisorsandoperating

systems.

Applications/UseCases

ApplicationsinlowlatencySSDenvironmentsincluderead/writecache;tier0betweenDRAMandTLCSSD;writeintensiveworkloads;writelogging(metadata);lowlatencySSDplusQLC–lowerTCOthan

TLC.

FormFactors

ExampleFormfactorsforNVMeSSDsinlowlatencySSDenvironmentsinclude2.5-inch(U.2)andaddincards(AICs).Moreinformationonformfactorscanbefoundat

/forums/cmsi/knowledge/formfactors

Power

PowerrequirementsforNVMeSSDsinlowlatencySSDenvironmentsare20-25Wfor2.5-inch(U.2),and9WforAIC.

Performance

NVMeSSDsinlowlatencySSDenvironmentsareusedinhighperformance,writeheavyworkloadsforbestinclassperformance.

5of12?SNIA.AllRightsReserved.

Latency

ForlowlatencySSDs,latencyis1/10thto1/3thelatencyofTLCSSDs.

Endurance

InlowlatencySSDenvironments,lookfor30,60,or100DriveWritesperDay(DWPD).

Capacity

TypicalcapacityforNVMeSSDsinlowlatencySSDenvironmentsare375-3200TB.

Management

Liketheenterpriseserverenvironment,lowlatencySSDsmaybemanagedthroughaBMCattachedtoacontroller.ThisBMCmaybethepointofmanagementforalltheNVMeSSDdrives.ThenetworkconnectionalsoallowsahosttomanagethestoragethroughSwordfish,andtheBMCthroughtheNVMeManagementInterface(NVMe-MI).SNIASwordfishmayalsobeusedtomanagemultiplestoragesystemsinadatacenter.

Features

TypicalfeaturesfoundinNVMeSSDsinenterprisestorageenvironmentsaredual-port(2.5-inchformfactor),predictablelowlatency,andveryhighendurance.

Illustration:LowLatencySSDDrive-FLSeriesSSD,withXL-FLASH?memory,ina2.5"15mmZ-heightformfactor.(courtesyofKIOXIA)

DataCenter/HyperscaleServer

Largedatacentercustomersareknownashyperscalers.NearlyallofthesecustomersbuildtheirownstoragesystemsusingSoftwareDefinedStorage(SDS)andcommoditycomponents,assembledinracks.Hyperscaleserversareincludedinthesesystems.

6of12?SNIA.AllRightsReserved.

Applications/UseCases

NVMeSSDsareusedtoboottheserverssecurely(i.e.,M.2)andsupportthemasterbootblockfeatureforthispurpose.Thedrivesinaclouddatastoragesystemarealsodirectattachedbutexportedviasoftwaredefinedstorage.

FormFactors

Differentformfactorshavedifferentrangesofpowerrequirements.HyperscalersareworkingwiththenewE1.Sformfactor(s)becauseofthedensitiesallowed.Hyperscalerscanandhavealsobeenusing

M.2andU.2.Moreinformationonformfactorscanbefoundat

/forums/cmsi/knowledge/formfactors

Power

PowerrequirementsforNVMeSSDsindatacenter/hyperscaleserverare8.25-11WforM.2,12-25WforE1.S,and12-25WforU.2.

Performance

HyperscalerenvironmentswanttoseeconsistentlatencyperformanceandmakesuredrivesscaletheirIOPSperformancewithincreasingcapacity.Becausetheycontrolthesoftwareimplementingthestoragesystem,theycantunetheperformancetothedrives’capabilities.

Latency

Taillatenciesarethoseoperationswhichtakemuchlongerthantheaverage.Thisissuecausesproblemsforupperlayersofthestackwaitingforthatlastcompletion.Thisshowsthroughtothehyperscalers’customersaslongpageloads.NewfeaturesofNVMeprovidemeansbywhichtominimizeoreliminatetaillatency.OneofthecriticalcriteriafordatacenterSSDsisconsistentandreliablelatency,toensurepredictableperformance.

Endurance

Enduranceisthekeyfeatureforhyperscalerenvironments.Theycreatedatacentersandwantthecomponentsofthatdatacentertolastuntiltheybuildadatacentertoreplaceit.Theamountofdatatypicallywrittenduringasingledayisequaltoitscapacity.OneDrivewriteperday(DWPD)isthemostcommonendurance.

Capacity

TypicalcapacityforNVMeSSDsindatacenter/hyperscaleserverenvironmentsare1-4TBin2021.

7of12?SNIA.AllRightsReserved.

Management

HyperscalersruntheirownsoftwareontheirserversandcanthereforeusehostagentsviaNVMeCommandLineInterface(NVMe-CLICLI)andscripting.WhilehyperscalerserversmayhaveaBMC,theBMConlyhandlesminimalpowerandcoolingmanagement.MinimalsupportforNVMe-MIbasicisallthatisneeded.

Features

Hyperscalershandleredundancyandavailabilityattheupperlayersoftheirownsoftware.Therefore,theydonotneedcomponentswith“nosinglepointoffailure”.Thismakesthecomponentscheaperwhentheyhavemultiplecopiesofthedataelsewhere.Thequalityofserviceforreadsiskeyinreducingtaillatency.NVMenewfeaturesofNVMSetsandI/Odeterminism(IOD)alsosupportQoS.DatacenterclassSSDsforserversaretypicallysingle-port.

DataCenter/HyperscaleStorage

LargedatacentercustomersareknownasHyperscalers.NearlyallofthesecustomersbuildtheirownstoragesystemsusingSoftwareDefinedStorage(SDS)andcommoditycomponents,assembledinracks.

Applications/UseCases

HyperscalersarenowmovingtodeployingJBOF/EBOFsystemswithdrivesnetworkattachedtothehost,creatingadisaggregatedcompute,storageandnetworkenvironment.Thisallowsthestorageandservercapacitiestoscaleseparately.ITalsoimprovesdensity.Thesystemsoftwarethatprovidesstorageisevolvinginthisdirectionaswell.

FormFactors

Withtheevolutionofnewenterprisestoragefeatures,newformfactorssuchastheE1.LandE1.Sareappearingintheseexternalchassis.BothdensityandamatchingbetweenCPUpowerandSSDcapabilityisneededandwillneedtoaccommodatenewtechnologies.

Power

Theaddedpowerallowedintheseformfactorsisincreasingbothperformanceanddensity.

Performance

NVMeSSDsofferperformanceforIOPS/TBscalingandmixedworkloads.Performancetendsnottobeashighasenterprisebutrequireconsistentandpredictableperformance.

8of12?SNIA.AllRightsReserved.

Latency

Fordatacenter/hyperscalestorage,readprioritizationismostimportantwithoutlongtails.Aswithperformance,consistencyandpredictabilityiscriticalforhyperscaleapplicatio