軟件性能測(cè)試與LoadRunner

國(guó)家信息中心軟件評(píng)測(cè)中心性能測(cè)試培訓(xùn)LoadRunner性能測(cè)試工具實(shí)踐目錄性能測(cè)試概述性能測(cè)試工具Loadrunner性能測(cè)試標(biāo)準(zhǔn)國(guó)際標(biāo)準(zhǔn)（IETF）RFC2544《網(wǎng)絡(luò)互聯(lián)設(shè)備基準(zhǔn)測(cè)試方法》RFC1242《網(wǎng)絡(luò)互聯(lián)設(shè)備基準(zhǔn)測(cè)試術(shù)語(yǔ)》RFC3511《防火墻性能基準(zhǔn)測(cè)試方法》RFC2647《防火墻性能基準(zhǔn)測(cè)試術(shù)語(yǔ)》國(guó)家標(biāo)準(zhǔn)GB/T16260《信息技術(shù)軟件產(chǎn)品評(píng)價(jià)質(zhì)量特性及其使用指南》GB/T17544《信息技術(shù)軟件包質(zhì)量要求和測(cè)試》其他SEI負(fù)載測(cè)試計(jì)劃過程RBI方法PTGM性能測(cè)試模型（《軟件性能測(cè)試過程詳解與案例剖析》）性能測(cè)試指標(biāo)吞吐量ThroughputGoodPutLR中的吞吐量一些性能測(cè)試書籍中的吞吐量響應(yīng)時(shí)間（延遲）ResponsetimeLatency并發(fā)連接數(shù)新建連接數(shù)傳輸層性能指標(biāo)Connections/connections/s并發(fā)事物數(shù)（transactions）新建事物數(shù)（TPStransactions/s）Bit/s并發(fā)用戶數(shù)系統(tǒng)用戶在線用戶并發(fā)用戶性能測(cè)試工具測(cè)試儀表SmartBits（2-3層性能測(cè)試）Avalanche&reflector（4-7層性能測(cè)試）商用測(cè)試工具HPLoadRunerIBMPerformanceTesterBorlandsilkperformaner免費(fèi)測(cè)試工具WebApplicationStressToolwebload開源工具OpenSTAJmeter第一節(jié)LR簡(jiǎn)介L(zhǎng)oadRuner簡(jiǎn)介5.Analyzedataand

pinpointsbottlenecks1.Recorduserinteractionsagainstclientapplicationintotestscript2.TurnscriptsintoVirtualUsersbyaddingtestdataanduserbehavior3.RunVirtualUserstogenerateload4.Monitorsystemperformanceduringloadtest性能測(cè)試一般流程LoadRunner的框架LoadRunner支持的企業(yè)環(huán)境Web:HTTP(S)SOAPWinsockFTPDNSRealMSMediaWAPiModeVoiceXMLPalmLDAPDatabases:OracleMSSQLServerDB2SybaseInformixODBCMiddleware:EJBsCORBACOMRMIJacadaBrokatTUXEDOMQSeriesPlatforms:WinNT/2000WinXPSunHPIBMLinuxERP/CRM:OracleApps.

SAPSiebelPeopleSoftClarifyLegacy:32705250VT100MailingServices:SMTPPOP3IMAPMAPIScriptingLanguages:C,Java,JavaScript,VBScript,VBA,C#,C++Browsers:IE

4.x-6.0Netscape4.x-6.xLoadRunner的實(shí)現(xiàn)方法LoadRunnerisacompletesolutiontoconductautomatedloadtestingbefore,during,andafterapplicationdeployment.

LoadRunnerallowsyouto...ScaleIdentifyDiagnosetheapplicationtoapredeterminedcapacity.businessprocesses

orsystemcomponentshavingtrouble.aproblemtopinpointtherootcause.LoadRunner組件腳本生成器：可錄制或編寫腳本，驗(yàn)證腳本的正確性VuGencontrollerAnalysis控制器：控制和執(zhí)行場(chǎng)景，協(xié)調(diào)負(fù)載生成器實(shí)現(xiàn)大用戶量的并發(fā)，并收集結(jié)果。分析器：實(shí)現(xiàn)結(jié)果數(shù)據(jù)的整理，并提供結(jié)果圖和報(bào)告，提供一些分析圖的工具。LoadRunner測(cè)試團(tuán)隊(duì)Tweak

SystemBasedonAnalysisPlanLoadTest1CreateVirtualUsers2ScenarioCreation3ScenarioExecution4ResultsAnalysis5LRExpertFunctionalExpertProjectManagerLRExpertFunctionalExpertProjectManagerLRExpertLRExpertSysAdminServerExpert(s)SysAdminServerExpert(s)LRExpert第二節(jié)性能測(cè)試規(guī)劃性能測(cè)試規(guī)劃在創(chuàng)建腳本之前要進(jìn)行充分的規(guī)劃PlanLoadTest1CreateVirtualUsers2ScenarioCreation3ScenarioExecution4ResultsAnalysis5Goals,businessprocesses,

usertype,userbehaviors,input

data,systemprofiling,

scenariodesign,andLoadRunner

installation規(guī)劃階段的內(nèi)容建立負(fù)載測(cè)試的目標(biāo)制定出可以用數(shù)量衡量的目標(biāo)標(biāo)準(zhǔn)分析被測(cè)系統(tǒng)的業(yè)務(wù)運(yùn)行狀況確定要錄制哪些商業(yè)流程(businessprocesses)確定業(yè)務(wù)高峰的負(fù)載情況和時(shí)間把需要測(cè)試的BP的操作步驟形成正式文檔準(zhǔn)備測(cè)試數(shù)據(jù)收集系統(tǒng)的技術(shù)信息確定系統(tǒng)的架構(gòu)確定系統(tǒng)各部件的軟件情況，使用什么樣的數(shù)據(jù)庫(kù)服務(wù)器？Web服務(wù)器？以幫助我們?cè)诤侠淼臅r(shí)間內(nèi)確定系統(tǒng)瓶頸第三節(jié)測(cè)試腳本開發(fā)測(cè)試腳本開發(fā)方法錄制腳本手工編寫腳本腳本錄制運(yùn)行VuGen，創(chuàng)建新的腳本選擇業(yè)務(wù)系統(tǒng)對(duì)應(yīng)的網(wǎng)絡(luò)協(xié)議，比如Web系統(tǒng)對(duì)應(yīng)HTTP/HTML;設(shè)定錄制選項(xiàng)RecordingOptions開始錄制進(jìn)行正常的業(yè)務(wù)流程的操作當(dāng)業(yè)務(wù)操作完畢后，按StopRecording將錄制結(jié)束保存腳本錄制選項(xiàng)

RecordingBrowserRecordingProxyAdvancedCorrelation腳本的目錄結(jié)構(gòu)C:\web_project-Scripts--Action1.cvuser_init.cvuser_end.cLab1Script2.usrAssoonasthescriptissaved,thesearethefoldersthatyouwillseeLab1Script2Run-timeSettingsRunLogicPacingLogThinkTimeMiscellaneousSpeedSimulationBrowserEmulationProxyPreferencesContentCheckAvailableforallprotocols.SpecifictoWeb.常用的調(diào)試腳本的工具TestResultswindowExecutionLogSnapshotResultswindow

PageViewServerResponseClientRequestRun-TimeViewer在Web腳本中使用多個(gè)ActionWeb腳本中使用多個(gè)Action使用多個(gè)Action的典型的例子如何把不同的操作錄制在多個(gè)Action中注意設(shè)定好開始和結(jié)束狀態(tài)根據(jù)測(cè)試的目標(biāo)來確定腳本的Action增強(qiáng)腳本事物點(diǎn)（transaction）參數(shù)化檢查點(diǎn)集合點(diǎn)關(guān)聯(lián)事物點(diǎn)（transaction）什么是transactionTransaction測(cè)量的內(nèi)容Transaction的狀態(tài)LR_AUTO/LR_PASS/LR_FAIL/LR_STOPTransactions中的思考時(shí)間如何處理？Transactions的相關(guān)設(shè)定簡(jiǎn)單演示參數(shù)化參數(shù)化的概念為什么要引入?yún)?shù)化什么時(shí)候需要參數(shù)化如何參數(shù)化輸入數(shù)據(jù)參數(shù)化類型參數(shù)選擇策略和參數(shù)更新策略參數(shù)化的一個(gè)技巧：如何突破參數(shù)顯示白條限制修改C:\windows\vugen.ini中的ParamTable選項(xiàng)中的MaxVisibleLines=100的值參數(shù)化演示檢查點(diǎn)checkpoint什么是檢查點(diǎn)為什么要設(shè)置檢查點(diǎn)檢查點(diǎn)函數(shù)Web_find（）Web_reg_find（）檢查點(diǎn)演示關(guān)聯(lián)的基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@12345)1.Login

UserNamejojoPasswordbean

2.Yoursessionid@@@12345

3.Requestforproductinfo

4.ProductinfofoundResponseProductinfoVuGenScriptRequestforproductinfo(SessionID@@@12345)腳本錄制過程關(guān)聯(lián)基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@23456)1.Login

UserNamejojoPasswordbean2.Yoursessionid@@@12345

3.Requestforproductinfo4.ProductinfofoundResponseERRORSessionID12345hasexpiredLoginagaintogetproductinfoVuGenScriptRequestforproductinfo(SessionID@@@12345)腳本回放過程關(guān)聯(lián)基本概念WebServerLogin(UserNamejojoPasswordbean)Response(SessionID@@@23456)Requestforproductinfo(<SessionID@@@23456>)ResponseHereistherequestedproductinfo1.……2.Your<session_id>3.……4.………CorrelatedVuGenScript解決方案關(guān)聯(lián)過程自動(dòng)關(guān)聯(lián)創(chuàng)建關(guān)聯(lián)規(guī)則手動(dòng)關(guān)聯(lián)Web_reg_save_paramLr_save_param手工腳本開發(fā)什么時(shí)候需要手工開發(fā)腳本手工開發(fā)腳本的方式通過LR自身的函數(shù)編寫腳本通過對(duì)應(yīng)開發(fā)語(yǔ)言編寫腳本（C語(yǔ)言、JAVA、VB）手工創(chuàng)建腳本演示手工創(chuàng)建一個(gè)FTP上傳文件的腳本手工創(chuàng)建一個(gè)JAVA的腳本第四節(jié)場(chǎng)景設(shè)計(jì)目標(biāo)了解場(chǎng)景設(shè)計(jì)場(chǎng)景Runtimesetting（運(yùn)行設(shè)置）性能監(jiān)控器（PerformanceMonitors）什么是場(chǎng)景scriptsrun-timesettingsloadgeneratorsreal-timemonitorsvirtualusersElementsofaScenarioScenarioAscenarioisafilethatdefineswhichVuserstoexecute,thenumberofVuserstorun,thegoalsofthetest,whichcomputerhoststheVusersandtheconditionsunderwhichtoruntheloadtest.兩種類型場(chǎng)景的比較ManualScenariomainpurposeistolearnhowmanyVuserscanrunconcurrentlygivesyoumanualcontroloverhowmanyVusersrunandatwhattimesGoal-OrientedScenariogoalmaybethroughput,responsetimeornumberofconcurrentVusersLoadRunnermanagesVusersautomatically如何選擇兩種類型的場(chǎng)景ScenarioOutlineScenarioTypeManualscenariowith1,000concurrentVusersScriptshoulddefine‘Update’

Whenrunningtheloadtestatpeakload,achieve1,000concurrentusersGoal-OrientedscenariowithTransactionResponseTimeasthe‘GoalType’Scriptshoulddefine‘Search’

TransactionWhenrunningtheloadtestduringnon-peakhoursachieveresponsetimeof8secs.with2,000concurrentusersWhenrunningtheloadtestinpeakhoursachieveresponsetimeof12secswith5,000concurrentusersRuntimesettingRunLogicPacingLogThink-TimeMiscellaneousDEMO：如何進(jìn)行測(cè)試Transactions不能說明一切Transactionsmeasurethetimerequiredforabusinessprocess.Theperformanceoftransactionssuggestsapictureofthesystemcomponent’sbehavior.Transaction:searchExercisestheWeb,application

anddatabaseserver Thistransactionperformed

poorlywitharesponsetimeof30seconds.Transaction:buyExercisestheWeband

applicationserver Thistransactionperformed

asexpectedwitharesponse

timeof1min.性能監(jiān)控（PerformanceMonitors）性能指標(biāo)監(jiān)控基本設(shè)置系統(tǒng)資源監(jiān)控Internet/IntranetDatabaseserverAppserversWebserversClients場(chǎng)景設(shè)計(jì)常見問題如何突破Controller可用腳本五十條限制修改Max_num_of_scripts的值（LR8.0中可以設(shè)置）8.1中沒有這個(gè)選項(xiàng)如何在命令行下啟動(dòng)Controller如何解決由于設(shè)置引起的運(yùn)行失敗問題幾種不同超時(shí)的處理方法DEMO：?jiǎn)栴}解決演示第五節(jié)測(cè)試執(zhí)行執(zhí)行Scenario之前的準(zhǔn)備工作AddperformancemonitorsinRuntab.Specifyalocationtosavethescenarioresultsanddecideonanamefortheresults.Establishrendezvouspolicies,ifany.測(cè)試執(zhí)行過程中的團(tuán)隊(duì)合作NetworkAdministratormonitorsnetworkperformancewhileloadtestisrunningDatabaseserverAppserversWebserversLoadtestengineermonitorstransactionperformanceAndservermonitorsviaLoadRunnerControllerApplicationorDatabaseAdministratormonitors

remotesystemperformance

duringloadtestScenarioExecution過程:DebugRunDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADSCALABILITY100%++LOADFULLLOAD100%Objective:VerifythatparameterizeddataworksunderconcurrentusageRun-timeSettings:Useextendedloganddatareturnedbyserverand

ignorethinktimesWhattolookfor:Noerrors.Thissignifiesthatyouarenowreadyto proceedwiththeloadtest ScenarioExecution過程:IsolateTopTimeTransactionsSCALABILITY100%++LOADFULLLOAD100%Objective:Isolatetransactionsthathaveperformanceproblems

irrespectiveofloadtofindifthereareanybottlenecksRun-timeSettings:UsestandardlogandignorethinktimeWhattolookfor:Theworstperformingtransactions.Thismightbein absolutetime(longest)oritmightbeagainst

somemeasurablegoal(2Xasslowasthetestobjective)DEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADScenarioExecution過程:FullLoadSCALABILITY100%++LOADObjective:VerifythatthesystemperformsasexpectedunderloadRun-timeSettings:TurnloggingoffandenablethinktimeWhattolookfor:CompareyourloadtestgoalstothetestresultsDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADFULLLOAD100%ScenarioExecution過程:ScalabilityTestObjective:Verifiestheloadlimitthatcanbehandledbeforemore

resourcesarerequired Run-timeSettings:TurnloggingoffandenablethinktimeWhattolookfor:Loadtestgoalshouldbeexceeded,and2Xresponse timeofyourfullloadtest(100%)shouldbeachievedDEBUGRUN3-5VusersISOLATE

TOPTIME

TRANSACTIONS20%LOADFULLLOAD100%SCALABILITY100%++

LOAD第六節(jié)結(jié)果分析哪里出現(xiàn)了問題?AppserversDatabaseserversWebserverAnylinkinthechainbetweenbrowseranddatabasecouldbethecauseofanapplicationfailureorperformancedeg