簡潔大方ppt模板

2023年11月MonitoringandEvaluatingODAThispresentationwillcoverWhymonitor?Whyevaluate?MonitoringintheWorldBank,othermulti-lateraldevelopmentbanks,bilateraldonorsEvaluationintheWorldBank,othermulti-laterals,bilateraldonorsWhatismonitoring?Definitionofmonitoring:acontinuousprocessthatusessystematiccollectionofdataaboutprogressinanon-goingdevelopmentproject,forusebymanagersandother

stake-holdersWhymonitor?Toimproveimplementationofon-goingprojects;mustprovidepracticalinformationToassesswhetherdevelopmentobjectiveslikelytobemetToidentifysystematicissuesandrisksacrossprojects,bycountry,bysector,andoverallToprovideinputforexpostevaluationWhatisEvaluation?Definitionof(expost)evaluation:assessmentofacompletedproject,program,orpolicy,itsdesign,implementation,andresults.Whyevaluateandwhocares?Why?Tworeasons:TolearnfromexperienceToprovideaccountabilityWhouses(orshoulduse)evaluations:BoardsofDirectors(MDBs)andMinistersandDirectorsGeneralforoversight;ODAmanagersforpoliciesandstrategies;ODAstaffforprogramandprojectdesigns,waysofdoingbusiness;Clientcountries,externalpartners,andthepublicforpolicies,aligningprograms,researchM&EincontextWorldBankcommits/disburses$20-23billion/year;Approves~280loansandcredits/year;activeloanportfolio:~1,400in>120countriesBankalsoprovidesgrantsandothernon-lendingservices(diagnosticwork)Bankhastotaladministrativebudgetof$2billionMostotherMDBscommit$1–6billion/yearBilateralODA:$200million(Greece,Luxembourg,NewZealand,Portugal)-$25billion/year(USA)Bilateralagencieshaveadministrativebudgetsof$11million(Luxembourg)to>$700million(Japan)MonitoringintheWorldBankEveryon-goinglendingoperationismonitoredbyvisitsfromBankstaffabouttwiceayear;Implementationstatusandresults(ISR)reportissuedtwiceeachyear:ProgressonimplementationProgressinmeetingdevelopmentobjectivesProblemprojectsidentifiedPortfolioatriskreports–separatemethodology–updatedmonthlyOtherqualitycontrolactivitiesincludequalityatentryreviews;qualityofsupervisionEvaluation:thetopicsSelfevaluationIndependentevaluation:whyitmattersTools:projects;sectors;countries;etc.Coverage:howmanyevaluationsResources/budgetMainchallengeforevaluationDisclosureOtherEvaluationIssuesSelf-EvaluationintheBankSelfevaluationintheBank:Everyprojecthasanimplementationcompletionreport,donebystaffofresponsibleunit(about280/year)Everynewcountryassistancestrategynowhascompletionreportcoveringpreviouscountryassistancestrategy,donebystaffofresponsibleunit(about20/year)Self-evaluationinotherdonorsMulti-lateralinstitutions:almostallMDBshaverequirementforself-evaluation,althoughinsomeMDBs(AsianDB,EBRD,EIB),theevaluationdepartmentisinvolvedBilateraldonors:somerequireforprojectsovergivenvalue,othersdon’t;SDC(Swiss):externalevaluatorsdoself-evaluation;GTZ(German)hasinnovativeeVAL(electronic)system.IndependentevaluationWhatisindependence?Theextenttowhichtheevaluationunit:ReportsdirectlytoaBoardorothergoverningunit;Hasstaff,budget,andfunctionsindependentfrommanagement;notinvolvedwithmanagementofODABehavesindependentlybyissuingobjective,impartial,andbalancedreportsIndependentevaluationIntheWorldBank,independentevaluation,since1973,haslookedlikethis:BoardofDirectorsInstitutionalIntegrityPresidentPaulWolfowitzIndependentEvaluationGroupInternalAuditingSVP&ChiefEconMDOperationsCFOSVP&GenCounselInspectionPanelMDOperationsIndependentevaluationInbilateraldonors,independentevaluationhasevolvedtolooklikethis:MinistryofForeignAffairs

EvaluationUnitDirectorGeneralAidagencyOperationalunitOperationalunitOperationalunitIndependentevaluationWhyindependencematters:Allowsforobjective,unbiasedevaluationsEvaluationfindingsarenottailoredtomanagement’swishesIndependencelendscredibilitytofindingsIndependencedifficulttoachieveandmaintainEvaluationTools:WorldBankProjectevaluationsImplementationCompletionReport(ICR)reviewsProjectperformanceassessmentreviews(PPARs)CountryevaluationsCASCompletionReport(CASCR)ReviewsCountryassistanceevaluations(CAEs)Sector,thematic,globalevaluationsProcessevaluationsCorporateevaluations(ARDE,AROE)EvaluationTools:interactionsSynergiesamongdifferentevaluationtoolscanprovidevaluableinputGlobal(Globalprograms)EvaluationtoolsintheWorldBankCorporate(ARDE)Sector(finance,education)Thematic(gender,decentralization)Process(PRSP)CountryAssistanceEvaluation

CASCRReview

CASCRReviewICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewCountryAssistanceEvaluationICRReview(validationofself-evaluation)ProjectPerformanceAssessmentReviewProjectlevelCountrylevelSector,thematic,policylevelGlobalandcorporatelevelEvaluationCoverage:WorldBankEvaluationcoverageInmostMDBs,fullrangeofevaluations:project,country,sector,thematicevaluationsInmostbilaterals,fewprojectevaluations;somecountrylevel;mostfocusonthemesorprogramsMostbilateralsproduces3-10evaluations/yearDFIDproduces20-25reports/yr;PotentialweaknessofcountryandthematicevaluationswithoutunderpinningsofprojectevaluationstouseasinputResourcesforevaluation:MDBsResourcesvary,butaspercentoftotaladministrativebudget,fairlysimilar:

Resourcesforevaluation:bilateralsBilateraldonoragenciesaremorelikelytohireexternalconsultantsforvirtuallyallevaluations(UK,Norway,Denmark,Switzerland,Australia)Basedonnumbersfromafewbilaterals(DFID,NORAD,SDC),evaluationbudgetis~2%oftotaladministrativebudget;figuresof0.5–2%havebeencitedbyothers.Smallerdonors(Greece,NewZealand)arestillsettinguptheirevaluationunitsMainchallengeforevaluationHowtomakeevaluationsusefulMostmanagers,stafffocusedonfuture,notonpastEvaluationmust/shouldbe:TimelyOperationallyrelevant:avoidgeneralizations,platitudesEasilyaccessible:avoidlongreportsConstructive:goodpracticeshouldberewardedWidelydisseminatedanddisclosedDisclosureofevaluationreportsWorldBank:publicdisclosureofall:PPARsCAEsSector,thematic,globalevaluationsProcessevaluationsCorporateevaluationsEBRD,ADB:selectivepublicdisclosure:evaluationsinvolveprivatesectorBilaterals:majoritydisclose,butvaries:UK,Norway–fulldisclosure;Germany–selectivedisclosureDisclosureForWorldBank:reportsandinformationonevaluationtools,approaches,onwebsite:andscrolldowntoright-hadsideofhomepage,or:Forotherdonors:checktheirwebsitesOtherissuesinevaluationEvaluationapproachUseofperformanceindicatorsSourcesofinformationRatingsProcessesPartnershipsOtherchallengesEvaluationApproachWithincontextofresults-basedmanagement,Bankusesobjectives-basedapproach,focusonoutcomesandimpactBankloans;grants;diagnosticwork;dialoguePhysicaloutputs;privatization;newlaws;agencycreated;trainingcompleted;sub-loansdisbursed.Moreefficientoperations;betterfiscalmanagement;employment

creation;betteraccesstoservices;InputsOutputsExogenousfactorsExogenousfactorsOutcomeImpactLonger-termobjective,likepovertyreduction,bettereducational,healthoutcomesEvaluationApproachBankassesses:Outcome(relevance,efficacy,efficiency)Useofperformanceindicatorsforoutputs,outcomes,impactRisktoDevelopmentBankandBorrowerPerformanceSourcesofinformationforevaluationBaselinedatainprojectappraisaldocuments(sometimes)MonitoringreportsshouldhaveinformationonperformanceindicatorsDatabasesforprojectarea;sector;countryatbeginningofproject,endofprojectOthercountry-levelindeces(IMFfinancialstatistics,DoingBusinesssurveys;WorldBankIndicatorsofcorruptionsurveys;UNDPhumandevelopmentindicators)SurveysInterviews,focusgroups UseofRatingsWorldBankusesratingsonprojectoutcomesandoutcomesofcountryassistance.Noratingsonsector,thematic,otherevaluationsOtherMDBsuseratingsforprojectoutcomes;notforcountryassistanceBilaterals:someuseratings,onlyforprojects;somedonotuseanyratingsEvaluationApproach:ratingsProjectRatingsinWorldBank:Outcomes:6pointscale(HS-HU)RiskstoDevelopment:4pointscale(H-N)BankandBorrowerperformance:4pointscale(HStoHU)ProsandconsofratingPro:providesdataandaccountabilityCon:takesfocusawayfromlessonlearningandrichnessofevaluationProcessesIndependencedoesnotmeanisolationMDBsandbilateraldonorsincorporatecommentsfromoperationalmanagersandstaffandfromstakeholdersincl