corpuslinguistics教學(xué)講解課件

CorpusLinguistics......1Whatisacorpus?Corpus(pl.corpora)Acollectionoftextsassumedtoberepresentativeofagivenlanguage,dialect,orothersubsetofalanguage,tobeusedforlinguisticanalysis.(Francis1982)...Whatisacorpus?Corpus(pl.c2Whatisacorpus?Threebasicknowledgeaboutcorpus:Alargeprincipledcollectionofnaturaltexts.naturaltexts:languagehasbeencollectedfromnaturallyoccurringsources.Abasicsourceofstoringlanguageknowledge.Onlyafterbeingprocessed,canitbeavailableresources....Whatisacorpus?Threebasick3Partone-Whatiscorpuslinguistics?Asameans-exploreactualpatternsoflanguageuseAsatool-developingmaterialsforclassroomlanguageinstructionAndalsouseslargecollectionsofbothspokenandwrittennaturaltextsthatarestoredoncomputers....Partone-Whatiscorpuslingu4Whatiscorpuslinguistics?Corpuslinguisticsisanapproachtoinvestigatelanguagethatischaracterizedbytheuseoflargecollectionsoftexts(spoken,writtenorboth)andcomputer-assistedanalysismethods....Whatiscorpuslinguistics?5ContributionsofcorpuslinguisticsOneofthemajorcontributionsofcorpuslinguisticsisintheareaofexploringpatternsoflanguageuse.Provideanextremelypowerfultool-theanalysisofnaturallanguageProvidetremendousinsights-howlanguageusevariesindifferentsituations...Contributionsofcorpuslingui6ThedevelopmentofcorpusIn1964,，thefirstcorpuswasbuiltbyAmericanBrownUniversity,storingonemillionwordsandcollectingeachstylesoflanguagesourcesofAmericanEnglish.In1978,BritainbuiltLOB(Lancaster-Oslo-Bergen),storingonemillionwordsandcollectinglanguagesourcesofBritishEnglish.In1980s,BirminghamUniversitybuiltBCET(BirminghamCollectionofEnglishTexts),storing7.3millionwordsandusingfordictionarycompilation.In1996,thestoragewasextendedto32millionwordsandwasrenamedasBE(BankofEnglish).In1980,COBUILD(CalLinsBirminghamUniversityInternationalLanguageDatabase)wasbuilt,includingBE,thestoragewasupto50millionwords(15millionspokencorpus)....ThedevelopmentofcorpusIn197Beforetheadventofcomputers:Imaginethatyouareinterestedinexploringtheuseofconjunctionsinawrittenlanguageandimaginethatyouneedtocarryoutthistaskbyhand.Aftertheadventofcomputers:ThecollectionofeverlargerlanguagesamplesTheabilityformuchfasterandmoreefficientprocessingandaccessTheavailabilityofeasytolearncomputerresourcesforlinguisticanalysis...Beforetheadventofcomputers8Fourfeaturesofcorpus-basedanalysisoflanguageItisempirical,analyzingtheactualpatternsofuseinnaturaltexts.b.Itutilizesalargeandprincipledcollectionofnaturaltexts,knownasa‘corpus’,asthebasisforanalysis.c.Itmakesextensiveuseofcomputersforanalysis,usingbothautomaticandinteractivetechniques.d.Itdependsonbothquantitativeandqualitativeanalyticaltechniques....Fourfeaturesofcorpus-based9Parttwo-CorpusDesignandCompilationHowtobuildavaluableandaccuratecorpusHowtoprocessandanalyzecorpus...Parttwo-CorpusDesignandCo10TypesofcorporaGeneralcorpora(通用語料庫)Specializedcorpora(專用語料庫)...TypesofcorporaGeneralcorpor11GeneralcorporaTheBrownCorpusTheLOBCorpusTheBNCRepresentlanguageinitsbroadestsense.Aredesignedtobequitelargeandbalanced.includelanguagesamplesfromawiderangeofregistersIncludefromcasualconversationsamongfriendsandfamilytoacademiclecturesandnationalradiobroadcasts.TheGeneralCorporaisformedbygeneraltextsthatdonotbelongtosinglefield,orregister....GeneralcorporaTheBrownCorpu12Specializedcorporaa.Mayincludebothspokenandwrittencomponents.Forexample:theICECorpusThestudyofnationalvarietiesofEnglishTheTOEFL-2000SpokenandWrittenAcademicLanguageCorpus...Specializedcorporaa.Mayincl13b.Usually,focusesonaparticularspokenorwrittenvarietyofLanguage.Writtencorpora:

historicalcorpora(theHelsinkiCorpus,theArcherCorpus)corporaofnewspaperwriting,fictionoracademicprose,etc.Spokencorpora:

academicspeech(theMichiganCorpusofAcademicSpokenEnglish-MICASE)teenagelanguage(COLT)childlanguage(theCHILDESdatabase)...b.Usually,focusesonaparti14c.‘learner’scorpusForexample:

theInternationalCorpusofLearnerEnglish(ICLE)...c.‘learner’scorpusForexampl15IssuesinCorpusDesignReflectionb.Representativeness

representativeofdifferentregisters,discoursemodesandtopicsrepresentativeofthedemographics(人口特征)ofthespeakersorwritersrepresentativesamplesshouldbebasedonproductionorreceptionc.Distribution...IssuesinCorpusDesignReflect16CorpuscompilationDatacollectionforawrittencorpusDatacollectionforaspokencorpus...CorpuscompilationDatacollect17DatacollectionofawrittencorpusOrganizethematerialsbeingcollectedinelectronicformKeyboardedmanuallyOCR-opticalcharacterrecognition...Datacollectionofawrittenc18DatacollectionforaspokencorpusRecordthetranscriptionArrangetherecordedcontentintowrittenformKeyboardthewrittenformintocorpusObtainpermission...Datacollectionforaspokenc19Markup&AnnotationTitlesAuthorsParagraphsSubheadingsChaptersEtc.Markup:...Markup&AnnotationTitlesMarku20Annotation:Part-of-speechtagging,POS(詞性標(biāo)注)b.Grammaticalparsing(句法標(biāo)注)c.Wordsensetagging(語義標(biāo)注)d.Prosodicannotation(語音標(biāo)注)...Annotation:Part-of-speechtagg21......22Whatisthedifferencebetweenmarkup&annotation?Markup-thecorpusitselfAnnotation-interpretthecorpuslinguistically...Whatisthedifferencebetween23Thankyou!...Thankyou!...24CorpusLinguistics......25Whatisacorpus?Corpus(pl.corpora)Acollectionoftextsassumedtoberepresentativeofagivenlanguage,dialect,orothersubsetofalanguage,tobeusedforlinguisticanalysis.(Francis1982)...Whatisacorpus?Corpus(pl.c26Whatisacorpus?Threebasicknowledgeaboutcorpus:Alargeprincipledcollectionofnaturaltexts.naturaltexts:languagehasbeencollectedfromnaturallyoccurringsources.Abasicsourceofstoringlanguageknowledge.Onlyafterbeingprocessed,canitbeavailableresources....Whatisacorpus?Threebasick27Partone-Whatiscorpuslinguistics?Asameans-exploreactualpatternsoflanguageuseAsatool-developingmaterialsforclassroomlanguageinstructionAndalsouseslargecollectionsofbothspokenandwrittennaturaltextsthatarestoredoncomputers....Partone-Whatiscorpuslingu28Whatiscorpuslinguistics?Corpuslinguisticsisanapproachtoinvestigatelanguagethatischaracterizedbytheuseoflargecollectionsoftexts(spoken,writtenorboth)andcomputer-assistedanalysismethods....Whatiscorpuslinguistics?29ContributionsofcorpuslinguisticsOneofthemajorcontributionsofcorpuslinguisticsisintheareaofexploringpatternsoflanguageuse.Provideanextremelypowerfultool-theanalysisofnaturallanguageProvidetremendousinsights-howlanguageusevariesindifferentsituations...Contributionsofcorpuslingui30ThedevelopmentofcorpusIn1964,，thefirstcorpuswasbuiltbyAmericanBrownUniversity,storingonemillionwordsandcollectingeachstylesoflanguagesourcesofAmericanEnglish.In1978,BritainbuiltLOB(Lancaster-Oslo-Bergen),storingonemillionwordsandcollectinglanguagesourcesofBritishEnglish.In1980s,BirminghamUniversitybuiltBCET(BirminghamCollectionofEnglishTexts),storing7.3millionwordsandusingfordictionarycompilation.In1996,thestoragewasextendedto32millionwordsandwasrenamedasBE(BankofEnglish).In1980,COBUILD(CalLinsBirminghamUniversityInternationalLanguageDatabase)wasbuilt,includingBE,thestoragewasupto50millionwords(15millionspokencorpus)....ThedevelopmentofcorpusIn1931Beforetheadventofcomputers:Imaginethatyouareinterestedinexploringtheuseofconjunctionsinawrittenlanguageandimaginethatyouneedtocarryoutthistaskbyhand.Aftertheadventofcomputers:ThecollectionofeverlargerlanguagesamplesTheabilityformuchfasterandmoreefficientprocessingandaccessTheavailabilityofeasytolearncomputerresourcesforlinguisticanalysis...Beforetheadventofcomputers32Fourfeaturesofcorpus-basedanalysisoflanguageItisempirical,analyzingtheactualpatternsofuseinnaturaltexts.b.Itutilizesalargeandprincipledcollectionofnaturaltexts,knownasa‘corpus’,asthebasisforanalysis.c.Itmakesextensiveuseofcomputersforanalysis,usingbothautomaticandinteractivetechniques.d.Itdependsonbothquantitativeandqualitativeanalyticaltechniques....Fourfeaturesofcorpus-based33Parttwo-CorpusDesignandCompilationHowtobuildavaluableandaccuratecorpusHowtoprocessandanalyzecorpus...Parttwo-CorpusDesignandCo34TypesofcorporaGeneralcorpora(通用語料庫)Specializedcorpora(專用語料庫)...TypesofcorporaGeneralcorpor35GeneralcorporaTheBrownCorpusTheLOBCorpusTheBNCRepresentlanguageinitsbroadestsense.Aredesignedtobequitelargeandbalanced.includelanguagesamplesfromawiderangeofregistersIncludefromcasualconversationsamongfriendsandfamilytoacademiclecturesandnationalradiobroadcasts.TheGeneralCorporaisformedbygeneraltextsthatdonotbelongtosinglefield,orregister....GeneralcorporaTheBrownCorpu36Specializedcorporaa.Mayincludebothspokenandwrittencomponents.Forexample:theICECorpusThestudyofnationalvarietiesofEnglishTheTOEFL-2000SpokenandWrittenAcademicLanguageCorpus...Specializedcorporaa.Mayincl37b.Usually,focusesonaparticularspokenorwrittenvarietyofLanguage.Writtencorpora:

historicalcorpora(theHelsinkiCorpus,theArcherCorpus)corporaofnewspaperwriting,fictionoracademicprose,etc.Spokencorpora:

academicspeech(theMichiganCorpusofAcademicSpokenEnglish-MICASE)teenagelanguage(COLT)childlanguage(theCHILDESdatabase)...b.Usually,focusesonaparti38c.‘learner’scorpusForexample:

theInternationalCorpusofLearnerEnglish(ICLE)...c.‘learner’scorpusForexampl39IssuesinCorpusDesignReflectionb.Representativeness

representativeofdifferentregisters,discoursemodesandtopicsrepresentativeo