數(shù)字視頻特效處理lec01-概述

CourseoverviewDigitalVisualEffectsYung-YuChuangLogisticsMeetingtime:2:20pm-5:20pm,TuesdayClassroom:CSIERoom102Instructor:Yung-YuChuang(cyy@.tw)Teachingassistants:TBATextbook:Readingsfrombooks,journalsandproceedings.RichardSzeliski’sComputerVision:AlgorithmsandApplications.RichardRadke’sComputerVisionforVisualEffects.Webpage:(username/password).tw/~cyy/vfxMailinglist:vfx@.twsubscribevia.tw/mailman/listinfo/vfx/ThiscourseisNOTabout…Itisn’taboutphotographyItisn’tabout3DanimationsItisn’taboutwatchingmoviesItisn’taboutphysicaleffectsIt’snotaboutindustrialtrickscomputervisioncomputergraphicsimageprocessingYouwilllearnmoreaboutTaylorandPoissonthanLucasandSpielberginthiscourse.IfyouhearLucasintheclass,itismorelikelytorefertoBruceLucas,notGeorgeLucas.PrerequisitesItisamustthatyouhaveprogrammingexperiences.Itisamustthatyouhavebasicknowledgeonlinearalgebraandprobability.Itisaplusifyouhavebackgroundknowledgeoncomputervision,imageprocessingandcomputergraphics.Itisaplusifyouhaveaccesstodigitalcamerasandcamcorders.ThevfxcoursewhatyouactuallydowhatyouthoughtyouwilldowhatotherstudentsthinkyoudowhatotherprofessorsthinkyoudoBecautious!Warningfrompreviousstudents請(qǐng)學(xué)期初老師要多提醒這門課的困難度請(qǐng)興趣或?qū)嵙Σ蛔愕耐瑢W(xué)勿修，否則就會(huì)像我一樣停修XD

Thiscourseisabout…DigitalVisualEffectsLifeofPiLifeofPi獨(dú)自一人拍和十三人的戲要把身材高大的甘道夫和小矮人們拍攝在一起，我們是沒法在同一個(gè)片場(chǎng)的。和我一起拍攝的只有柱子上貼著的13張他們的照片，後面還有一個(gè)小燈，哪個(gè)角色說話了燈就亮起來。想像一下你在拍一場(chǎng)和13個(gè)人一起演的戲，但你卻只有獨(dú)自一人。這真的會(huì)把你的演技推到極限。我哭了，真的，我當(dāng)時(shí)真的哭了。然後我還說出了聲：我認(rèn)真演了一輩子不是為了跟這些照片對(duì)戲啊！Reality?RetouchingRetouchingRetouchingIraqWar,LATimes,April2003DigitalphotomontageBushcampaign’sTVAD,2004TexturesynthesisandinpaintingDomesticexampleTheLibertyTimes2007.12.17SpecialeffectsStopactionTheexecutionofMary,1895GlassshotRearprojectionKingKong,1933stopmotionSpecialeffects(make-up)Specialeffects(physicaleffects)Specialeffects(miniature)Specialeffects(mattepainting)LordoftheRingsIllusion-forcedperspectiveComputer-generatedmodelTheAvengers(1978vs2012)Visualeffects100YearsProductionpipelineProductionpipelinePreproductionProductionPost-productionArtworkReferenceStillsPlatesStoryboardEditingVFXMusicSoundFilmEffectsPreproductionStoryboardPreproductionArtworkPreproductionReference&ResearchProductionShootingPost-productionVisualeffectsproductionPreproductionProductionPost-productionArtworkReferenceStillsPlatesModelGeometrySkinningEffectsAnimationCharacterAnimationLightingandRenderingCompositingMatchmoveandMatchmodelAssetsShotsSkeletonScanningFilmRecordingTexturesMaterialsStoryboardEffectsVisualeffectspost-productionAcasestudy405:TheMovieThismoviewerecreatedsolelybytwovisualeffectsartistsintheyearof2000.Itwasaprocessthattookoverthreemonthsofnights,weekendsandanysparemomentsthattheycouldfind./405:TheMovieMakingof405Step0:scriptandshootingplanMakingof405Step1:shootingtwodayswithaCanonOpturaDVcamerawithprogressivemode.a70-minuterawfootageinitialediting

pickupshotsMakingof405Step2:buildingCGworldtotal62shots,42enhancedwithdigitalVFX.19shotsareentirelydigitalcreations.plane,twocars,freewaybackgroundaredigitalphoto-based3DenvironmentMakingof405Realcarswereusedforclose-upandinteriorshotsAlow-resolutionmeshscannedbyacyberscanner.Mappedwithphotographs.

Makingof405DC-10planetookamonthtomodelindetailsfortheneedsofclose-upshots.59objects,142,439polygonsreferencemodelingmaterialpainting

Makingof405close-upshots

Step3:trafficclearing

inpaintingcleanplate

Makingof405shotwiththevehiclestandingstillinabackyardStep4:compositing

Makingof405Makingof405Step5:finetouchup

3DhatcompositingandinpaintingMakingof405Step6:musicanddelivery

BloodyOmahaBreakdown(WolfofWallStreet)Topicsweplantocover

CameraCanon10DHighdynamicrangeimaging/displayImagewarping/morphingvideosomeoneveryfamoussomeonenotthatfamousImagewarping/morphingTrackingFeaturetrackingImagestitchingMatchMoveMovematchingusingsceneplanes

MatchmoveMovematchingusingsceneplanes

MatchmoveMovematchingusingsceneplanes

PhototourismVideomatchingMOCO(Motioncontrolcamera)MatrixVideomatchingVideomatchingStopmotionStopmotionMattingandcompositingTitanicMattingObjectselectionLazySnappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingphotogrammetricmodelingandprojectivetexture-mappingImage-basedmodelingTourintoapictureImage-basedmodelingTourintoapicture3Dphotography(active)Cyberwarewholebodyscanner3Dphotography(active)Photometricstereo3Dphotography(passive)StereoleftrightdepthImage-basedrenderingSurfacelightfieldViewinterpolationBullettimevideoViewinterpolationHigh-QualityVideoViewInterpolationImagemanipulationGraphCutTextureImagemanipulationPoissonblendingStereoscopicfilmsMakingfaceSpacetimefaceGollumVirtualhumanVideorewriteTrainablevideorealisticspeechanimation

Inpainting(wireremoval)InpaintingTexturesynthesis/replacementTexturereplacementSemi-automaticmattepaintingImageanalogiesVideoeditingFlow-basedvideoeditingGrading(subjecttochange)3programmingassignments(60%)HDRImaging

(18%)AutoStitch(24%)MatchMove(18%)Classparticipation(5%)Finalproject(35%)ResearchSystemFilmHigh