¿ªÆô×ó²à

¹ØÓÚDirectShowÒôÊÓÆµÍ¬²½½â¾öÍêÕû·½°¸

Ô­´´
¹ØÓÚDirectShowÒôÊÓÆµÍ¬²½½â¾öÍêÕû·½°¸

¶àýÌå´¦Àí£¬²»¿É±ÜÃâµØÒª½â¾öÒôÊÓÆµµÄͬ²½ÎÊÌâ¡£DirectShowÊÇÔõôÀ´ÊµÏÖµÄÄØ£¿ÎÒÃÇÒ»ÆðÀ´Ñ§Ï°Ò»Ï¡£
¡¡¡¡´ó¼ÒÖªµÀ£¬DirectShow½á¹¹×îºËÐĵIJ¿·ÖÊÇFilter Graph Manager£ºÏòÏ¿ØÖÆGraphÖеÄËùÓÐFilter£¬ÏòÉ϶ԦÓóÌÐòÌṩ±à³Ì½Ó¿Ú¡£ÆäÖУ¬Filter Graph ManagerʵÏֵĺÜÖØÒªÒ»¸ö¹¦ÄÜ£¬¾ÍÊÇͬ²½ÒôÊÓÆµµÄ´¦Àí¡£¼òµ¥µØËµ£¬¾ÍÊÇѡһ¸ö¹«¹²µÄ²Î¿¼Ê±ÖÓ£¬²¢ÇÒÒªÇó¸øÃ¿¸öSample¶¼´òÉÏʱ¼ä´Á£¬Video Renderer»òAudio Renderer¸ù¾ÝSampleµÄʱ¼ä´ÁÀ´¿ØÖƲ¥·Å¡£Èç¹ûµ½´ïRendererµÄSampleÍíÁË£¬Ôò¼Ó¿ìSampleµÄ²¥·Å£»Èç¹ûÔçÁË£¬ÔòRendererµÈ´ý£¬Ò»Ö±µ½Sampleʱ¼ä´ÁµÄ¿ªÊ¼Ê±¼äÔÙ¿ªÊ¼²¥·Å¡£Õâ¸ö¿ØÖƹý³Ì»¹ÒýÈëÒ»¸ö½ÐQuality ControlµÄ·´À¡»úÖÆ¡£
¡¡¡¡ÏÂÃæ£¬ÎÒÃÇÀ´¿´Ò»Ï²ο¼Ê±ÖÓ(Reference Clock)¡£ËùÓÐFilter¶¼²ÎÕÕÓÚͬһ¸öʱÖÓ£¬²ÅÄÜͳһ²½µ÷¡£DirectShowÒýÈëÁËÁ½ÖÖʱÖÓʱ¼ä£ºReference timeºÍStream time¡£Ç°ÕßÊǴӲο¼Ê±ÖÓ·µ»ØµÄ¾ø¶Ôʱ¼ä(IReferenceClock::GetTime)£¬ÊýÖµ±¾ÉíµÄÒâÒåÈ¡¾öÓڲο¼Ê±ÖÓµÄÄÚ²¿ÊµÏÖ£¬ÀûÓüÛÖµ²»´ó£»ºóÕßÊÇÁ½´Î´Ó²Î¿¼Ê±ÖÓ¶ÁÈ¡µÄÊýÖµµÄ²îÖµ£¬Êµ¼ÊÓ¦ÓÃÓÚFilter GraphÄÚ²¿µÄͬ²½¡£Stream timeÔÚFilter Graph²»Í¬×´Ì¬µÄȡֵΪ£º
¡¡¡¡1. Filter GraphÔËÐÐʱ£¬È¡ÖµÎªµ±Ç°²Î¿¼Ê±ÖÓʱ¼ä¼õÈ¥Filter GraphÆô¶¯Ê±µÄʱ¼ä(Æô¶¯Ê±¼äÊÇͨ¹ýµ÷ÓÃFilterÉϵÄIMediaFilter::RunÀ´ÉèÖõÄ)£»
¡¡¡¡2. Filter GraphÔÝͣʱ£¬±£³ÖΪÔÝÍ£ÄÇÒ»¿ÌµÄStream time;
¡¡¡¡3. Ö´ÐÐÍêÒ»´ÎSeek²Ù×÷ºó£¬¸´Î»ÖÁÁ㣻
¡¡¡¡4. Filter Graphֹͣʱ£¬È¡Öµ²»È·¶¨¡£
¡¡¡¡ÄÇô£¬²Î¿¼Ê±ÖÓ¾¿¾¹ÊÇʲô¶«Î÷ÄØ£¿Æäʵ£¬ËüÖ»ÊÇÒ»¸öʵÏÖÁËIReferenceClock½Ó¿ÚµÄ¶ÔÏó¡£Ò²¾ÍÊÇ˵£¬ÈκÎÒ»¸öʵÏÖÁËIReferenceClock½Ó¿ÚµÄ¶ÔÏ󶼿ÉÒÔ³ÉΪ²Î¿¼Ê±ÖÓ¡£ÔÚFilter GraphÖУ¬Õâ¸ö¶ÔÏóÒ»°ã¾ÍÊÇÒ»¸öFilter¡£(ÔÚGraphEditÖУ¬ÊµÏÖÁ˲ο¼Ê±ÖÓµÄFilterÉÏ»áÏÔʾһ¸öʱÖÓµÄͼ±ê£»Èç¹ûͬһ¸öGraphÖÐÓжà¸öFiterʵÏÖÁ˲ο¼Ê±ÖÓ£¬µ±Ç°±»Filter Graph ManagerʹÓõÄÄǸö»á¸ßÁÁ¶ÈÏÔʾ¡£)¶øÇÒ´ó¶àÊýÇé¿öÏ£¬²Î¿¼Ê±ÖÓÊÇÓÉAudio RendererÕâ¸öFilterÌṩµÄ£¬ÒòΪÉù¿¨Éϱ¾Éí´øÓÐÁËÓ²¼þ¶¨Ê±Æ÷×ÊÔ´¡£½ÓÏÂÀ´µÄÎÊÌâÊÇ£¬Èç¹ûFilter GraphÖÐÓжà¸ö¶ÔÏóʵÏÖÁËIReferenceClock½Ó¿Ú£¬Filter Graph ManagerÊÇÈçºÎ×ö³öÑ¡ÔñµÄÄØ£¿Ä¬ÈϵÄËã·¨ÈçÏ£º
¡¡¡¡1. Èç¹ûÓ¦ÓóÌÐòÉèÖÃÁËÒ»¸ö²Î¿¼Ê±ÖÓ£¬ÔòÖ±½ÓʹÓÃÕâ¸ö²Î¿¼Ê±ÖÓ¡£(Ó¦ÓóÌÐòͨ¹ýIMediaFilter:: SetSyncSourceÉèÖòο¼Ê±ÖÓ£¬²ÎÊý¼´Îª²Î¿¼Ê±ÖÓ£»Èç¹û²ÎÊýֵΪNULL£¬±íʾFilter Graph²»Ê¹Óòο¼Ê±ÖÓ£¬ÒÔ×î¿ìµÄËÙ¶È´¦ÀíSample£»¿ÉÒÔµ÷ÓÃIFilterGraph:: SetDefaultSyncSourceÀ´»Ö¸´Filter Graph ManagerĬÈϵIJο¼Ê±ÖÓ¡£ÖµµÃ×¢ÒâµÄÊÇ£¬ÕâʱºòµÄIMediaFilter½Ó¿ÚÓ¦¸Ã´ÓFilter Graph ManagerÉÏ»ñµÃ£¬¶ø²»ÊÇö¾ÙGraphÖÐËùÓеÄFilter²¢·Ö±ðµ÷ÓÃFilterÉϵÄÕâ¸ö½Ó¿Ú·½·¨¡£)
¡¡¡¡2. Èç¹ûGraphÖÐÓÐÖ§³ÖIReferenceClock½Ó¿ÚµÄLive Source£¬ÔòÑ¡ÔñÕâ¸öLive Source¡£
¡¡¡¡3. Èç¹ûGraphÖÐûÓÐLive Source£¬Ôò´ÓRendererÒÀ´ÎÍùÉÏÑ¡ÔñÒ»¸öʵÏÖIReferenceClock½Ó¿ÚµÄFilter¡£Èç¹ûÁ¬½Ó×ŵÄFilter¶¼²»ÄÜÌṩ²Î¿¼Ê±ÖÓ£¬ÔòÔÙ´ÓûÓÐÁ¬½ÓµÄFilterÖÐÑ¡Ôñ¡£ÕâÒ»²½Ëã·¨Öл¹ÓÐÒ»¸öÓÅÏÈÇé¿ö£¬¾ÍÊÇÈç¹ûFilter GraphÖк¬ÓÐÒ»¸öAudio RenderµÄÁ´Â·£¬ÔòÖ±½ÓÑ¡ÔñAudio RendererÕâ¸öFilter(Ô­ÒòÉÏÃæÒѾ­Ìá¼°)¡£
¡¡¡¡4. Èç¹ûÒÔÉÏ·½·¨¶¼ÕÒ²»µ½Ò»¸öÊʺϵÄFilter£¬Ôòѡȡϵͳ²Î¿¼Ê±ÖÓ¡£(System Reference Clock£¬Í¨¹ýCoCreateInstance´´½¨£¬CLSIDΪCLSID_SystemClock¡£)
¡¡¡¡ÎÒÃÇÔÙÀ´¿´Ò»ÏÂSampleµÄʱ¼ä´Á(Time Stamp)¡£ÐèҪעÒâµÄÊÇ£¬Ã¿¸öSampleÉÏ¿ÉÒÔÉèÖÃÁ½ÖÖʱ¼ä´Á£ºIMediaSample::SetTimeºÍIMediaSample::SetMediaTime¡£ÎÒÃÇͨ³£½²µ½Ê±¼ä´Á£¬Ò»°ãÊÇָǰÕߣ¬ËüÓÖ½ÐPresentation time£¬RendererÕýÊǸù¾ÝÕâ¸öʱ¼ä´ÁÀ´¿ØÖƲ¥·Å£»¶øºóÕß¶ÔÓÚFilterÀ´Ëµ²»ÊDZØÐëµÄ£¬Media timeÓÐûÓÐÓÃÈ¡¾öÓÚÄãµÄʵÏÖ£¬±ÈÈçÄã¸øÃ¿¸ö·¢³öÈ¥µÄSampleÒÀ´Î´òÉϵÝÔöµÄÐòºÅ£¬ÔÚºóÃæµÄFilter½ÓÊÕʱ¾Í¿ÉÒÔÅжϴ«ÊäµÄ¹ý³ÌÖÐÊÇ·ñÓÐSample¶ªÊ§¡£ÎÒÃÇÔÙ¿´Ò»ÏÂIMediaSample::SetTimeµÄ²ÎÊý£¬Á½¸ö²ÎÊýÀàÐͶ¼ÊÇREFERENCE_TIME£¬Ç§Íò²»ÒªÎó½âÕâÀïµÄʱ¼äÊÇReference time£¬ÆäʵËüÃÇÓõÄÊÇStream time¡£»¹ÓÐÒ»µã£¬¾ÍÊDz¢²»ÊÇËùÓеÄSample¶¼ÒªÇó´òÉÏʱ¼ä´Á¡£¶ÔÓÚһЩѹËõÊý¾Ý£¬Ê±¼ä´ÁÊǺÜÄÑ´òµÄ£¬¶øÇÒÒâÒåÒ²²»ÊǺܴó(²»¹ýѹËõÊý¾Ý¾­¹ýDecoder³öÀ´Ö®ºóµ½´ïRenderer֮ǰ£¬Ò»°ã¶¼»á´òºÃʱ¼ä´ÁÁË)¡£Ê±¼ä´Á°üÀ¨Á½¸öʱ¼ä£¬¿ªÊ¼Ê±¼äºÍ½áÊøÊ±¼ä¡£µ±Renderer½ÓÊÕµ½Ò»¸öSampleʱ£¬Ò»°ã»á½«SampleµÄ¿ªÊ¼Ê±¼äºÍµ±Ç°µÄStream time×÷±È½Ï£¬Èç¹ûSampleÀ´ÍíÁË»òÕßûÓÐʱ¼ä´Á£¬ÔòÂíÉϲ¥·ÅÕâ¸öSample£»Èç¹ûSampleÀ´µÃÔçÁË£¬Ôòͨ¹ýµ÷Óòο¼Ê±ÖÓµÄIReferenceClock::AdviseTimeµÈ´ýSampleµÄ¿ªÊ¼Ê±¼äµ½´ïºóÔÙ½«Õâ¸öSample²¥·Å¡£SampleÉϵÄʱ¼ä´ÁÒ»°ãÓÉSource Filter»òParser FilterÀ´ÉèÖã¬ÉèÖõķ½·¨ÓÐÈçϼ¸ÖÖÇé¿ö£º
¡¡¡¡1. Îļþ»Ø·Å(File playback)£ºµÚÒ»¸öSampleµÄʱ¼ä´Á´Ó0¿ªÊ¼´òÆð£¬ºóÃæSampleµÄʱ¼ä´Á¸ù¾ÝSampleÓÐЧÊý¾ÝµÄ³¤¶ÈºÍ»Ø·ÅËÙÂÊÀ´¶¨¡£
¡¡¡¡2. ÒôÊÓÆµ²¶×½(Video and audio capture)£ºÔ­ÔòÉÏ£¬²É¼¯µ½µÄÿһ¸öSampleµÄ¿ªÊ¼Ê±¼ä¶¼´òÉϲɼ¯Ê±¿ÌµÄStream time¡£¶ÔÓÚÊÓÆµÖ¡£¬Preview pin³öÀ´µÄSampleÊǸöÀýÍ⣬ÒòΪÈç¹û°´ÉÏÊö·½·¨´òʱ¼ä´ÁµÄ»°£¬Ã¿¸öSampleͨ¹ýFilterÁ´Â·´«Ê䣬×îºóµ½´ïVideo RendererµÄʱºò¶¼½«Êdzٵ½µÄ£»Video Rendererͨ¹ýQuality Control·´À¡¸øSource Filter£¬»áµ¼ÖÂSource Filter¶ªÖ¡¡£ËùÒÔ£¬Preview pin³öÀ´µÄSample¶¼²»´òʱ¼ä´Á¡£¶ÔÓÚÒôƵ²É¼¯£¬ÐèҪעÒâµÄÊÇ£¬Audio Capture FilterÓëÉù¿¨Çý¶¯³ÌÐòÁ½Õ߸÷×ÔʹÓÃÁ˲»Í¬µÄ»º´æ£¬²É¼¯µÄÊý¾ÝÊǶ¨Ê±´ÓÇý¶¯³ÌÐò»º´æ¿½±´µ½FilterµÄ»º´æµÄ£¬ÕâÀïÃæÓÐÒ»¶¨Ê±¼äµÄÏûºÄ¡£
¡¡¡¡3. ºÏ³É(Mux Filters)£ºÈ¡¾öÓÚMuxºóÊä³öµÄÊý¾ÝÀàÐÍ£¬¿ÉÒÔ´òʱ¼ä´Á£¬Ò²¿ÉÒÔ²»´òʱ¼ä´Á¡£
¡¡¡¡´ó¼Ò¿ÉÒÔ¿´µ½£¬SampleµÄʱ¼ä´Á¶ÔÓÚ±£Ö¤ÒôÊÓÆµÍ¬²½ÊǺÜÖØÒªµÄ¡£Video RendererºÍAudio Renderer×÷ΪÒôÊÓÆµÍ¬²½µÄ×îÖÕÖ´ÐÐÕߣ¬ÐèÒª×öºÜ¶à¹¤×÷¡£ÎÒÃÇ»òÐíÒª¿ª·¢ÆäËü¸÷ÖÖÀàÐ͵ÄFilter£¬µ«Ò»°ãÕâÁ½¸öFilterÊDz»ÓÃÔÙ¿ª·¢µÄ¡£Ò»ÊÇÒòΪRenderer Filter±¾ÉíµÄ¸´ÔÓÐÔ£¬¶þÊÇÒòΪ΢Èí»á¶ÔÕâÁ½¸öFilter²»¶ÏÉý¼¶£¬¼¯³ÉDirectXÖÐÆäËüÄ£¿éµÄ×îм¼Êõ(ÈçDirectSound¡¢DirectDraw¡¢Direct3DµÈ)¡£
¡¡¡¡×îºó£¬ÎÒÃÇÔÙÀ´×Ðϸ¿´Ò»ÏÂLive SourceµÄÇé¿ö¡£Live SourceÓÖ½ÐPush source£¬°üÀ¨Video /Audio Capture Filter¡¢ÍøÂç¹ã²¥½ÓÊÕÆ÷µÈ¡£Filter Graph ManagerÊÇÈçºÎÖªµÀÒ»¸öFilterÊÇLive SourceµÄÄØ£¿Í¨¹ýÈçÏÂÈκÎÒ»¸öÌõ¼þÅжϣº
¡¡¡¡1. µ÷ÓÃFilterÉϵÄIAMFilterMiscFlags::GetMiscFlags·µ»ØÓÐAM_FILTER_MISC_FLAGS_IS_SOURCE±ê¼Ç£¬²¢ÇÒÖÁÉÙÓÐÒ»¸öOutput pinʵÏÖÁËIAMPushSource½Ó¿Ú¡£
¡¡¡¡2. FilterʵÏÖÁËIKsPropertySet½Ó¿Ú£¬²¢ÇÒÓÐÒ»¸öCapture output pin(PinµÄÀàÐÍΪPIN_CATEGORY_CAPTURE)¡£
¡¡¡¡Live Source¶ÔÓÚÒôÊÓÆµÍ¬²½µÄÓ°ÏìÖ÷ÒªÊÇÒÔÏÂÁ½¸ö·½Ã棺LatencyºÍRate Matching¡£LatencyÊÇÖ¸Filter´¦ÀíÒ»¸öSample»¨·ÑµÄʱ¼ä£¬¶ÔÓÚLive SourceÀ´Ëµ£¬Ö÷Ҫȡ¾öÓÚʹÓûº´æµÄ´óС£¬±ÈÈç²É¼¯30fpsµÄÊÓÆµÒ»°ã²É¼¯ÍêÒ»Ö¡ºó²Å½«Êý¾ÝÒÔÒ»¸öSample·¢ËͳöÈ¥£¬ÔòÕâ¸öFilterµÄLatencyΪ33ms£¬¶øAudioÒ»°ã»º´æ500msºó²Å·¢ËÍÒ»¸öSample£¬ÔòËüµÄLatency¾ÍΪ500ms¡£ÕâÑùµÄ»°£¬AudioÓëVideoµ½´ïRenderer¾Í»áÆ«²î470ms£¬Ôì³ÉÒôÊÓÆµµÄ²»Í¬²½¡£Ä¬ÈÏÇé¿öÏ£¬Filter Graph ManagerÊDz»»á¶ÔÕâÖÖÇé¿ö½øÐе÷ÕûµÄ¡£µ±È»£¬Ó¦ÓóÌÐò¿ÉÒÔͨ¹ýIAMPushSource½Ó¿ÚÀ´½øÐÐLatencyµÄ²¹³¥£¬·½·¨Êǵ÷ÓÃIAMGraphStreams::SyncUsingStreamOffsetº¯Êý¡£Filter Graph ManagerµÄʵÏÖÈçÏ£º¶ÔËùÓÐʵÏÖIAMPushSource½Ó¿ÚµÄFilterµ÷ÓÃIAMLatency::GetLatencyµÃµ½¸÷¸öSourceµÄLatencyÖµ£¬¼ÇÏÂËùÓÐLatencyÖµÖеÄ×î´óÖµ£¬È»ºóµ÷ÓÃIAMPushSource::SetStreamOffset¶Ô¸÷¸öSourceÉèÖÃÆ«ÒÆÖµ¡£
¡¡¡¡ÕâÑù£¬ÔÚSource Filter²úÉúSampleʱ£¬´òµÄʱ¼ä´Á¾Í»á¼ÓÉÏÕâ¸öÆ«ÒÆÁ¿¡£Rate MatchingÎÊÌâµÄÒýÈ룬Ö÷ÒªÊÇÓÉÓÚRenderer FilterºÍSource FilterʹÓõÄÊDz»Í¬µÄ²Î¿¼Ê±ÖÓ¡£ÕâÖÖÇé¿öÏ£¬Renderer¶ÔÊý¾ÝµÄ²¥·ÅҪô̫¿ì£¬ÒªÃ´Ì«Âý¡£ÁíÍ⣬һ°ãLive Source²»ÄÜ¿ØÖÆÊä³öÊý¾ÝµÄËÙÂÊ£¬ËùÒÔ±ØÐëÔÚRendererÉϽøÐв¥·ÅËÙÂÊµÄÆ¥Åä¡£ÒòΪÈ˵ÄÌý¾õÃô¸Ð¶ÈÒª´óÓÚÊÓ¾õÃô¸Ð¶È£¬ËùÒÔ΢ÈíĿǰֻÔÚAudio RendererÉÏʵÏÖÁËRate Matching¡£ÊµÏÖRate MatchingµÄËã·¨ÊDZȽϸ´Ôӵģ¬ÕâÀï¾Í²»ÔÙ׸Êö¡£
¡¡¡¡¿´µ½ÕâÀ´ó¼ÒÓ¦¸Ã¶ÔDirectShowÊÇÈçºÎ½â¾öÒôÊÓÆµÍ¬²½ÎÊÌâµÄ·½°¸ÓÐÒ»µãüĿÁ˰ɡ£Éî²ã´ÎµÄÑо¿£¬»¹ÐèÒª¸ü¶àµÄ²âÊÔ¡¢Base classÔ´ÂëÔĶÁ£¬ÒÔ¼°DirectShowÏà¹Ø¿ØÖÆ»úÖÆµÄÀí½â£¬±ÈÈçQuality Control ManagementµÈ¡£
ÊÕ²Ø
ËÍÔÞ
·ÖÏí

·¢±í»Ø¸´

µÇ¼ºó²ÅÄÜÆÀÂÛ

ÒôƵ·ÖÀà´óÈ«

+ ²é¿´È«²¿·ÖÀà