¿ªÆô×ó²à

iOSÒôƵ²É¼¯¹ý³ÌÖеÄÒôЧʵÏÖ

5051485

2018-1-6 09:04:03

񙮵
1¡¢±³¾°

ÔÚÒÆ¶¯Ö±²¥ÖÐ, ÉùÒôÊÇÖ÷²¥ºÍ¹ÛÖÚ»¥¶¯µÄÖØÒªÍ¾¾¶Ö®Ò», ΪÁ˷ḻֱ²¥µÄÄÚÈÝ,´ó¼Ò¶¼»áÏëÒªÔÚÉùÒôÉÏ×öһЩÎÄÕÂ, Ôڲɼ¯Â¼ÒôµÄ»ù´¡ÉÏÍæÒ»Ð©»¨Ñù¡£

±ÈÈçÑݳªÀàµÄÖ±²¥¼äÖÐ, Ö÷²¥°éËæ×ű³¾°ÒôÀÖÑݳª. ÕâʱÓÐЩÖ÷²¥¾Í»áÏ£ÍûÄܹ»¸ø×Ô¼ºÉùÒôÔö¼Ó»ìÏìµÄЧ¹û, ÓªÔì³öÔÚÎę̀¾ç³¡µÈ»·¾³ÏÂÑݳªµÄ·ÕΧ. ÔÙ±ÈÈçÓÐЩ¸ãЦÀàµÄÖ±²¥¼ä, Ö÷²¥»áÏ£Íû¸ø×Ô¼ºµÄÉùÒôÌí¼Ó±äÉùµÄЧ¹û, Å®±äÄÐ,ÄбäÅ®»òÕß±ä³É»úÆ÷È˵ȵÈ. ΪÁËʵÏÖÕâЩÐèÇóÎÒÃÇÐèÒª¶Ô²É¼¯µÄÉùÒô½øÐд¦Àí, ²¢ÇÒΪÁËÈÃÖ÷²¥ÊµÊ±Ìýµ½ÕâЩ´¦ÀíºóµÄЧ¹û,ÒÔ±ã¸ù¾ÝЧ¹û½øÐе÷Õû£¬ÎÒÃÇÒ²ÐèÒªÌṩµÍÑÓʱµÄ»Ø·Å,½«±ä»¯ºóµÄÉùÒô²¥·Å¸øÖ÷²¥Ìý.¶ÔÉùÒô´¦ÀíµÄ·½°¸±È½Ï¶à£¬ÕâÀï½éÉÜһϽðÉ½ÔÆÖ±²¥SDKÖÐËù²ÉÓõĻùÓÚiOSÌṩµÄAudioUnitµÄ·½°¸¡£

iOSϵͳÌṩÁ˷dz£·á¸»µÄÒôƵÏà¹ØµÄAPI£¬º­¸ÇÁ˴Ӳɼ¯£¬´¦Àíµ½²¥·ÅµÈ¸÷¸ö»·½Ú£¬²¢ÇÒ°´ÕÕÐèÇóµÄ²ã´Î½øÐÐÁË·Ö×é¡£

e4097d4a6e634abc9f6395b1e773ddc0.png

ͼ1. Core Audio Overview

ÆäÖУ¬Àëµ×²ãµÄÇý¶¯ºÍÓ²¼þ×î½üµÄ¾ÍÊÇAudioUnitϵÁеÄAPI£¬ºÜ¶àÆäËû¸ß²ãµÄAPI£¬¶¼ÊǶÔAudioUnitµÄ·â×°. ±ÈÈçAVFoundation¡¢AudioQueue¡¢AVAudioEngineµÈ¡£

ȱµã£º

Éæ¼°µ½µÄרÓиÅÄî±È½Ï¶à£¬½Ó¿Ú¸´ÔÓ

ÌṩC·ç¸ñµÄAPI

Óŵ㣺

µÍÑÓʱ£¬´Ó²É¼¯µ½²¥·Å»Ø»·¿ÉÒÔµ½10msµÄ¼¶±ð

¿ÉÒÔ¶¯Ì¬±ä¸üÅäÖÃ×éºÏ

¿ÉÒÔÖ±½Ó»ñµÃºǫִ́ÐÐȨÏÞ
ÊÕ²Ø
ËÍÔÞ ・1
·ÖÏí

·¢±í»Ø¸´

µÇ¼ºó²ÅÄÜÆÀÂÛ

ÆÀÂÛÁÐ±í£¨3£©

5051485 Â¥Ö÷
2. AudioUnit¼ò½é

AudioUnitÕâ¸öÃû×ÖÈ¡µÃ»¹ÊDZȽÏÐÎÏóµÄ£¬ËüµÄÖ÷Ìå¾ÍÊÇһϵÁеÄunit£¬²»Í¬unitÄܹ»ÊµÏÖ²»Í¬µÄ¹¦ÄÜ£¬½«Ò»¸ö»ò¶à¸öunitÌí¼Óµ½AUGraph(Audio Processing Graph)ÖУ¬²¢½¨Á¢unitÖ®¼äµÄÁ¬½Ó£¬ÒôƵÊý¾Ý˳´Îͨ¹ý¸÷¸ö½Úµã¼´¿ÉÍê³ÉÎÒÃÇ×îÖÕÐèÇó¡£

3534db95e149440e877979caebc65546 (1).png

ͼ2. AudioUnit in iOS

iOSϵͳһ¹²ÌṩÁËÈçÏÂ4Ààunit¡£
ddd4602698404a2f9558d4fed708d148.png


ÆäÖУ¬I/OÖ÷Òª¸ºÔðºÍÉ豸´ò½»µÀ£¬±ÈÈç²É¼¯ºÍ²¥·Å;Mixing¸ºÔ𽫲»Í¬À´Ô´µÄÒôƵÊý¾Ý½øÐлìºÏ;EffectÊǶÔÒôƵÊý¾Ý½øÐÐÒôЧ´¦Àí;Format ConversionÖ÷ÒªÊǽøÐиñʽת»»±ÈÈçÖØ²ÉÑùµÈ¡£ÕâÀïÓÐÒ»¸öÓÅ»¯µÄµãÊÇÒôƵ¸ñʽת»» Multichannel Mixer ±¾Éí¾ÍÄܹ»ÊµÏÖ¸ñʽת»»µÄ¹¦ÄÜ£¬ÊäÈëºÍÊä³öµÄÒôƵÊý¾Ý¸ñʽ¿ÉÒÔ²»Í¬£¬ÀûÓÃÕâÒ»µã¿ÉÒÔ½Úʡһ¸ö¸ñʽת»»unit¡£
2018-1-6 09:06:28 »Ø¸´
5051485 Â¥Ö÷
3. ʹÓÃAudioUnit½øÐÐÒôƵ²É¼¯

ÔÚÖ±²¥Ó¦ÓÃÖУ¬ÎÒÃÇÖ÷ÒªÊÇʹÓÃRemote I/O unitÀ´½øÐвɼ¯¹¤×÷¡£ ÔÚÒ»¸öAUGraphÖÐÖ»ÔÊÐíÓÐÒ»¸öI/O unit¡£Remote I/OÐèҪͬʱ¸ºÔð²É¼¯ºÍ²¥·ÅµÄ¹¦ÄÜ¡£µ±Óû§¿ªÆô¶ú·µ¹¦ÄÜʱ£¬Òª½«²É¼¯µ½µÄÉùÒô£¬´¦ÀíÖ®ºóÔÙËͻص±Ç°½ÚµãÖ±½Ó²¥·Å£¬ÕâÑù¿ÉÒÔ½«²É¼¯ºÍ²¥·ÅµÄÑÓʱ¿ØÖÆÔÚ50msÒÔÄÚ£¬Ö÷²¥²Å²ì¾õ²»µ½ÉùÒôµÄÑÓʱ¡£ »ù±¾µÄ²½ÖèÈçÏÂ:

1. ʵÀý»¯AUGraph£¬½«Óõ½unitsÌí¼Ó½øÈ¥£»

2. ÅäÖÃÿ¸öAudioUnitµÄÊôÐÔ£»

3. ÉèÖÃRender Callback Function£»

4.½«units ½¨Á¢Á¬½Ó£»

5.Æô¶¯AUGraph¡£

ÒÔÉϹý³Ì´ó¼Ò¶¼¿ÉÒÔµ½Apple¹Ù·½µÄÎĵµÖÐÕÒµ½¾ßÌåµÄ˵Ã÷ºÍ´úÂëʾÀý¡£

ÔÚÖ±²¥Â¼ÖÆÖбȽϹؼüµÄÒ»²½¾ÍÊÇRender Callback Function¡£
a803af91759f4b83b55b3315bf74be15.png


AudioUnitÿ´Î¶¼ÊÇ´¦ÀíÒ»¶ÎÒôƵÊý¾Ý£¬Ã¿´Î´¦ÀíÍê³ÉÒ»¶ÎÊý¾ÝµÄʱºò£¬Õâ¸ö»Øµ÷º¯Êý¾Í»á±»µ÷ÓÃÒ»´Î¡£ÔÚÕâ¸ö»Øµ÷º¯ÊýÖУ¬Í¨¹ýAudioUnitµÄAudioUnitRender·½·¨£¬¿ÉÒÔAUGraphÖеÄijһ¸ö½ÚµãÖлñÈ¡µ½Ò»¶Î´¦ÀíºóµÄÒôƵPCMÊý¾Ý¡£Í¬Ê±£¬Èç¹ûÐèÒª½øÐжú·µ²¥·Å£¬ÔÚÕâ¸ö»Øµ÷ÖÐÒ²ÐèÒª½«È¡µÃµÄÒôƵÊý¾ÝËÍÈëµ½»Øµ÷º¯ÊýµÄ×îºóÒ»¸ö²ÎÊýioData¶ÔÓ¦µÄbufferÖС£

ÔÚÉèÖÃunitµÄÊôÐÔʱ£¬ÐèҪעÒâµÄÊÇһЩ¹«¹²µÄÊôÐÔ¡£±ÈÈçÒôƵ¸ñʽÊôÐÔºÍMaximumFramesPerSlice¡£Èç¹ûÒôƵ¸ñʽÉèÖôíÎó£¬ÍùÍù»á³öÏÖAUGraphÆô¶¯Ê§°Ü»òÕßÉùÒôÒì³£µÈÎÊÌâ¡£±ÈÈ磬ʹÓÃiOSÄÚÖõÄÂó¿Ë·ç»òÕßÓÐÏß¶ú»úʱ£¬É豸֧³ÖµÄ²ÉÑùÂʱȽϸߣ¬44.1KHz ÄÜÕý³£¹¤×÷£¬ÎÒÃÇÕûÌõÒôƵͨ·ÉÏ»ù±¾É϶¼²ÉÓõÄÊÇ44.1KHz¡£µ«Êǵ±Ê¹ÓÃÀ¶ÑÀÉ豸ʱ£¬Ò»°ãÀ¶ÑÀÉ豸ÎÞ·¨Ö§³Ö44.1KHz²É¼¯ºÍ²¥·Å£¬Í¨³£¶¼ÊÇ16KHzÉõÖÁ¸üµÍ¡£´ËʱI/O UnitÎÞ·¨¼ÌÐøÊ¹ÓÃ֮ǰµÄÅäÖá£ÐèÒª°´ÕÕʵ¼ÊÖ§³ÖµÄ²ÉÑùÂʽøÐÐÅäÖá£

AudioUnit»¹ÒªÇóÁ½¸öµ¥ÔªÏνӴ¦µÄÒôƵÊý¾Ý¸ñʽ±ØÐë±£³ÖÒ»Ö£¬µ±AUGraphÖв»Í¬unitÖ§³ÖµÄ¸ñʽ²»Í¬Ê±£¨±ÈÈçÔÚÖ§³ÖÀ¶ÑÀÉ豸»òÕßʹÓûØÉùÏû³ýÄ£¿éʱ£¬I/O unitÒªÇóµÄ¸ñʽºÍÆäËûµ¥ÔªµÄÓпÉÄܲ»Í¬£©£¬´Ëʱ¾ÍÐèÒª·Ö±ðÉèÖøñʽ£¬²¢Í¨¹ý¸ñʽת»»unit»òmixer unit¶Ô¸ñʽ½øÐÐת»»¡£

Èç¹ûMaximumFramesPerSliceÉèÖôíÎ󣬿ÉÄÜ»á³öÏÖÉùÒôÒì³£µÄÇé¿ö¡£ MaximumFramesPerSlice ±íʾµÄÊÇÿ´Î»Øµ÷ËÍÈë»òÈ¡³öµÄÒôƵÊý¾ÝµÄ³¤¶È£¬ÔÚAUGraphµÄËùÓнڵãµÄÕâ¸öÊôÐÔÒ²ÐèÒª±£³ÖÒ»Ö·ñÔò»áµ¼ÖÂÓеÄunit¶ªÆúÊý¾Ý£¬¶ø³öÏÖÉùÒôÒì³£ ¡£

4. ʹÓÃAudioUnit½øÐÐÒôЧ´¦Àí

ÕâÀïËùνµÄÒôЧ´¦Àí£¬Ö÷ÒªÊÇÖ¸¶ÔÔ­±¾µÄÉùÒô½øÐÐһЩ¸Ä±ä£¬±ÈÈç»ìÏìЧ¹û£¬±äÉùЧ¹ûµÈ¡£Óõ½ÊÖ¶ÎÖ÷ÒªÊÇÊý×ÖÐźŴ¦ÀíÌṩµÄһϵÁÐʱ¼äºÍƵÓòµÄ¹¤¾ß£¬½«ÊäÈëµÄPCMÊý¾Ý¾­¹ýÔËËãºóµÃµ½±ä»¯ºóµÄÉùÒô¡£

4.1 »ìÏìЧ¹û(reverberation)

ÎÒÃÇÔÚÒôÀÖÌü£¬¾çÔº£¬ÀñÌõȱȽϿտõµÄÊÒÄÚ˵»°»ò³ª¸èʱ£¬ÍùÍùÄÜÌýµ½ºÍƽʱ²»Ò»ÑùµÄÉùÒô£¬Ö÷ÒªÊÇÉùÒôÔÚǽ±ÚÉ϶à´Î·´Éäºóµþ¼ÓÔÚÒ»Æð£¬ÌýÆðÀ´¾ÍÓÐÁË»ìÏìµÄЧ¹û¡£ÔÚÉùÒô´¦ÀíÖУ¬ÎÒÃÇ¿ÉÒÔÈËΪµÄ½«ÉùÒô»º´æÆðÀ´£¬ÑÓʱһ¶¨Ê±¼äºó£¬ºÍÔ­ÉùÒôµþ¼Ó£¬¾ÍÄܹ»Ä£Äâ³ö»ìÏìµÄЧ¹û¡£AudioUnitÌṩÁËkAudioUnitSubType_Reverb2À´ÊµÏÖ»ìÏìЧ¹ûµÄÉú³É¡£½«¸Ãunit½ÓÈëµ½AUGraphÖÐÖ®ºó£¬ÅäÖòÎÊý¼´¿ÉʵÏÖ»ìÏìµÄЧ¹û¡£ËäÈ»»ìÏìÔ­ÀíÊDZȽϼòµ¥£¬µ«Êµ¼ÊÉÏΪÁËÄ£Äâ×ÔÈ»½çÖÐʵ¼ÊµÄÒôЧ£¬¼ÆËã¹ý³Ì»¹ÊÇÏ൱¸´Ôӵģ¬ÒªÄ£Äâ³ö²»Í¬µÄ´óСµÄ¿Õ¼ä£¬²»Í¬²ÄÖʵÄǽ±Ú£¬Õϰ­ÎïµÄ¶àÉÙ£¬ÐèÒªÊäÈë±È½Ï¶àµÄ²ÎÊýÀ´²ÎÓëÔËËã¡£iOSµÄreverb unitÌṩÁË7¸ö²ÎÊý¡£ÎÒÃÇÔÚÖ±²¥Ó¦ÓÃÖÐÌṩÁË4¸ö²»Í¬³¡¾°µÄÄ£Äâ(¼ÒôÅÑݳª»á£¬KTV£¬Ð¡Îę̀)£¬Ö÷ÒªÊÇͨ¹ýµ÷ÕûÈçϲÎÊýʵÏֵģº

kReverb2Param_DryWetMix»ìÏìЧ¹ûÉùµÄ´óСÓë¿Õ¼ä´óСÎ޹أ¬¶øÖ»Óë¿Õ¼äÄÚÔÓÎïµÄ¶àÉÙÒÔ¼°Ç½±Ú¼°ÎïÌåµÄ²ÄÖÊÓйأ»

kReverb2Param_DecayTimeAt0Hz / kReverb2Param_DecayTimeAtNyquistË¥¼õʱ¼ä£¬Õû¸ö»ìÏìµÄ×ܳ¤¶È£¬Óë¿Õ¼ä´óС±È½ÏÏà¹Ø£¬Ô½¿Õ¿õÔ½³¤¡£
2018-1-6 09:08:17 »Ø¸´
5051485 Â¥Ö÷
4.2 ±äÉùЧ¹û

±äÉùЧ¹ûÖ÷ÒªÊÇÔÚÆµÓòÉ϶ÔÈ˵ÄÉùÒô½øÐÐÒ»¶¨µÄ´¦Àí£¬ÎÒÃÇÖªµÀÄÐÉùÒ»°ã±È½ÏµÍ³Á£¬Å®Éù±È½Ï¼âÈñ£¬Õâ¸öÖ÷Ҫ˵µÄÊÇÒôµ÷¡£Í¨¹ý¶ÔÉùÒôÒôµ÷µÄµ÷Õû£¬¿ÉÒÔÈõͳÁµÄÄÐÉùÌýÉÏÈ¥Ïñ¼âÈñÅ®Éù¡£iOSÌṩÁËkAudioUnitSubType_NewTimePitchµÄunitÀ´ÊµÏÖÒôµ÷µÄµ÷Õû¡£ÖµµÃ×¢ÒâµÄÊÇkAudioUnitSubType_NewTimePitch²»ÊÇÊäÈëEffectÀàµÄ£¬¶øÊÇÊôÓÚFormatConverterÀàµÄ¡£Í¨¹ýÉèÖÃTimePitch unitµÄkNewTimePitchParam_PitchÊôÐÔ¼´¿É¡£

/// pitchShiftΪ¾ßÌåÊýÖµ(0±íʾ²»±ä£¬¸ºÊý±íÃ÷µ÷µÍ³Á£¬ÕýÊýµ÷¼âÈñ)AudioUnitSetParameter(pitchUnit, kNewTimePitchParam_Pitch, kAudioUnitScope_Global, 0, pitchShift, 0);

±äÄÐÉù£¬ÐèҪǿ»¯Í»³öµÍ³ÁµÄÌØµã£¬½«Òôµ÷µ÷µÍ£¬ÉèÖøºÊý²ÎÊý¼´¿É£»

±äÅ®Éù£¬ÐèҪǿ»¯Í»³ö¼âÈñµÄÌØµã£¬½«Òôµ÷µ÷¸ß£¬ÉèÖÃÕýÊý¼´¿É£»

»úÆ÷ÈËÒôЧ£¬»úÆ÷È˵ÄÒôЧÊÇÒ»¸ö×éºÏЧ¹û£¬ÎÒÃÇÓ¡ÏóÖеĻúÆ÷ÈËÒôЧ¶¼ÊÇÀϵçÓ°ÖеÄÄÇÖÖ£¬Òôµ÷±È½Ï¸ß£¬¶øÇÒÓÐÖØÒô¡£ËùÒÔÎÒÃDzÉÓõÄÊÇTimePitch unit + Delay unitµÄ·½Ê½¡£Delay unitÒ²ÊÇiOSÌṩµÄÒ»¸ö½«ÉùÒôÑÓʱµþ¼ÓµÄunit£¬µ«ÊDZȻìÒôÒª¼òµ¥ºÜ¶à£¬Ö»Óе¥´Îµþ¼Ó£»

ׯÑϺê´óÒôЧ£¬ÏëÏóһϷð׿֮ÀàµÄÉùÒô£¬Ò»°ã¶¼ÊÇ×Ô´ø»ØÉù£¬¶øÇұȽÏÄÐÐÔ»¯£¬ËùÒÔÎÒÃÇÑ¡ÔñµÄÊÇTimePitch unit + Reverb unitµÄ·½Ê½À´ÊµÏÖ¡£

ÕâÀïÍÆ¼öÒ»¸ö×Ô¼ºµ÷ÒôЧµÄ²Î¿¼Èí¼þvoxal voice changer¡£´ó¼Ò¿ÉÒÔÔÚÕâ¸öÈí¼þÉÏ×Ô¼º½«²»Í¬µÄ¹¤¾ß×é¼þ×éºÏÆðÀ´£¬µ÷ÊÔ²ÎÊý£¬ÊµÊ±Ìýµ½²ÎÊý¶ÔÓ¦µÄ½á¹û¡£µ±Ð§¹ûÂúÒâºóÔÙÒÆÖ²µ½AudioUnitÖС£


d820e77cad224aa19dea5ae89e4266b9.png
ͼ3 voixal voice changer

5. ×ܽá

ÒÔÉÏ´ó¸Å½éÉÜÁËÔõôÓÃAudioUnitÀ´ÊµÏÖiOSÖ±²¥ÖеÄÒôƵ²É¼¯£¬ÔõôʹÓÃAudioUnitÖеÄÒôЧ×é¼þÀ´ÊµÏÖ»ìÏìºÍ±äÉùЧ¹û¡£µ«ÊÇAudioUnitµÄDZÁ¦»¹Ô¶Ã»ÓÐÍÚ¾òÍ꣬±ÈÈ绹¿ÉÒÔ½«±³¾°ÒôÀÖ²¥·Å£¬»ìÒô£¬»ØÉùÏû³ýµÈÆäËûÒÆ¶¯¶àýÌåÒôƵÏà¹ØµÄ¹¦ÄÜÄÉÈëµ½Õâ¸ö¿ò¼ÜÖС£
2018-1-6 09:08:39 »Ø¸´

ÒôƵ·ÖÀà´óÈ«

+ ²é¿´È«²¿·ÖÀà