YT YouTube2Text

YouTube2Text → Transcripts → The Capabilities of Roblox's NEW Audio API (Voice Filters, Analyzers, etc.)

The Capabilities of Roblox's NEW Audio API (Voice Filters, Analyzers, etc.) — Transcript

by BrawlDev · 5,093 words · 673 segments · language en · Watch on YouTube

Open in transcriber Summarize with AI Download SRT/VTT

Full transcript

0:00Roblox recently expanded their audio API
0:02that can allow us to do some really cool
0:04stuff with them such as we can
0:06manipulate our voice chat to different
0:09filters within the game which I think is
0:11actually really really cool there's a
0:13lot of filters go through with and I
0:15will give credit to the person who
0:17created this game because this is to
0:20discover we can have multiple speakers
0:22playing the same audio at the same time
0:25if I drag my listener closer to here you
0:27can hear it better if I drag out of it
0:29go to this one it's playing the same
0:31song and we can also hear it very
0:33clearly the closer The Listener
0:35gets and one of my personal favorites
0:37that I've created is speaking so that an
0:39NPC can follow me hey Noob get over here
0:44yeah that's right he's following me as
0:46soon as I start speaking he's going to
0:48continuously follow me as I continue
0:52speaking I'm over
0:57here I'm actually over here dude how
1:00insane is that this update is so cool so
1:02yes this new audio API adds 15 new
1:05instances to it and we can do a whole
1:07bunch of cool things with them that
1:09include voice input multiple listeners
1:11effects and inworld microphones So based
1:14on the examples that I showed you we
1:15were able to do all of this using the
1:18new API and some of these instances
1:20include all of these different things
1:22here which I'm going to go over some of
1:24these inside of this episode and kind of
1:27just break down everything that I've
1:29been able to discover from this new
1:31update up until this point I recommend
1:33wearing headphones for this video so
1:35that you can really get to see the
1:36difference when it comes to the audio
1:38and with that being said let me show you
1:39more of what I've got in store for you
1:41for this video all right let's think
1:43about this for a minute I'm going to
1:44show you an example of how the new audio
1:46structure is formatted uh in the most
1:49simplest way possible so that you can
1:51understand how the stuff works because I
1:52know it definitely trips up a lot of
1:54people okay but let's say we have a
1:56sound or piece of music that we want to
1:59produce in the game and we want to be
2:01able to listen to it the first thing we
2:03would need to do is get an audio input
2:06so that we know that this is a sound or
2:08music that we want to play so this is
2:09basically what it looks like right here
2:11we have an audio player but this can
2:14also act as audio input it doesn't
2:15matter what it is as long as we know
2:17that there is sound coming from
2:19somewhere and in this case it's going to
2:21be coming from an audio player because
2:22we want to play music now we have the
2:25sound but how do we actually project
2:27this sound or music or whatever it is we
2:30send this to an audio emitter is what
2:33this object is called and we can kind of
2:35think of this as a speaker so you pretty
2:37much know that Sound and Music can come
2:40from a physical speaker uh cuz that's
2:42where we're able to hear the sound
2:44coming from a speaker also known as an
2:47audio emitter uh that's being played
2:49from an audio player so we have this
2:52structure so far but that's not the only
2:55thing that we need because what happens
2:57if we just use an audio emitter or this
2:59speaker to project sound it's just going
3:02to project the sound into the world uh
3:04with nobody to listen to that sound so
3:07what do we need to do we need to add an
3:10audio listener but you may have noticed
3:12that these two are not linked together
3:13that's because an audio listener uh
3:16simply just needs to listen for a
3:18specific sound coming from this audio
3:21emitter as long as they're in the same
3:22audio group now I'm going to introduce
3:24you to that later in this episode but
3:26basically this audio listener we can
3:28treat this as our ears so our ears
3:31Listen to Sound and Music so when we
3:35hear music coming from this speaker
3:39that's how we're able to capture the
3:40sound to know that this is where we're
3:43hearing the music from and finally what
3:45we do is we link this audio listener so
3:48we have the uh the music or Sound or
3:50whatever and we link this to an audio
3:52device output so that we can actually
3:54hear the sound in the game this is a
3:57basic structure of how you play music
4:00thinking about this in terms of how the
4:01new audio system works and it's kind of
4:04difficult to get your head wrapped
4:05around it at first but I'm going to show
4:07you what this looks like in Roblox
4:09studio so we're going to be able to
4:10implement this so I hope this part made
4:12sense to you just a little bit okay so
4:14we're now going to try implementing what
4:16I just showed you with the previous
4:18model that's shown right here uh that
4:20basically allows us to have an audio
4:21player with a certain song and we're
4:23going to be able to project it in the
4:25game uh by doing so and the first thing
4:27we're going to do is try and look for a
4:29song inside of the audio Marketplace it
4:32really doesn't matter which one you use
4:33so I'm just going to insert this one
4:35that I just found right here so I'm
4:36going to hit insert uh so it's going to
4:38be inserted on the right side of the
4:39screen what I'm going to do is copy the
4:42sound ID so I'm going to uh click on
4:44this hit contrl + C and then what we're
4:46going to do is actually delete this
4:47because we're not going to use the
4:48actual sound we're trying to create our
4:50own sound structure so what we're going
4:53to do now is make a folder so that we
4:55can organize our structure so I'm going
4:56to create a folder I'm going to call
4:58this one audio player example I'm just
5:02going to call it that and what we're
5:04going to do now is click on the plus
5:05sign we're going to add an audio player
5:09so if we hit the plus sign we're going
5:10to hit
5:12audio player so this is what it looks
5:14like right here so we're going to do
5:16that and then once we go into this audio
5:18player there's a bunch of properties
5:20here but the thing that we're most
5:21interested in is this property called
5:24asset ID so we're going to click on this
5:27going to paste our asset ID and it's
5:29going to say that it's ready and it
5:31updated the time length automatically
5:33for us to uh do so I'm also going to
5:35turn on looping so that we can
5:37constantly hear the song uh while the
5:39game is running uh so we now have our
5:41audio player which basically tackles uh
5:43the first step right here but now what
5:45we need next is an audio emitter so I'm
5:48going to structure this audio emitter uh
5:50by using Parts like we've done over here
5:53so I'm going to go to model I'm going to
5:55hit part and this part I'm going to call
5:58emitter and I'm going to put this inside
6:00of the audio player example and I'm also
6:03going to change the color so that it's
6:05distinguishable from the other ones I'm
6:06going to make this lapis okay so now we
6:09have our emitter what we do now is we
6:13insert inside of this emitter uh an
6:16audio emitter and this is what it looks
6:19like so we're going to click this this
6:21is our audio emitter right here and now
6:24here's the important step that we have
6:25to do so you noticed in our model I
6:28linked the these two together using an
6:30audio player and an audio emitter but
6:33how do we actually link these two
6:34together we use what's known as a wire
6:37uh to connect these two together because
6:39that's pretty much how audio Works in
6:40real life you connect multiple sources
6:42of audio together so that they produce
6:44sound so that's basically what we're
6:46going to do here uh what we're going to
6:47do is click on the plus sign on audio
6:50emitter and we're going to search up
6:51wire so it looks like this and on this
6:54wire we need to make sure that our
6:56source instance and Target instance is
6:59accurate so our source is basically
7:01going to be where the sound is coming
7:03from so the source we're just going to
7:04click on this and we're going to select
7:06our audio player because this is
7:08basically where the sound is coming from
7:09and we want to send this sound over to
7:13our Target which is going to be our
7:14audio emitter because this is where uh
7:16the emitter can produce the sound and
7:19make it project into the world so now
7:22that we have that what we need to do is
7:25insert an audio listener and we're going
7:27to make another part specifically for
7:29that so I'm going to insert a part right
7:31here and I'm going to call this one The
7:34Listener and I'm going to insert this
7:36inside of the audio player example so
7:38we're going to hit the plus sign here
7:39and then we're going to add an audio
7:41listener okay and so now we have an
7:43audio listener that's waiting for us to
7:45hear the sound but how do we know which
7:47sound we're trying to listen to
7:49specifically because there can be
7:51multiple audio listeners there can be
7:52multiple audio emitters so how can we
7:55tell the difference what we can do is
7:57set this property called audio
7:58interaction group to basically tell us
8:01that this is the right audio that we
8:03want to try and listen to uh from this
8:07emitter specifically so we're just going
8:08to call this um music just for just for
8:12Simplicity sake and so we're going to do
8:14the same thing down here with audio
8:16listener we're just going to call this
8:17one music and finally we need an audio
8:21output and you can put this audio output
8:23wherever you want but I'm going to put
8:24this inside of the audio listener so I'm
8:26going to hit the plus sign I'm going to
8:27add an audio device output so basically
8:31this thing right here and then I'm going
8:34to hit the plus sign here add a wire so
8:36that we can link the audio listener to
8:41the audio device output so that we can
8:44finally hear the sound coming from this
8:48uh part specifically so this is going to
8:51be the listener I'm going to make this
8:52one red so that we can tell the
8:54difference between them and this is
8:56pretty much our basic structure for uh
8:58our audio player but obviously we need
9:01to be able to play the sound so I'm just
9:03going to add a simple script inside of
9:05our audio player and what we're going to
9:08do is say script. parent colon play open
9:13and close parentheses and that is
9:14basically all we need to do for that so
9:17that is how we structure our audio
9:19player so now let's go into the game and
9:21hit test and hit play to see what
9:23actually happens and once again I
9:24recommend having headphones on so that
9:26we can really see the difference here
9:28okay so our music seems to working as
9:29expected we have the emitter and we have
9:31the listener but let's see what happens
9:34if I go into the server side I'm going
9:36to move the emitter this way to the
9:39right just a little bit if we go into
9:42the game we can now hear that the
9:44listener is on the left side of this
9:47speaker which is why we're hearing more
9:49of the sound coming from the left side
9:51than the right side and if we move our
9:55speaker this way uh to the left this
9:57time and our listeners on the right side
9:59we can hear more of the sound coming
10:02from the right side rather than the left
10:04side and this is really fascinating cuz
10:06like this gives us more control over um
10:10our audio levels where we uh project the
10:12audios where we project the audio from
10:14and all that sort of stuff and if I
10:16bring it closer and if I bring the two
10:19closer together like they are basically
10:20synonymous with each other then you can
10:23hear it very clearly from both sides of
10:26our ears so that is a really basic
10:29example of of an audio player and I
10:33think it's really cool okay now I did
10:35show you uh one of the examples at the
10:37beginning of this video where we were
10:39able to create multiple speakers with
10:41the same listener and they were they
10:43were both playing the same song at the
10:46same time uh it's really easy to
10:48implement this once we have the
10:49structure going on all we really need to
10:51do is just uh take our emitter duplicate
10:54it and then make sure that our uh wire
10:57is connected to the the audio player uh
11:00with the right target instance of the
11:01audio emitter so the only thing we need
11:03to update is this target instance to be
11:06uh in correlation to this audio emitter
11:09right here and so now we have two
11:11speakers playing the same song at the
11:13same time so if we go into the game now
11:16and see this change we can see um that
11:19it's working basically as expected okay
11:21so we're now listening to the music
11:22we're right here in the center with our
11:24listener if I move the listener closer
11:26to this speaker then we can hear music
11:30coming from
11:31this and if we decide to move it to the
11:33right side then we can hear that it's a
11:37little bit louder on the left side
11:39because our listener is really really
11:41close to this speaker on the left side
11:43but then if I move this over here this
11:45listener is really really close to the
11:48right side of this speaker so that's why
11:50we're able to hear it more clearly on
11:52the right side again it's very
11:54fascinating but it is hard to wrap your
11:56head around uh if you're new to all this
11:58but I hope that this gives you more
12:00insight into into the possibilities of
12:03creating your own audio structures in
12:05Roblox Studio okay now I'm not going to
12:07go in depth with filters and effects
12:10that you can add to audio but I
12:12definitely do think it's a cool thing to
12:14experiment with so if if I'm in this
12:16place this place is basically made uh
12:18for demonstrating this new audio API um
12:22we basically have uh the ability to add
12:25effects to the sound that's currently
12:27being played right now so we can add a
12:29pitch shift effect that adds pitch to it
12:31we can even Reverb it and then we can
12:33add an equalizer and we can also add a
12:36distortion to it so these effects are
12:38pretty cool you basically need to create
12:40uh an effect for each individual one and
12:43you need to link it to the audio emitter
12:45and that's basically how you manipulate
12:47the sound using it so again I'm not
12:49going to go too deep into detail with uh
12:51effects but these are still really cool
12:54features to have uh and to consider when
12:57you're manipulating audio in Roblox
12:59studio all right and the last thing I'm
13:01going to show in this video is how I was
13:03able to use my voice uh basically my
13:06voice chat to be used within the game so
13:10that there can be certain things
13:11happening like this NPC following me uh
13:14every time that I chat within the game
13:16it's a really cool feature we can now
13:18use our microphone to interact with the
13:20game world because before uh our voice
13:23chat was basically used to communicate
13:25with other players but this new audio
13:27API allows us to interact with the world
13:30using our own voice which I think it's
13:32very very cool so I'm going to show you
13:34a little diagram of what I did and I'm
13:36going to show you a little bit of what I
13:38did with the scripts so that it can give
13:40you so that it can give you a bit of an
13:42insight to know more about how this
13:45audio API works okay this looks kind of
13:48confusing but I will try to break this
13:50down to the best of my ability step by
13:52step what you're hearing right now from
13:54me is the audio coming from my character
13:57uh rather than my mic microphone that I
13:59normally use to record these videos
14:01because uh there's audio coming from my
14:03character but there's also audio coming
14:04from my microphone for recording this
14:06video which is why I had to mute it um
14:09but basically what we have going on here
14:11is uh a structure that looks similar to
14:14what we worked with before uh using an
14:17audio player so you might have noticed
14:19that we have an audio device input
14:21instead of an audio player uh everything
14:23else here seems relatively the same we
14:25have the audio emitter we have the
14:27listener and we have the audio device
14:29output but things are just a little bit
14:31different so I'm going to try and
14:33explain to you what the difference here
14:34is so we need to try and figure out
14:37where is the source of this audio coming
14:39from uh in our previous example it came
14:42from an audio player because we wanted
14:44to play sound or music coming from uh
14:47the toolbox's marketplace but this time
14:50what we want is an input coming from our
14:53microphone uh from our player so pretty
14:57much our audio device input is a more
15:00general term for getting an audio input
15:03from somewhere because before it was the
15:05audio player but in this case we want it
15:07to come from our player and so if we
15:09open up our players and open up our
15:11player we can see that there is well
15:14there's supposedly one audio device
15:16input but there's two of them just for
15:17testing purposes so I want you to
15:19imagine there's just one this is the
15:21audio device input coming from our
15:23player but now what we need to do is we
15:26have the sound but we need to be able to
15:28produce this sound and project it into
15:30the world this is where we need to use
15:33our character we're going to put this
15:35audio emitter uh also know as our
15:37speaker inside of our character so if we
15:39go to the workspace open up our
15:41character we can see that there's an
15:42audio emitter just pretend that there's
15:44one uh that has a wire that connects our
15:47input from our player to our character
15:51so I hope this part is making sense to
15:53you so far like we're basically taking
15:54the the the voice input from our player
15:57and we're going to project this onto our
15:59characters so that's how you're able to
16:01hear the voice coming from my character
16:04right now it's because we have an
16:05emitter that's producing this sound and
16:07it's coming from my character but now
16:10that we have that we need to have a
16:11listener of course and so we basically
16:14have an audio listener that listens for
16:16this audio coming from our character and
16:18if you remember we use an audio
16:20interaction group to specify which sound
16:24we're looking for specifically so once
16:26we have that then we're able to use an
16:29audio device output to be able to
16:31actually hear the sound that's being
16:33produced and in this case our audio
16:35listener is inside of our character and
16:38our uh audio device output is also in
16:41our character but specifically in the
16:43audio listener so this is how we're able
16:45to take the player's voice uh project it
16:48onto our character and then listen for
16:50it and then hear it on our character but
16:54here's one interesting thing you might
16:56notice that we have what's known as an
16:58audio analyzer you might ask what the
17:00heck is an audio analyzer this basically
17:03tells us that we can measure our audio
17:06to know how loud or how soft our uh
17:10input is in this case how loud or how
17:13soft my microphone is so this is how I
17:15was able to whisper so quietly so that
17:19uh the NPC couldn't hear me but then
17:21when I shouted really loudly that's when
17:23the NPC was able to pick it up and then
17:25move over to my character uh because we
17:28were able to use an audio analyzer to
17:30analyze this and I basically took this
17:32audio analyzer and I connected it to our
17:36uh microphone input and so with all of
17:39this we have a structure that allows us
17:42to do all these sorts of things now
17:45again just from this analogy alone you
17:47might be sort of confused with it but I
17:48highly recommend going through with this
17:50and just experimenting because
17:52experimentation and struggling through
17:54is what's going to get you to learn how
17:55this stuff works but with that being
17:57said I'm going to show show you what the
17:59scripts look like so that we can
18:00actually see this in action let me try
18:02and break down the scripts for you so
18:04that you can see how I was able to
18:05incorporate this new feature inside of
18:07my game um and the first thing I'm going
18:10to introduce to you is the NPC itself so
18:13this NPC has two scripts one of them is
18:15animating and the other one is follow
18:16player animates basically just so that
18:18the character can actually move around
18:19in the game and stuff but let's look at
18:21follow player so if we open this up we
18:24can see that this is referencing
18:26something inside of replicated storage
18:28so if we go to replicated storage let's
18:30open this we we can see that we're using
18:33an unreliable remote event called NPC
18:35follow and this is basically going to
18:38capture any firing that happens onto the
18:40server uh so that we can make the
18:42character or we can make the NPC move to
18:45wherever the character is also known as
18:47our player inside of the game wherever
18:49it is and then we're just going to wait
18:50until it finishes so right now this
18:52seems to be pretty self-explanatory it
18:54doesn't seem to be too complicated right
18:55now but let's go outside of here and
18:59what I'm going to show you now is the
19:01main script that basically allows us to
19:04have all of these things hooked up onto
19:06our players so that we can incorporate
19:08this uh audio design into our game so
19:11this is going to be a local script
19:13called Radio Chat I mean I basically
19:14just took this from uh that default
19:17starter Place uh that represents uh the
19:19the new audio uh but I modified it
19:21myself so that it uh can work with what
19:24I'm trying to do here so basically uh
19:26what's happening is let's go down here
19:28onto on player added so we're creating
19:31an audio input device and putting this
19:33inside of our players so basically this
19:36first step right here adding the audio
19:38input device uh trying to get the
19:40player's uh microphone uh and so we're
19:43also going to make an event every time
19:46the character has spawned into the world
19:48so we're going to go up here we're going
19:49to go into on character spawned and what
19:51we're doing now is creating an audio
19:54emitter and putting this inside of
19:55character and we're also setting the
19:57audio intera Action Group to something
19:59called NPC follow uh so basically it's
20:02this right here we're basically putting
20:04this inside of our character so that we
20:06can project sound onto our character uh
20:09whenever we get the input from the
20:11player's microphone we're going to
20:12project it onto our character and then
20:14we basically use this helper function
20:16called connect which basically just
20:18creates a wire uh that takes in um the
20:21source and then the destination so
20:22that's how we're able to create this
20:24line This linking together using a wire
20:27it's a pretty useful um helper function
20:30so that's what we're going to be using
20:32um but this basically takes in uh the
20:34microphone input which is the source and
20:36we basically made that down here which
20:38is inside of our player uh and then the
20:39emitter that we just created that's
20:41inside of our character so the next
20:43thing is we're going to create a
20:44listener and we're also going to put
20:46this inside of the character we're going
20:47to make sure the audio interaction group
20:49is the same as our emitter uh so that we
20:52can listen for the audio emitter but not
20:55directly using a wire or anything like
20:57that we don't need to do do that um but
20:59then we're going to create a device
21:01output an audio device output and put it
21:03inside the listener and then we're going
21:04to connect the listener to the audio
21:08device output uh and then so what we do
21:09now is we basically create an analyzer
21:12we set this up inside of our character
21:14uh and then we connect our microphone
21:16input to the analyzer that we just
21:19created that's inside of our character
21:20so that is another final step that we
21:22have to do for that so now we have the
21:24hookup what we need to do is basically
21:26use a while true do statement to
21:29constantly check if uh I'm talking
21:32inside the microphone we use the
21:34analyzer to detect if my voice is loud
21:37enough uh to then basically use this NPC
21:40follow uh unreliable remote event and
21:43fire it so that we can use the uh NPC's
21:47follow player script to then follow my
21:49character wherever it is inside of the
21:51world so that is something that we uh
21:54pretty much do with our script so if I
21:56go back we can see that with our while
21:58your du statement it's going to
21:59constantly say that there's no sound
22:01being produced but once the analyzer
22:03picks up our RMS level to be anything
22:05higher than 0.1 so that's when I'm like
22:07shouting and stuff like that um because
22:09zero is like no sound is being produced
22:11at all 0.1 is like the bare minimum
22:13we're going to fire the NPC follow it's
22:15going to be sent to the follow player
22:17and then the NPC is going to follow our
22:19character so that is basically how it
22:21works and that is the basic rundown of
22:23how the script works so if I go into the
22:25game that's pretty much what it's going
22:26to be like uh where the NPC is just
22:28going to be following me and that is the
22:31basic rundown of how I was able to
22:32script this inside of Roblox studio and
22:35I honestly think it's very very
22:36fascinating now here's my recommendation
22:39for if you're adding your own audio
22:41structure to your game I definitely
22:43recommend having some sort of diagram or
22:45structural layout so that you can
22:47visually see how all of these audio
22:50objects are are connected with each
22:53other because if you were just to look
22:54at this inside of a script you'd be very
22:56confused having to just just like go
22:58through see what's being connected
23:00what's not being connected and things
23:01like that uh or looking at it inside of
23:03the Explorer I think it's definitely a
23:04lot better if you had a visual
23:06representation like this uh so that you
23:09can understand this I definitely
23:10struggled with this a little bit when I
23:12first learned about this but uh
23:13struggling through just to like learn
23:15how this stuff works will definitely be
23:17beneficial for you in the long run and
23:19that is just something I recommend and I
23:20hope you're able to take away a lot of
23:22information from this video and you
23:24found this to be extremely extremely
23:25valuable once again I hope this video
23:28helped you a lot um there are some
23:29things in this video that I did not go
23:31over like being able to call up somebody
23:34else that's inside of the server like if
23:36you had a walkie-talkie or if you had a
23:37phone you can have a phone and you can
23:40call up somebody else like another
23:42player who's on the other side of the
23:43world and you can hear them through the
23:45phone which I think that's also very
23:46cool but I'm not going to go over how to
23:48do that inside of this video um but I'm
23:50just throwing out more examples of the
23:52possibilities of what you can do with
23:54this new audio API once again this audio
23:56API is in beta so I don't think it's
23:59fully so I don't think it's released to
24:01the public right now but I highly
24:03recommend going through and
24:04experimenting with this new API because
24:06there's so many new possibilities you
24:08can do with everything that this API has
24:11to offer now so if you really liked this
24:13video then I encourage you to like this
24:15video and also share it to other people
24:17who you think might also find this sort
24:19of stuff to be fascinating or just or
24:21just something that uh your friends
24:22would want to learn about um but also
24:24subscribe because I'm going to be having
24:26more videos like this in the future so
24:28if you really liked it then be sure to
24:30be on the lookout for that um my Discord
24:32server is in the description so if you
24:33want to meet other like-minded
24:35developers then you can do that as well
24:37um but that's going to be pretty much it
24:38for this video and with that being said
24:40I will see you in the next episode take
24:42care

About this transcript

This page contains the full transcript of The Capabilities of Roblox's NEW Audio API (Voice Filters, Analyzers, etc.) by BrawlDev, generated from the public captions YouTube serves with the video. The transcript has 5,093 words across 673 segments, with the original timestamps preserved so you can click any line to jump to that moment in the embedded player.

What you can do with it

Use the transcript to take notes, quote the speaker, build a study guide, generate a summary with ChatGPT or Claude via the YouTube Summary tool, or export it as a timed subtitle file with YouTube to SRT. You can also re-open it in the transcriber to choose a caption track available on the video.

Free YouTube transcript tool

YouTube2Text is a free YouTube transcript generator — no signup, no daily limit. Paste any YouTube link and get the full transcript instantly, with timestamps, click-to-jump, caption language selection, AI prompts for ChatGPT, Claude, and Gemini, and exports to TXT, SRT, VTT, or Markdown.