Friday, August 31, 2012

What Does A Ninja Sound Like?

Welcome back to part two.  It's been getting a bit hectic trying to wrap up several projects and get a ton of new stuff rolling but I'm going to get a little more technical and in-depth on this article because I wanted to share some more in-depth information.  

I should note that my production workflow has been extremely loose from project to project in terms of sync and audio capture.  I don't normally bring in my audio and try to sync inside of my NLE.  Instead, what I do is just leave the in-camera audio on the NLE's primary audio track and label it Scratch.  During picture lock, which is the stage in which I can safely say I will no longer be making any time-based changes to my arrangement of clips or their lengths I begin exporting the project to work in my DAW.  Typically this is done via OMF export options.

 One thing I always do as I start editing and importing audio into Sonar is it's crucial to find the spots where transitions or cuts happen in the video.  As I work to the picture and import my sounds and start placing them on the timeline I find the cuts in the video and place markers on my timeline for easier recall.
This has helped saved time especially as a workaround for Sonar's lack of real-time video scrubbing (at least for me).  It seems that for some reason no matter which file format I work in or resolution (HD / SD) I still have buffering issues with Sonar: The further away from the beginning of the timeline I get the longer it takes to respond to user input.  In this regard I think my next video projects I'll try Avid Pro Tools seeing as how they've had a long-standing history with working to picture as it's been the industry standard for such a long time.  I just haven't had the chance to do this yet, as Sonar is my most comfortable DAW and one I instinctively gravitate to.

A huge workflow tip: as I edit and mix is using the clip features in Sonar such as creating clip groups to keep multiple audio tracks in sync with each other.
This practice helps keep me moving through spots quicker.  Even in the picture above there are 2 clips overlapping in each of the audio tracks.  I grouped each one separate so I can still edit the timings between the clips if I need to.  You can also group large quantities of clips spanning various tracks together (great after building a "sound" up from various elements and not quite ready to create a bounced stem).  Once these clips are grouped things like slicing and fades and trimming apply uniformly to the entire group.

Once I've got the audio where I want it and things match up to picture well, I make avid and religious use of the clip lock features in Sonar.  I clip locked both the data and the position to show this case:
Sonar allows independent locking of both Position and actual clip data.  I normally just clip lock position and then can come back to it later for doing things like clip automation (gain, fades, etc.) but in this case I don't need to do any of that so I went ahead and locked both position and data.  The biggest benefits for independently locking these two ways of manipulating clips is to accommodate the different workflows: 

Example:
building a sound design element it's usually more crucial to have the sound in sync before working on the actual sculpting of the sound, therefore locking position can assure you that while you affect the clips with plugins, fades, and even trimming (not affected by position lock), the clips are not accidentally moved. 
Example 2:
Clips that require movement but want their particular trims, fades, and other clip-based edits to remain intact while you move them along the timeline, the data lock ensures these do not get altered.

This provides a huge advantage of saving yourself from trouble later on in the event of mishaps like the program locking up or hanging for a moment while you're making selections / deleting / moving things around.  The most common mistake is ending up way ahead in your project before you notice something is missing or has changed due to one of those overlooked circumstances. 

It's Wednesday, May 9th (just over a week after the original shoot) and I've managed to rough in all the audio for the first spot - the 60 second Ninja version.  I first set out to capture the worldization of the music track to blend in with the actual song and give the music some room to sit in the visuals and then pop out when it's supposed to.

It's worth noting the time frame in which I'm working.  We did all of our pick-up shots this same day I'm already beginning audio work on picture-locked versions of the commercial.

Projects like this usually have a 2-3 day turnaround time if not less.  In fact, in a future blog article I will discuss time-frames on my other commercial project Zenergy Band.  Long story short, a full day of shooting with a rough cut turnaround to the client in just 6 hours after the production wrapped.  But for now, back to what Worldization is.

Worldization is a clever yet simple technique (in concept) of playing back a sound or sample into a given environment, and recording the new sound as it's interacting with that environment.

The commercial spot has several different ranges between each of the 3 ninjas and the main actors sitting in the back room.  The music track ended up being a last minute selection to fit the deadline and still fit the mood of the commercial.  Since I can't be on location I set up 3 mics in my house and just used my JBL's to play back the solo'd music track, with the microphones' 'input echo' off (so they don't feedback into the recording).























The first mic I put up was in the middle of the hallway.  I opened the hallway closet up to help with some dampening so it didn't sound completely like a hall.

The 2nd mic is the Audio Technica in the far end of the room adjacent to where I'll be playing the music from.  The Rode NTG-3 is placed closest to the room but facing as off-axis as I can get it, and aimed directly at the wall just feet in front of it almost perpendicular to the direction of the sound source.  This should help enhance low-end reflecting off of boundary surfaces as large as the wall it's aiming at which is also in front of a small cove for the entry way that naturally enhances low frequency content.

So looking at the screenshot above again The green automation lines represent the volume changes throughout the tracks to simulate room changes when the camera cuts between locations.
here it is again if you don't wish to scroll....

The next step was to record Foley for the sword whirling and clothes cutting. I called Troy up to come over and help out as running Foley sessions is a 2 person job at best.  The first thing we discussed was tackling the sword whirling sound and we went through several items and settled on a broken power extension cable.
There's a particular setup I'm using with 3 mics.  I chose this method to give me the greatest range of options for panning and color as each mic is distinctly different.  An Audio Technica 3035 (cardioid condensor), Rode NTG-3, and an AKG C414 in Omni placed high up to get more ambiance.
Moving positions for the "ripping" foley.
The microphones' various recordings came out perfect and I ended up with an LCR approach to the mixing for stereo.  I imagine if I ever had to upfold this project or completely re-mix it for a 5.1 surround track I would have more than ample material to place in the 5.1 mix and still maintain a good balance and presence.

The editing workflow I use is pretty solid to me a this point as I've done several projects that have steadily grown in audio demands and complexity or have allowed me the freedom to experiment (which is a great opportunity to have)! 

While getting to see the project and all the edits I did. It's much more helpful just to describe my workflow and the order I like to do things in.

After capturing the audio the first thing I did was move the audio tracks far down the timeline away from any of the actual commercial material although ideally I would have just created a separate project for the recording session and what I'm about to describe next.

The first actual bit of work I set out on these audio clips is to clean them up, which involves denoising and any sort of effects for processing to get rid of unwanted background noise.  Once these are applied (which I normally do to each clip individually, and not the track), I then bounce the clips to commit the processes to audio.  Then, I begin slicing up all the useful bits and deleting useless audio gaps.
Sonar has a cool little process that can be applied to clips on the timeline that remove silence.  However this tool still requires some finessing and the volume levels of our Foley session vary so greatly it was easier and quicker just to manually slice the bits I needed.  After all the cutting, fades were applied, then came the arrangement of those clips which you can see their final place in the image above.

It's now Thursday, May 10th and I've just gotten to the point where I can transfer all the audio work I've done from the 60 second ninja spot.  I now have to build the audio for the 30 second spot.

I felt like exporting all my tracks out of Sonar individually to try my hand at working to picture in Pro Tools later.  Sonar has some really cool ways to easily bounce tracks and commit to audio all the Effects and even track and bus automation.  Note, this is not my workflow process I used since I actually stayed inside of Sonar for the entirety of the project.  I just want to highlight a really useful feature for quickly getting a project like this out of this daw and quickly into another daw like Pro Tools.

I highlighted all the tracks I want to export individually, and go to File > Export.

This is where I need to pay attention to my output options.  Sonar can output the tracks I want but I don't want it
With Tracks selected under Source Category, I un-check the box for "Track Automation" and since this is bouncing out the tracks individually before they hit the buses I don't have to worry about bus automation.

I normally un-check Fast Bounce just as personal preference but it really doesn't matter as any quality difference between Fast bounce and normal bounce is completely inaudible in most cases.




The next thing to follow immediately when I click save is a dialog box:

Sonar will not let you hit save unless you type something in the file name area.

I chose to simply put B and hit enter and this dialog box appears to confirm the following Actions Sonar is about to perform.

It clearly shows each individual file that's going to be created in the place I chose to save them, and that they all have a prefix "B" and Sonar automatically formats the file name with B-*track name*.wav

A really handy feature to have, as well as time-saving.

Sonar renders out the audio in one pass so it can take a while to process and write all the individual files at once.








I saved out OMF files for each of the individual spots and opted to simply rebuild audio for each of the 4 commercials individually.  I have greater control inside of Sonar and don't have to deal with the limited interchange options for audio from inside of Premiere Pro this way and thus I can move much faster.

The OMF for the 30 second ninja spot gets saved out the new project file.  Import the video track and set up the buses.  Here's the new template:
More cool tips!  Sonar has lots of hotkey commands that help save time.  When opening an OMF the audio tracks are placed on the timeline with the clips properly but the default selection is their outputs just go to your audio hardware's first output, and there are no buses. So the first thing I do is create a master bus.

Right clicking on the bus and you'll be able to see the option to "set as default bus".  A cool time-saver for future tracks that get created will now immediately route to the master bus as their output.

Next I simply create the remaining buses I know i'm going to use for the mix later on and these will all automatically route to "master":
  1. Voice
  2. SFX
  3. Music
Now comes the interesting part.  As I import the audio tracks I tackle track management and start creating folders and sending the tracks to the proper buses.
Here's another cool little time saver.  I can just select the tracks I want to put into a folder, once I have them all selected I just simply right click and there's an option to "move to folder".
This can work in various ways but since Sonar only has 1 folder level to work with, if audio tracks already reside in folders the option will not be there, instead "move to folder" will be replaced with "remove from folder" and then you have the option to place the tracks into existing folders / new folder.

Since I imported the tracks all at once, they are all routed to the master bus. I simply just open up the folder track and select all the tracks within.
Shift+click at the bottom track in the SFX folder to select all of them, which brings up the last track selected in the channel preview on the left side.  The default bus is still Master so hold down CTRL and select "SFX" as the new bus.  this applies the new bus selection to all the selected tracks.

Next, I have all the audio tracks and clips selected in the timeline I want to trim all the silence away and leave me just the audio material clips to move around and re-fit for the 30 second version.
The dialog box appears for the Remove Silence tool.
I set the open and close level to -68 dB.  The settings above seem to produce good cuts without any sudden pops or clicks as the waveform leaves 0 degrees.  The look ahead also gives ample time for changes using the 2 millisecond buffer in the attack and release times.  It's worth noting that I'm choosing to use this tool here instead of earlier doing the original cuts to the foley session as on these rendered out tracks there is "true" silence.  There should be no clutter and I should be left with only the audio clips I want and already edited.

I saved the settings as a preset (because Sonar doesn't come with any default ones). Run the tool.  and below is the result from the trimming.
Now to focus on placement for the 30 second version and figuring out how to tackle the music track for the shorter play time.  It's back to the routine set up, placing markers along the timeline to mark the shot changes in the video.  Moving and trimming the clips to fit the shorter shots, and then re-mixing the music with automation.

Between the 60 second and 30 second versions of the Ninja project, I have all the audio material I need to use these two project files as templates for building the biker's 60 second and 30 second spots.  I simply saved out each project file (copying audio to a new folder) and named it accordingly. This choice in project management allows me to keep additions to sound clips added in for the biker content like the bikes pulling up in their respective project folders and not cluttering up the whole project.
As I wrapped up the first two (one sixty second Ninja and Biker version) I uploaded them privately on youtube for the client to review.  The okay was given and they asked for a 2nd variation at the end where the tag-line was different.  This was a simple edit, in Premier Pro I simply swapped out the last clip with the correct one for the new tag-line, keeping the same length.  In the audio projects I simply saved the project and labelled it "alternate" to identify each of the 4 commercial projects with the new tag-line, dropped in the voice track and synced it up and processed it.

Mixing was a bit more of a duty to attempt uniformity across all the projects but still simple none-the-less.  Since I didn't have any of my plugins or processing done until after all the project files had been duplicated from each other, I simply went in to each track and bus and saved out FX Chains and Presets from the plugins, and simply followed the load-out on each of the projects.

Now, with audio mixed and mastered, I headed back into my premier pro project file and loaded up the appropriate audio files to replace the audio of each sequence.  Finally, text was added and final grading was done, and the results are now posted on youtube... The time difference between when I finished a bulk of this work and actually closed out the project was due to a client hiatus. Sometimes things happen and when projects reach their milestone like this and the client is unable to give any feedback or communicate they are ready for another step forward in the project is when ultimately I am stuck sitting on my hands waiting to be told what to do.

Some insight: []  We shot this on a shoe-string budget, with a small schedule expecting a short turn-around.  I had all 4 commercials ready for the client to approve and deliver within the first 2 weeks but because of unforseen circumstances on the clients side, communication breakdowns occured and my producer and I were left waiting for approvals on things for almost 3 months.  However, most of the work was paid for (aside from some of the editing).

IF jobs like these pop up, always make sure to cover yourself legally, or at the very least as a work ethic demand payment up front in full.  If for some reason political aspects begin to play into the business end of things like getting paid for your work, you need persistence and follow-through to make sure you get paid.  I've learned this the hard way through the years of growing my business from the ground up.

I'm not saying this out of personal aggravation (though there was a little of that). I understand this happens and the catch here is learning not to take things like this personally, it's just business, and in the end whether you get paid or not you have only your sanity.  Roll with the punches, don't get angry when they hit you.  Keep on trucking, and do what needs to be done.

Wednesday, August 29, 2012

How to The make The Cut


Building several commercial spots on the fly was a blast, and a challenge.  I had gotten a call from Harry just a couple days prior to the shoot day which was May 1st.  The idea was to go out to San Jose on short notice, and Harry already had the idea complete in his head so there would be no actual script or storyboard or shot list.

On May 1st, I got up super early to pick up a make-up artist acquaintance I had met through a mutual friend that does photography.  I was all the way out in Escalon (the opposite direction I needed to go) picking up Ava Nightingale who was to be our makeup artist for the day, then zoomed out to San Jose to meet at the Moda Italia store by 10 AM.  When we arrived there was no one even there which gave me and the makeup artist time to go to the nearest store and pick up some makeup supplies she needed.

When we got back Harry and Daren had just arrived and Daren was already dressed in a ninja costume.  Harry wanted to get rolling on shooting and thus Daren and I shot all the establishing ninja scenes where they pop from all corners of the store and converge on Cary and Harry sitting in the back room.

As we wrapped up those shots The other two extras arrived to begin dressing up as Ninjas and prep for the group shot..
Harry's favorite production method to keep time down and crew size minimal is shooting MOS.  So after getting all the takes of the ninjas approaching before they were to strip down for the next group shot of them having their clothes cut off, I took some time to get foley sounds of the footsteps and weapons.
Cary Tagawa arrived as we were setting up for these shots and proceeded to get him dressed and makeup.
Ava Nightingale working with Cary Tagawa.
Once Cary was dressed, I started getting feedback from Harry about the next shot while Melissa Andarmani (who works for Moda Italia) helped the ninjas get suited up for the next shot.
Harry had all the ideas in place for his "story" which is the ninjas coming out from all corners of the store and converging on Cary and Harry who are sitting in the back enjoying some quiet time.  He would tell me roughly what he wanted to see and I would get the camera position and dialed in.  On such a quick time-table, these shots were all done with a single T2i on a tripod, with no assist.  I have multiple SD cards and with the down-time between shots long enough to allow the camera to rest I kept swapping out cards to transfer to a laptop I brought with me.

During some of the down time I used to review shots, and I quickly noted that we had prepped a box of "clothing confetti" but never used in the shot for both the Ninjas and for Cary's slicing and dicing shot.  We ended up having to re-shoot both of those while we had our actors and extras on-set and in their clothing still.  Had I not reviewed the footage I would never have gotten those shots to help sell the effect of their clothes getting chopped off.
The other thing I've been aware of for some time now is that Troy's camera always produces a faulty pixel in the video image.  I've been unable to track down whether or not this was an issue up until my most recent shoot doing the Zombie Apocalypse Trailer  when I had the same issue regardless of switching out lenses.  Thankfully Tomas had let me borrow his T2i for use with that production.  This commercial project however would have to suffer the issue.

While it's not a complete nuisance, there were other issues with his camera.  His lens even though completely clean and free of artifacts presented focus problems, as if the only area in focus on the lens is slightly to the right of center, and it wasn't an issue with aperture settings or depth of field.  So in some of the shots you can tell I'm trying to get a focus I just can't get.  Unfortunately this was the only wide angle lens I had with me (much less had access to period).

Because of the quick pace of production with me and Harry handling it all, we ended up not using any of our lighting gear which we brought, and during the slicing and dicing scene with Cary, you can see the reflection of Vincent who's already fully clothed ready for the next shot, throwing the "clothing confetti" from off-camera into view to sell the effect of Cary slicing the clothes up.
Left circle: Vincent throwing the confetti.  Red arrow: pointing out the faulty pixel in the video.
Sometime after this we got to shooting the tag-lines with audio Cary was to deliver the brand at the end of the commercial with, and noted several good "lines" that Harry wanted to use in post later.
At this point I was using both SD cards, one in the camera, and one in my Zoom H4n.  I followed Harry's signals to get audio rolling, and worried about sync later in post.

The Zoom has some wonderful features like being able to record at 96k/24 bit but for this I opted to record at 48k/24 bit wave to allow me to capture the performance with not just my Rode NTG-3 (pictured above on a tripod and wind-jammer) but also the built-in stereo mic setup on the Zoom itself.  I placed the zoom a decent distance away from Cary and completely off-axis to his projection angle toward the camera to capture more of the room tone and ambiance should I need the material for anything in post.

The bikers arrived some time while we were wrapping up the master shots of Cary standing with the ninjas.  They had to dress down and get into their formal outfits for the master shots with Cary as well.  Then we quickly moved on to them with their clothes cut off from Cary's attack.  However, on this shot I never caught the fact that we didn't use the confetti and was stuck with the slightly less cohesive footage.
I personally would have liked to pick up a take for this as continuity for me felt broken.  To make matters worse, when we wrapped at 2:30 pm we never got any of the shots of the bikers in their original outfit pulling up to the store to intro them into the scene.

I noticed this and some other "shots" were missing when I got back home and started doing my dailies.  In the case of the digital workflow we're using, Dailies refers to bringing in the video files to my NLE and beginning the labeling and sorting and building rough timelines to get an idea of what the "sequence" will look like.

Immediately I called up Harry and let him know we needed to schedule a pick-up shoot which ended up being a week from that day (Tuesday the 2nd, the production day was Monday, May 1st).  This gave me time to build as much of the commercial as I could.  The way I work is by roughing in the scene for continuity, before I start trimming down for time considerations.

While we were able to get cooperation on the re-shoot, only Vincent could make it out for his "fitting" with Harry to get a pick-up shot we missed, Joneil couldn't make it out on that day.  For the bikers arriving out front of the store only 2 of the bikers could show up that day, and one of them was not from the original group, but another friend of the Biker that did show up for both days.

I was pretty happy with the results we got from the pick-up shoot day especially getting some nice audio for the bikes pulling up.  On top of that we were able to get the shot of the guys getting off the bikes and then heading into the store for the 60 second version.

There's lots more to discuss, up next I discuss the Post production workflow.  For more information and to see the commercials, go visit our site:  Neologic Studios.

Wednesday, August 22, 2012

Color me purple...

Getting the last bits wrapped up on the Arcade design project.
I'm hoping I can have this one wrapped up by the end of this week, so that leaves me 2 more days to work on it and get in final approval.

I've also been working on quick-mixing and mastering the 5 songs I recorded on saturday with my client to send out the mixes on Friday.  I've been talking with the client about their upcoming plans and it appears they want to prepare a mix-tape of their work soon, so we'll see how things roll into the near future.

I just sent Steven Hasting an old unfinished project we started last year and he decided to post it up on soundcloud, enjoy!

In the meantime, i've been slowly getting back to sound-design on my dubstep remix mashup of Rob Zombie's music in the "Zombie Apocalypse" project, and while the creative juices are down I've been getting close family and friends who are interested to start reading and giving me feedback on my novel.

Sometime in the near future i'll be scheduling a google hangouts session for an web interview with the developers of NovaCut, a collaborative online based video editor application.  I've made friends with two of the developers and have been in sporadic contact discussing various components of the video industry, politics, and straight down to production methods Neologic Studios and myself employ.  I'm incredibly interested in seeing what Novacut can do to really shift the whole paradigm of video and motion picture production as it has the potential to greatly advance the democratization of the whole industry.

Connecting this tool to some huge DIY and true independent filmmaker communities like IndyMogul







And even the audiences of great youtube and internet DIY channels like
Film Riot










And Freddie Wong
could blow the entire industry right into the next generation of multimedia...

Well, that's my two cents anyway.










Looks like Lauren got her demo reel up online that I built for her.
I'm also going to be pushing to have these open commercial projects closed this week too, which means I'll have more behind the scenes and in-depth looks at these projects coming up online soon!

Wednesday, August 15, 2012

Looking for work?

The last few weeks have been crazy trying to get things in order.  I've been rounding up projects, finishing up a couple in particular: The Arcade box Design for Mikey.  I've also finished a couple small projects: a video reel for a friend of mine Lauren, as well as Harry re-modeling a logo for an upcoming project he's been pushing forward on.  We're still waiting to wrap up the two commercial project campaigns I worked on back in May, but as soon as they're wrapped I'll have lots of updates.
1st design iteration
As I started to get more characters placed and sent the client a picture for reviewing on the "direction" he wanted the design to go, I was given instructions to lose the "logo" in the center and do more of a collage.
2nd design iteration
After updating the client again I got more information how how he wanted the collage to look, and he sent me a few for reference:
3rd design iteration
3rd design iteration update
Should have this project done this month, I've had the Dubstep remix on hold for a short while thought I'm still touching base with it and will be getting back to producing it very soon.  I've had to take care of some serious financial stresses and as soon as I can get myself situated in that area I'll have the ability to mentally focus the project down and have it released by the end of this year if all goes well!

I have a couple other growing projects, taking on a client / label that is going to start needing steady mastering work.  Will be mastering a project tomorrow, and negotiating for further projects down the line as well. 

The studio has some projects on the back-plate that might get moved back to the front of progress continues well with these I'm wrapping up.  A sample catalog is in the works, along with a roayltay free music elements catalog for game and interactive media developers. 

I'm going to announce this on here just as a "possibility" of opening up a new youtube section for Neologic Studios and producing a weekly series of DIY and tutorial videos for audio production.  There's no telling when / if this will happen, but the idea is that they would be short, concise videos that highlight a particular product in demonstration, used in a project we are working on, and give an in-depth look at it's use; to DIY projects and how-to's.  If this interests you, get some discussion going on this post's comment section!