☴ ANALYSIS: iPhone 7 binaural videography

iPhone 7 not available in blue.

There's a saying in the film industry: "nobody gives a f5ck about sound". Although that's not strictly true, it is one of the first areas to be compromised in a tight spot during production.

Apple does give a f5ck about sound having employed the likes of Tom Holman to consult on audio direction.

Whilst I believe the iPhone 7 lack of headphone jack is no big deal considering a wired connection remains possible with an adapter, and everything else like dual lenses, stereo speakers, and fast f1.8 lenses is playing catch-up with Android and Windows 10 Mobile Lumia, there remains a glaring omission in the contemporary iPhone spec sheet.

After nearly 10 years the iPhone does not record binaural video (I say binaural video because saying stereo video could mean a stereoscopic 3D effect, but I mean the two-channel sound with video).

The iPhone certainly has enough microphones to have a binaural recording capability. From what I've seen of mic positioning there has been no major changes with iPhone 7 - it has three - one on the front, one on the back, and one on the bottom edge.

This is precisely the same mic positioning as the HTC 10 which does record binaural video. So this is a choice being made by Apple to not record binaural video, not a technical limitation.

Now it might be that Apple are waiting for another design iteration to "do it right" (the HTC mic positioning records mildly biased stereo because left and right channels are not capturing vibrating air molecules equally and it is applying algorithmic compensation and noise cancellation DSP which increases the noise floor with digital uglies in certain scenarios).

Tom Holman's initials form THX (Tom Holman Crossover).

But when? It's been almost 10 years since iPhone dropped and we are in a vibrantly sounding 21st century that would be lovely to capture binaurally with all that hosing of iPhone video.

Clearly, binaural video recording is not important to corporate Apple since Sony Xperia have been offering high end models with binaural video recording for years, and very good it is too. Again it is clearly a choice by Apple not to offer the function because they see it as not important enough to make their list of priorities.

But here's the thing. If you're someone who appreciates sound and making your own recordings, once you've experienced the depth and breadth of decent binaural recording you just don't want to go back to monaural.

There are third party mics that record stereo (the Shure MV88 comes to mind - very good it is too but ultimately creates a biased stage due to it being on the other end to the lens) but the Airninja Movie Method is about less - less to carry, less to remember, less technicalities, just record your damned movie and be assured of decent results by default with a device straight out-of-the-box.

I appreciate that the telephone is a monaural device but an iPhone is so much more than that. It's a pity that out-of-the-box iPhone only creates monaural content. Proof, if any were needed, that binaural sound remains a niche interest - and therefore, opportunity.

The iPhone 7 is also 'water resistant'. The top end Sony Xperia are essentially waterproof in freshwater shallows (IP68) as demonstrated in the following binaural video which ends up fully submerged underwater.




There's just zero reasons for current iPhone to be the airninja's first choice.

iPhone SE - A Lot To Like

So the 4" screen iPhone SE is here, retailing in the UK for £439 with 64GB storage onboard.

The real kicker? It has the guts of the latest iPhone 6S inside in terms of A9 processor and 12MP iSight camera with focus pixels.

For an airninja like me that is very very tempting. Why? Apart from the fact it is simply light and powerful and strips away a lot of the flimflam.

Over the years my iPhone usage has matured, much like my iPad usage - which has fallen away completely. I'm old, I'm boring, I don't play games (at least, I have played my favourite genres to the point of boredom) - the idea of having an understated - yet powerful - iPhone appeals.

And I've had extensive use of all the public iPhone form factors at this point.

I started using big screen phones with the Dell Streak, believing that I would soon be able to get real meaty work done with the occasional attachment of a keyboard. It's never really happened though - my usage pattern has basically reverted to iPhone for comms/navigation/camcorder and any heavy lifting done on my 2013 13" MacBook Air - if that computer is tied up doing a heavy render I reach for a ChromeBook to do stuff.

I think this is a result of failed mobile UX paradigms as much as my own brain calcification. Which ever way you look at it, editing a video is fiddly on a small screen (I attach my 13" MBA to a 24" display for proper narrative video editing sessions - though I did edit my first feature film on the 12" screen of a PowerBook).

There are a couple, and only a couple, of reasons I will resist pulling the trigger on a 64GB iPhone SE purchase:

1. My current 128GB iPhone 6S Plus has 61GB storage free - this tells me that 64GB max storage just isn't going to cut it for me without additional admin/habits.

2. The size of the iPhone 6(S) Plus means it has a huge battery relative to smaller models. I am just not concerned about shooting video all day whilst powering a microphone on the lightning port. Take that battery away and it becomes a choice of lightning microphone or an external battery pack - and, that's right, potentially a whole bunch of admin.

It's a case of iPhone SE at £439 (still a significant chunk of change) vs my iPhone 6S Plus at £789 though - and the airninja movie method has always been about grasping value propositions early on. For my actual usage, I suspect the iPhone SE with 64GB would do just fine (after all, I have made feature films using iPhone 4S - albeit with onboard mics and an external battery pack).

Remember, zig when they zag. Avoid the mushy middle. It is tempting.

Relax. You're Quite Safe Here.

How new interest in VR could re-ignite the music video and album sales.

Not wearing headphones.

There's been a lot of chatter recently about VR (and AR) from the usual suspects. Apparently the tech is a lot better looking now, you know, realistic and immersive.

The immersive part always makes me laugh. I can be immersive with a pair of headphones and a decent binaural recording. I can be immersed reading a book. Imagine! I digress.

The point was, the narrative goes, VR failed in the 80s/90s because it was clunky low resolution shit.

True dat.

VR - then.

VR - now.

It was also true that gaming in the 80s/90s was clunky low resolution shit. It fucking rocked and a new industry was born - well documented in crowdfunded Bedrooms To Billions for one (I particularly like the founder of U.S. Gold admitting that he had no idea what he was doing).

So VR failed, 8-bit gaming skyrocketed through to the consolidated industry we know today. Stay with me.

Sitting passively wearing headphones. And that other thing.

I believe that VR may continue to fail whist it is physically non-passive. It will appeal to paintballers and lots of other people but who will actually prance around all day in that get up? I don't see it being as big as console gaming (famous last words of course). You can sit playing games at a console all day. VR all day? Be my guest.

Gaming, in common with watching movies, or watching a hybrid of the two - a Twitch stream - is largely passive, hypnotic.

Contemporary VR you must be awake standing up looking around bending reaching tripping over your furniture.

So even though today VR may look amazing it's is not a medium to be frolicking in for hours on end around staircases.

So, by my reckoning, VR must become a more passive activity to succeed - whatever success is nowadays.

VR reminds me of 3D in the cinema - it's going to be rolled out every generation to see if it sticks.

Anyway.

Passive VR. Immersive. Remember what I said about headphones and binaural? This has lead to a boom in Youtube videos promoting ASMR - sounds that make you feel good - and discussions around frisson - music that makes you feel good.

Strikes me that ASMR and frisson typically occur when the subject is passive rather than running around having all senses abused and bruised.

Still no headphones.

So if VR is to become a household medium, how could we shoehorn VR with sounds that make you feel good? Music, of course. Ambient soundscapes. More. No doubt over time a grammar would develop more akin to cinema than gaming (but Twitch is evidence that lots of people enjoy watching games passively and this goes right back to the days when computer games were in the arcade at the seafront - I remember watching that guy beat Space Harrier, awesome!).

Music video can be a great experimental landscape, as indeed can music itself.

VR is so fixated on the vision it forgets the wave.

Ignore the tech companies, ask an anthropologist.

Or, of course, not.

Persuading anyone that they need a helmet to listen to the latest album by the current big thing won't be easy. That's why a new category needs to be invented, and a progressive company needs to be first in it. Which is where it all falls apart. No smart money here! (unless the helmet plugs into a lightning port).

'EyePhone' VR, 1989. Note single cup headphone, d'oh.

Problem Solved: If Apple Ditch The Headphone Jack

The sky is falling as Apple is rumoured to be ditching the headphone jack in iPhone 7. Aside from the fact it is merely conjecture at this point, the entire planet seems to have forgotten that Apple are unlikely to ditch Bluetooth and, that being the case, instead of lining Apple's pockets you can buy a third party Bluetooth receiver to use with your old headphones.




Sure, this is not perfect - if you are able, use a cable - because of course the Bluetooth receiver costs money and is another battery to charge, another device to pair, another complication in your life (simplicity at Apple died with Steve Jobs?) - but it does make Apple's decision easier to deal with if they do indeed ditch the headphone jack and you really want to keep hold of your old headphones (I'm quite attached to my iGrado pair for example).

Actually, it's a TRRS jack, and I'm kind of more annoyed that it will render my Røde Smartlav+ microphone obsolete without some Lightning adapter or improved Bluetooth protocol inclusion.

There's always Android!

Eating Humble Pie - Apple, Pie

So you may remember I was very disappointed with the direction Apple is taking lately, with its subscription model and general smugness. So I switched to a Sony Xperia Z3+ via a refurb Z2 (still a good value phone I reckon).

It's not that Android is bad. Indeed, I am completely won over by Google services once more and thanks to Google Music I am actively listening and rediscovering my music library once more.

Google Inbox has matured to a point where it just seems normal to me, I've always used my email as a to-do list, so it's perfect(ing). I've been centralising my schedule with (Microsoft's) Sunrise Calendar and not looked back. And Google Keep has since been released for iOS.

So the software that sits on Android is not bad.

It's the ...

Well.

Those that know me know that I have virtually zero tolerance for a product flake out in critical working situation.

You guessed it.

The Xperia video camera let me down. More than once.

I can workaround the native camera not recording 1080P video for more than 30 minutes, but some things I can't comes to term with:

1. Camera lag. From activation delay to a delay after pressing record, it is not acceptable to me when one of my primary uses for bothering with a smartphone is to have a reliable and robust video camera on me at all times. The Xperia hardware may be robust and reliable but the software has proven to me over the last couple of months that it is neither robust nor reliable.

2. Fixing the exposure. I mean, c'mon. I want to set an exposure and keep it there, please. I didn't realise how important that feature had become to me on iPhone.

3. Third party camera apps that are a bit flakey. Likely because of that F word.

I just don't have time for this shit. I need something that "just works", shit here I am on my knees begging for iPhone to take me back because in my experience it "just works".

So I guess I've learned a lesson here. I love recording live stereo sound, I really love it. However, moreso I love a reliable and robust video camera that records mono. And there always the Shure MV88 and my credit rating before I bankrupt myself with another round of Apple gear and Lightning cables.

Like I say though, Google services have won me over. Android hardware flakiness is to Apple network services flakiness in my experience - frustrating and somewhat second-rate; mediocre.

My next iteration airninja mojo core kit looks like being a previous generation Apple phone running current generation Google services. Win win, right?

The Switch From iPhone 6 Plus to Sony Xperia Z3+ (iOS to Android)

The airninja switch is complete. As I'm sure you know I am platform agnostic, being primarily interested in the best tools for a given job.

For the last five years I've been an iPhone user, upgrading most years with unlocked devices and running on Three UK PAYG (great unlimited data plans).

Each year I've been waiting for Apple to release an iPhone that is capable of recording stereo sound using its onboard mics when taking video (modern iPhone has three mics). Whilst iPhone mono recordings do sound good, I've always preferred the 'reality' of a stereo sound-stage - and I don't always carry a stereo microphone with me because extra gear is not the way of the airninja.

For various reasons (job redundancy being a huge one) I have been re-evaluating the "things" in my life and when Apple came under the microscope it just didn't hold up. The competition promised to deliver far more value into my life (including the stereo audio video recording).

I bought a refurbished Sony Xperia Z2 for a shade over £200 to see how I'd get on. This phone model is about a year old, records 4K video, has 3GB RAM, expandable storage to 128GB and is made by the company and culture that Steve Jobs himself had great admiration for.

An Apple designer, Shin Nishibori, was asked to create “Sony-like” concepts of phones that carried the name “SONY” and “JONY”. The pictures were created around a year before the iPhone first appeared.

Based on my success with the Z2 (and the release of the Z5) I upgraded to the Z3+ which has an improved camera over the Z2 and a reduced price due to the release of the Z5. They all record stereo audio video and have 4K capability.


I did wonder if Apple's iPhone 6S might offer stereo audio recoding with video, but as far as I know it does not (the iPhone 6 which I owned definitely did not). So, for my airninja purposes, it looks like I made a good choice with the Z3+

Now if you google anything about the Z3+ you'll probably come across reports of how this phone runs hot and overheats. In my experience this is not accurate on the current firmware. Although when taking video it does run warmer than the iPhone ever did. I think it's fair to say that whatever problems may have existed with the Z3+ original firmware has been addressed by Sony in recent updates. HOWEVER a mild annoyance remains with the Z3+ in that the native camera app will report "overheating" and shutdown to cool off. It only does this on looong takes (30 minutes or more continuous) which most normal people rarely do. The workaround is to use an alternative app, such as Google's own camera app (also shoots video).

BTW, I have no compelling reason to ditch OS X or FCPX so I remain an Apple customer.

Competition between vendors is a good thing in general, and who knows I may return to a future iPhone iteration. Yesterday's Apple keynote only confirmed my thoughts on the direction Apple is now taking, and it's not a direction I want to travel when Sony already provides the sufficient destination today.

Contemplating a Switch from iOS to Android

More specifically, iPhone 6 Plus to Sony Xperia Z2.

How did this happen? Doesn't Android lead me to a world of false hope and disappointment every time?

Well ... perhaps not. I've always wanted to see if Cyanogenmod is a good fit for me but I've never owned an Android phone with official support so that was also a lesson in false hope and disappointments (generally waiting for OS updates from Samsung that never come).

It seems the Z2 has official Cyanogen support so I can take any frustrations out on the stock firmware by reflashing it bloatware-less.

Why the Z2?

A few days ago a good friend posted some video taken under water in a swimming pool. I know he's an Android guy, I guessed he had a waterproof housing.

Nope. Sony Xperia Z3. Caseless Underwater.

As someone who often gets creative with iPhone video, and knowing a lot of the iPhone sensors and camera parts are from Sony anyway, my interested perked a bit.

So at time of writing the Z3 is 9 months old, the Z2 is 15 months old. Almost pre-historic by smartphone terms. But both a great value proposition when compared to my (or future) iPhones.

Anyway, the argument for or against the hardware and features isn't what I'm writing about today (I may still yet be crushingly disappointed when my good-as-new refurb Z2 arrives). Although I will mention the Xperia Z2 has a microSD slot for up to 128GB expansion - again, another good value proposition for something I care about (storage for video rushes).

What about the apps? I've spent a good few years in the iOS eco-system (dabbling with Android here and there on the way). What equivalents are there?

Well here's my essentials and most-used apps on iPhone with what I expect to replace them with on Android (the handset is due to arrive soon - please don't disappoint me Sony!)

In order on my iPhone homescreen:

Settings
On Android there are OS settings and Google settings and I dare say manufacturer settings. Already I'm questioning if I made a good decision!

App Store
Google Play Store

Photos
Google Photos - though I dare say I will miss Apple Photostream

Shazam

Shazam

Phone
Phone

Skype
Skype

FaceTime
Skype

Messages
Skype

Facebook Messenger
Facebook Messenger

Reminders
Google Now

Calendar
Calendar

Health
Not sure on this one - however I am past counting my steps, and only really take data points on my weight - which I can put in Evernote or whatever. I do like the trend graphs Apple Health creates but hey ho.

Hours Keeper
Evernote probably. Although Hours Keeper also generates an invoice. I'm sure I'll figure it out, I don't do a high number of transactions per month so shouldn't be an issue.

Notes
Evernote

Words with Friends
Words with Friends

Boggle
Boggle

MULE Returns
Not available :-(

Carmageddon
Carmageddon

Jetpack Joyride
Jetpack Joyride

Zite
Zite

Tweetbot
Twitter

Kinomatic
Cinema FV-5

Mail
GMail

Safari
Chrome

Camera
Camera (at a guess)

Periscope
Periscope


There are others of course but that's about it for my most used apps.

Apart from iMovie which I use intermittently but when I do use it I'm really glad it's there. The closest app on Android seems to be something called Kinemaster which looks okay except for a godawful subscription model to remove the watermark.

You'll note I haven't listed Apple's Music app. I think that app is singlehandedly responsible for me listening to less music due to the fact the app is a naff experience. I have been keeping my music in parallel with Google Play Music (free account) and find that a much easier experience to just listen to some goddam music rather than navigate the bizarre Apple Music interface.

Google Play Music also makes it possible to import music into your cloud library using only your phone. No sodding iTunes and Mac/PC sync malarky needed.

I have a real psychological problem with subscriptions because - you guessed it - it  makes it more difficult for me to be brand disloyal and fully independent. I've always bought my phones outright for this very reason and the fact the entire IT industry is heading toward a cloud subscription model fills me with dread. But that's to think about another day.

After I cancel my subscriptions to iTunes Match and iCloud Storage.

Refurb Sony Xperia Z2 via Argos on eBay: £220 with 1 year warranty.