The painful quest of 4K Video

2015 has probably been the first year where consumer devices have taken the journey to 4K as even iPhones now can record at Ultra High Definition.

However there is still a very long way to get us to the level of standardisation of HD video and the war of the codecs has still to determine a winner.

As of January 2016 if we consider only digital cameras only three manufacturers produce 4K capable devices that can be housed for underwater use and those are Canon, Sony and Panasonic.

Specifically we have two compact cameras with fixed lenses, the Sony RX100 Mark IV and the Panasonic LX100, two micro four thirds the Panasonic GH4 and GX8 and three DSLR the Sony A7IIR and A7IIS and the Canon EOS-1D C that was in fact the first camera to record 4K video in 2013.

From a consumer point of view we are interested in a 4K device that can operate with wet lenses across the focal range and that is under the $5,000 mark including the housing so I will focus on the Micro Four Thirds and fixed lens compacts and exclude immediately the Panasonic LX100 that requires a port system to operate we are now left with 3 devices that today are the real options for 4K underwater video.

4K Digital Cameras for Underwater Use

  1. Panasonic GH4 with Panasonic 14-42mm II Mega OIS
  2. Panasonic GX8 with Panasonic 12-32mm Mega OIS
  3. Sony RX100 Mark IV

I have added the lenses of choice of each camera for convenience.

In 35mm terms the focal lengths offered by the 3 devices are:

Panasonic GH4 with 14-42mm : 35-105mm

Panasonic GX8 with 12-32mm: 31.2-83.2mm

Sony RX100 IV: 28-80mm

Wet lenses

Both Panasonic cameras revert to a traditional 35mm cameras when the 4K crop is applied. The wet lens of choice is therefore the old Inon UWL-100 with M67 thread. This is a lens with a magnification of 0.57077 that with the 14-42mm II Mega OIS and Macro Port 35 or the 12-32mm and Macro Port 29 performs very well without vignetting and offers zoom through the whole focal range. The same lens appears to work fine also with the Sony RX100 Mark IV but is almost border line in terms of vignetting and I will need to conduct further experiments for now we will refer to the Inon UWL-H100

Focal range with Inon UWL-100 / UWL-H100* (Sony)

Panasonic GH4+14-42 : 20-60mm

Panasonic GX8+12-32 : 18-48mm

Sony RX100 Mark IV : 17-48mm

You can see that the GX8 and the RX100 are virtually equivalent and the same holds true for macro with the GX8 and the RX100 offering same working distance and magnification. The GH4 is superior in this area due to the longer focal length after crop of 105mm. For me the most versatile wet lenses for macro remain the Inon UCL-165 despite the various Nauticam and Subsee options because you can cover all the working distances from 16cm to 8cm which is the sweet spot for macro work.

Unfortunately the level of magnification obtainable with the GX8 and RX100 is not great and really small subject will still look tiny in the frame. Obviously the use of the 14-42mm lens on the GX8 resolves all problems except the field of view with wet lens at wide end is now 21mm anyway not a huge issue.

I am still waiting for a proper review of the GX8 but in terms of 4K resolution I have been impressed with the Sony RX100 Mark IV that appears to be sharper than the GH4 and even the A7IIR.

4K formats

In terms of 4K recording all devices on the market use some form of H264 100 Mb/s codec Sony uses what they call XAVC S while Panasonic uses a standard Mp4 compatible wrapper. Sony codecs do not use B frames in their H264 implementation but this does not seem to affect quality that much.

So now that you have your 4K footage what do you do with it?

The first consideration is that all cameras record internally at 8 bit with 4:2:0 subsampling this means that colours are only recorded for 50% of the pixels and then interpolated. The implication is that color grading opporunites are limited and heavy manipulation should be avoided to avoid undesired effects such as banding.

This means custom white balance better with a filter is still very much needed for 4K.

In the Mac camp there are many consumer options for 4K editing including iMovie, Final Cut Pro X, Adobe Premiere Pro and for Windows you also add Sony Vegas, Avid composer and many more

S-logs or V-log are also not meaningful at 8 bits without external recording capabilities as grading will ruin the footage.

Workflow for Consumer Use on Mac

For the average home user on a Mac iMovie offers now decent functionality and imports and edits in native format all the clips produced by our selected cameras. iMovie also exports in Prores 422 which is ideal for storing your master copy after editing.

Unless you edit on a laptop or a machine with poor hardware there is no need to convert the footage in intermediate formats as most of GPU have H264 acceleration so your 4K workflow will look like this:

  1. Import into your 4k editor
  2. cut and edit sequence
  3. Perform minimal corrections to exposure and color
  4. Add some transitions
  5. Add music of voice over
  6. Export to Prores 422 or 422 HQ if available
  7. Compress with 3rd party software or plug in

Compression Headaches

Step 6 is particularly important as none of the above mentioned editors has good native export capabilities so you want to do that with another program. If we take for good what apple says Prores HQ is very rarely fooled by 4K footage at 737 Mb/s for 25p. Consindering that our footage was 4:2:0 to start with this means we need only 75% of that bandwidth or 552 Mb/s. As Prores 422 records at 492 Mb/s which is only 11% less than the required bandwidth so iMovie with the Prores export option is pretty good.

We now have our 492 Mb/s video with most likely an AAC audio what are we going to do with it?

This is where it gets really painful. If you have a 4K Tv you definitely want to watch your footage on it, today UHD Tv support the HEVC codec and more recently also the VP9 codec that google uses in YouTube however both those codecs have limited options for encoding and do not have any hardware acceleration support in your computer that will be used to compress the footage.

To make matters worse if you then share your footage online on YouTube this will be heavily re-compressed. I have done some analysis on some clips that I watch to find that 4K bandwidth is between 17 and 20 Mb/s in H264 and the files are not even encoded with CABAC to ensure they can be played on devices with limited hardware capabilities. In terms of web browser many now supports VP9 however hardware acceleration is lacking so it is likely that you will be watching H264 4K footage at 18 Mb/s when you connect to YouTube on your computer.

It is likely that the mp4 files that you can produce with handbrake or other tools are easily coded at 60-70 Mb/s so YouTube, as it does with HD footage, will introduce significant issues to your 4K videos.

Interestingly the 4K bandwidth is higher in terms of Bits/(Pixel*Frame):

  • 0.090 for 4K
  • 0.076 for 2K
  • 0.055 for HD

This would suggest that 4K videos are less compressed but on the other hand the compression is less efficient. 2K appears an interesting mix that still uses Cabac and 3 reference frames but is really a computer only option.

For who has access to an x264 encoder  this is a suggestion for 4K  encoding that does not kill your computer

Preset slower – modified

cabac=1 / ref=5 / deblock=1:0:0 / analyse=0x3:0x113 / me=umh / subme=9 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=2 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=1 / chroma_qp_offset=-2 / threads=3 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=2 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=2 / keyint=250 / keyint_min=25 / scenecut=40 / intra_refresh=0 / rc_lookahead=60 / rc=crf / mbtree=1 / crf=18.0 / qcomp=0.60 / qpmin=0 / qpmax=69 / qpstep=4 / ip_ratio=1.40 / aq=1:1.00

The options that differ are ref=5 otherwise we break the limit of level 5.1 and the decoder may have issues, and crf=18 from 23 to increase quality.

This H264 encoding can easily produce files around 1.4 Gb for just 3 minutes and will require playback on the device or USB disk attached or a good cat 5 ethernet network or solid wireless at at least 100 Mb/s effective speed.

It follows that H264 really is not the way forward at 32 Mb/s HEVC two pass or crf=23 in single pass you get files that are 20% or less of the size and work well if you have a 4K HEVC accelerated player like I do. At this bitrate is also very easy to stream over your wireless LAN even at mediocre quality. Unfortunately YouTube will reject your HEVC files and require H264 or VP9.

Google plot for 4K world domination

Google did not want to incur more royalties so they pushed out HEVC to use the open source VP9 as they did years ago with Vp8.

VP9 is at least in the Mac version very slow and seems fairly amateurish. They have been succesful with Android Tvs that have YouTube as a prime source of 4K content because the YouTube app does not work in 4k on Tv sets unless it can decode VP9. This is clearly only a commercial plot as all TVs can play H264 and YouTube wants to reach as many people as possible with 4K therefore keeping bandwidth below 20 Mb/s and accessible to the higher end of DSL connections not just fiber so that they can push their ads to the masses, however it also means that your video will look pretty pathetic on YouTube unless  you use a VP9 capable browser or Tv set or android to box to watch it.

At time of writing the only android box that can decode Vp9 is the Nvidia Shield Tv so if you want to watch YouTube 4K videos at 18 Mb/s Vp9 there is at least one choice.

http://shield.nvidia.com/android-tv

Also the Roku and Kindle fire Tv support YouTube 4K but don’t have Kodi so I would not consider them