1 of 44

The very most important digital video properties

according to Ashley Blewer,

a/v archivist and software developer

2 of 44

02

01

Hey there

Table of contents

MediaInfo

03

Properties

The usual introduction

What is that?

What are important details to know about video?

3 of 44

01

Hey there

Who is this?

4 of 44

Ashley Blewer

Worked on MediaConch, QCTools, & other media analysis tools for archivists

Lots of stuff to learn about here: https://ashleyblewer.com

5 of 44

Ashley Blewer

Worked on MediaConch, QCTools, & other media analysis tools for archivists

Lots of stuff to learn about here: https://ashleyblewer.com

6 of 44

7 of 44

8 of 44

@ablwr online

9 of 44

02

Let's go, MediaInfo

metadata extraction tool

10 of 44

Why MediaInfo?

  • Robust format support
  • Robust data
  • Versatile
  • Works everywhere
  • Open source
  • Microservice
  • Easy to use

11 of 44

Wide format support

Matroska (mkv/mka/mks)

Ogg (ogg/ogm)

Riff (avi/wav)

Mpeg 1&2 container (mpeg/mpg/vob)

Mpeg 4 container (mp4)

Mpeg video specific (mpgv/mpv/m1v/m2v)

Mpeg audio specific (mp2/mp3)

Windows Media (asf/wma/wmv)

Quicktime (qt/mov)

Real (rm/rmvb/ra)

DVD-Video (ifo)

AC3 (ac3)

DTS (dts)

AAC (aac)

Monkey's Audio (ape/mac) Flac (flac)

CDXA, like Video-CD (dat)

Apple/SGI (aiff/aifc)

Sun/NeXT (au)

Amiga IFF/SVX8/SV16 (iff)

Ensoniq PARIS (paf)

Sound Designer 2 (sd2)

Berkeley/IRCAM/CARL (irca)

SoundFoundry WAVE 64 (w64)

Matlab (mat)

Portable Voice format (pvf)

FastTracker2 Extanded (xi)

Midi Sample dump Format (sds)

Audio Visual Research (avr)

12 of 44

fun fact

MediaConch

MediaInfo works underneath MediaConch to do media analysis

13 of 44

MediaInfo streams

General: Title, author, director, album, track number, date, duration

Video: codec, aspect ratio, framerate, bitrate

Audio: codec, sample rate, channels, language, bitrate

Text: subtitle language

Chapters: numbers of chapters, list of chapters

14 of 44

MediaInfo streams

Container: format, profile, commercial name of the format, duration, overall bit rate, writing application and library, title, author, director, album, track number, date, duration, et cetera

Video: format, codec id, aspect, frame rate, bit rate, color space, chroma subsampling, bit depth, scan type, scan order, et cetera

Audio: format, codec id, sample rate, channels, bit depth, language, bit rate, et cetera

Text: format, codec id, language of subtitle, et cetera

Chapters: count of chapters, list of chapters, et cetera

15 of 44

Versatile

Command Line

GUI (graphical user interface)

Online

Programming bindings

Also: open source! ✨✨✨

BSD-2-Clause License

16 of 44

03

Audio/Video properties

thinking in streams

17 of 44

MediaInfo streams: General

  • Unique ID : string
  • Complete name : new_file.mkv
  • Format : Matroska
  • Format version : Version 4 / Version 2
  • File size : 1.16 MiB
  • Duration : 10 s 0 ms
  • Overall bit rate : 977 kb/s
  • Writing application : Lavf57.83.100
  • Writing library : Lavf57.83.100
  • ErrorDetectionType : Per level 1

18 of 44

MediaInfo streams: Video (Pt 1)

  • ID : 1
  • Format : FFV1
  • Format version : Version 0
  • Codec ID : V_MS/VFW/FOURCC / FFV1
  • Duration : 10 s 0 ms
  • Width : 720 pixels
  • Height : 576 pixels
  • Display aspect ratio : 5:4
  • Frame rate mode : Constant
  • Frame rate : 25.000 FPS
  • Standard : PAL

19 of 44

MediaInfo streams: Video (Pt 2)

  • Color space : YUV
  • Chroma subsampling : 4:2:0
  • Bit depth : 8 bits
  • Compression mode : Lossless
  • Writing library : Lavc57.107.100 ffv1
  • Default : Yes
  • Forced : No
  • DURATION : 00:00:10.000000000
  • coder_type : Golomb Rice

20 of 44

MediaInfo streams: Audio

  • ID : 2
  • Format : PCM
  • Codec ID : A_PCM/INT/LIT
  • Duration : 10 s 0 ms
  • Bit rate mode : Constant
  • Channel(s) : 1 channel
  • Sampling rate : 48.0 kHz
  • Bit depth : 16 bits
  • Writing library : Lavc57.107.100 pcm_s16le
  • Default : Yes
  • Forced : No
  • DURATION : 00:00:10.000000000

21 of 44

03

Audio/Video properties

(for real this time)

22 of 44

Containers and Codecs

  • Container: the General stream
    • Muxing/demuxing
  • Codec: the Video and Audio streams
    • Encoding/decoding

23 of 44

Containers and Codecs

source: ffmpeg docs

24 of 44

Containers vs Codecs

  • Just some notes:
    • container and codec can have the same name
    • not all containers/codecs can work together
    • additionally: sometimes their properties can clash with each other

25 of 44

Containers

  • aka "Wrapper"
  • usually just that – contains some significant information but usually fairly light

26 of 44

MediaInfo streams: General

  • Unique ID : string
  • Complete name : new_file.mkv
  • Format : Matroska
  • Format version : Version 4 / Version 2
  • File size : 1.16 MiB
  • Duration : 10 s 0 ms
  • Overall bit rate : 977 kb/s
  • Writing application : Lavf57.83.100
  • Writing library : Lavf57.83.100
  • ErrorDetectionType : Per level 1

27 of 44

Codecs

  • Here's where most of the trouble can be found
    • Uncompressed / compressed
    • Lossy / lossless
      • "perceptually" lossless is a marketing scam
    • Open / closed
    • Codec profiles (e.g. h.264)

28 of 44

MediaInfo streams: Video (Pt 1)

  • ID : 1
  • Format : FFV1
  • Format version : Version 0
  • Codec ID : V_MS/VFW/FOURCC / FFV1
  • Duration : 10 s 0 ms
  • Width : 720 pixels
  • Height : 576 pixels
  • Display aspect ratio : 5:4
  • Frame rate mode : Constant
  • Frame rate : 25.000 FPS
  • Standard : PAL

29 of 44

MediaInfo streams: Video (Pt 1)

  • ID : 1
  • Format : FFV1
  • Format version : Version 0
  • Codec ID : V_MS/VFW/FOURCC / FFV1
  • Duration : 10 s 0 ms
  • Width : 720 pixels
  • Height : 576 pixels
  • Display aspect ratio : 5:4
  • Frame rate mode : Constant
  • Frame rate : 25.000 FPS
  • Standard : PAL

30 of 44

MediaInfo streams: Video (Pt 1)

  • Width & Height
    • Depending on codec, may need to be divisible by an even number

31 of 44

MediaInfo streams: Video (Pt 1)

  • Display Aspect Ratio
  • Pixel Aspect Ratio
  • Storage Aspect Ratio

32 of 44

MediaInfo streams: Video (Pt 1)

  • Standard
    • Just PAL, NTSC, SECAM – you probably have been learning about this already because it comes from legacy analog standards

33 of 44

MediaInfo streams: Video

  • Frame rate
    • You also probably know a bit about this already – this is worth keeping an eye on because it can make things a bit weird, esp. during conversions
    • Frames are straightforward but time is not

34 of 44

MediaInfo streams: Video (Pt 2)

  • Color space : YUV
  • Chroma subsampling : 4:2:0
  • Bit depth : 8 bits
  • Compression mode : Lossless
  • Writing library : Lavc57.107.100 ffv1
  • Default : Yes
  • Forced : No
  • DURATION : 00:00:10.000000000
  • coder_type : Golomb Rice

35 of 44

MediaInfo streams: Color space

Color space

* How is color organized, translated, conveyed, and presented?

36 of 44

MediaInfo streams: Chroma subsampling

Chroma subsampling

Some common ones for preservation (because we want the best):

  • 4:4:4 (not actually subsampling)
  • 4:2:2 (this is broadcast standard)
  • 4:2:0 (also common in production)

37 of 44

MediaInfo streams: Chroma subsampling

  • 4:4:4, 4:2:2, 4:2:0

x:y:z

x = width (horizontal) of sample size

y = number of chroma samples in the first row

z = number of chroma samples in the second row

38 of 44

MediaInfo streams: Bit depth

Bit depth

* Can think of this as "color depth"

* Represents depth of each color (RGB, YUV)

* 8bit, 10bit, and beyond

39 of 44

MediaInfo streams: Audio

  • ID : 2
  • Format : PCM
  • Codec ID : A_PCM/INT/LIT
  • Duration : 10 s 0 ms
  • Bit rate mode : Constant
  • Channel(s) : 1 channel
  • Sampling rate : 48.0 kHz
  • Bit depth : 16 bits
  • Writing library : Lavc57.107.100 pcm_s16le
  • Default : Yes
  • Forced : No
  • DURATION : 00:00:10.000000000

40 of 44

MediaInfo streams: Audio channels

Channels

* Can represent positions (surround sound setup)

41 of 44

MediaInfo streams: Audio sampling rate

Sampling rate

* the "frames" of audio

* higher is better

42 of 44

MediaInfo streams: Audio bit depth

Bit depth

* another quality indicator

* bits of information in each sample

bits - 1s and 0s

sample - value in time

43 of 44

And many more!

Those are some of the bigger audio/video properties you'll encounter, with tons of nuance and more complex details

What else do you want to know about?

44 of 44

Thank youuu

More questions?

ashley.blewer@gmail.com

ashleyblewer.com

CREDITS: This presentation template was created by Slidesgo, and includes icons by Flaticon, and infographics & images by Freepik