Cat and Girl:
I make music and DJ, and I would like to bulk edit and search my media using my own criteria, especially when it comes to dealing with the crappy media metadata that other artists give me with their tracks. In general I am interested in managing the affiliated artwork and various media artefacts in bulk, en masse and without paying Adobe to waste my hard disk space with their nonsense software.
See also machine listening, playing music.
- IINA for macOS is the hip new stripped-back media play for macOS.
- VLC is the universal media player that does a lot of things, usually confusingly.
- mpv is also a video player; more stripped down than VLC.
Technical details of converting AV formats from whatever you have, to whatever you need to use.
Check with your local jurisdiction’s intellectual property laws before doing any of these. I honestly have no idea any more what is legal and what is not. Ask a lawyer before getting out of bed or brushing your teeth idk.
See also remix, innovation.
Ant provides open-source WebRTC streaming.
rip web videos
Remember kids, for fair use only!
youtube-dl is an incredible script that (despite the name) downloads not just youtube videos but whole playlists of videos from many many websites, setting up transcoding etc for offline use.
Rip VCDs because copying the files doesn’t work. (See also ripping VCD to various formats) Two choices. Firstly, using Mencoder which is ubiquitous but ugly.
Depending on where you want to play it, the following non-re-encoding step might be more hi-fi:
On the other hand, you might want to play this on a mac, which won’t work with either of the above steps without specialist software, so you’ll need to re-encode. See FFMPEG for that, since I couldn’t make it work with Mencoder.
Alternatively, use a specialist vcd ripper, such as
vxdxrip in the
ffmpeg is handy for video, or extracting audio from video, or whatever other permutation of these ingredients you wish.
Documentation is not so much abstruse, as requiring knowledge of the minor implementation details video formats which is one of the most boring domains of human endeavour imaginable, and something that only patent trolls and sometimes engineers are paid enough to care about. Thankfully we have copy-pasta.
FFMPEG is conservative in its default install under
homebrew, skipping anything that might conceivably infringe upon any patent in any jurisdiction, or anything that sounds like too much effort; you might want something more expansive, like:
If you wish to salvage pure audio for your sampling (up to you to ensure this is legal in your jurisdiction) by getting rid of the video track:
Or replace a video soundtrack:
Or to stitch photos to video for making animated GIFs:
There is a wiki for each major format, e.g. AAC audio and H.264 video.
There is a dummies’ guide.
Using these I have stitched together a workflow for, e.g. converting annoying camera video into something modern:
Keunwoo Choi shows how to make an animated scrolling spectrogram
Normalizing is easiest with wrapper script ffmpeg-normalize.
ffmpeg includes a programmatic control from ZeroMQ, so you can dynamically control filters while, e.g. playing video. There are controversies about implementation.
Converting animated GIFs to movies
ffmpeg -i input.gif -b:v 0 -crf 25 output.mp4
You can also extract information about media using ffprobe. This is designed to be easy to parse programatically, outputting specific values or parseable JSON or all manner of other useful stuff.
see image editing
XLD, X Lossless Decoder, is an excellent free app for transcoding arbitrary audio between formats.
Need offline versions of youtube videos or youtube video soundtracks? Firefox extension Media extractor gets these. There are SO MANY times you need this, such as giving lectures in Indonesia with supporting videos where you don’t have 1 hour to cache EACH VIDEO if YOU ARE LUCKY. Grrrrrrr. Also, AFAICT it’s legal in Indonesia as long as you don’t show penises in said video, but I am no lawyer, so this is not legal advice. I suspect it is illegal in DMCA jurisdictions, so don’t do it there.
exiftool, exiv2 seem to be popular media manipulation libraries. pyexiv2 is a python binding. Digikam is a whole photo library and metadata management system.
It would be nice to have some kind of smart annotation and viewing system which used AI to tag the photos without depending upon Google’s creepy data mining infrastructure. ownphotos aims for this.
Erase all (or most) of the explicit metadata from an image:
ExifTool is not guaranteed to remove metadata completely from a file when attempting to delete all metadata. For JPEG images, all APP segments (except Adobe APP14, which is not removed by default) and trailers are removed which effectively removes all metadata, but for other formats the results are less complete:
- JPEG – APP segments (except Adobe APP14) and trailers are removed.
- TIFF – XMP, IPTC and the ExifIFD are removed, but some EXIF may remain in IFD0.
- PNG – Only iTXt, tEXt and zTXt chunks (including XMP) are removed.
- PDF – The original metadata is never actually removed.
- PS – Only some PostScript and XMP may be deleted.
- MOV/MP4 – Only XMP is deleted.
- RAW formats – It is not recommended to remove all metadata from RAW images because this will likely remove some proprietary information that is necessary for proper rendering of the image.
mat attempts to erase all metadata from everything it can handle.
Free/libre video editors
Subler is an Mac OS X app created to mux and tag mp4 files. The main features includes: (sic)
Creation of tx3g subtitles tracks, compatible with all Apple’s devices (iPod, AppleTV, iPhone, QuickTime?).
Mux video, audio, chapters, subtitles and closed captions tracks from mov, mp4 and mkv.
Raw formats: H.264 Elementary streams (.h264, .264), AAC (.aac), AC3 (.ac3), Scenarist (.scc), VobSub? (.idx).
metadata editing and TMDb, TVDB and iTunes Store support.
beets A python library: “The purpose of beets is to get your music collection right once and for all. It catalogs your collection, automatically improving its metadata as it goes using the MusicBrainz database. Then it provides a bouquet of tools for manipulating and accessing your music.” Free, in every sense.
supports acoustic fingerprinting! I mean in a useful way, for you identifying your own tracks, as opposed to some faceless corporation issuing takedown notices against your family videos on youtube. What a change.
Also analysing via echonest. Why yes, I would like to be able to index my music by “danceability”, “energy”, “liveness”, “loudness”, “speechiness”, and bpm, whatever the fuck they are, why not?
…and key detection
A gui cousin of beets is ex falso, the metadata managing end of Quod Libet, the media player.
“Yate was developed for people who are serious about tagging and organizing their audio files. The application was designed from the ground up for Mac users. It is a 100% Cocoa written application and uses its own tagging library. Yate will tag mp3, m4a, AIFF, wav, dsf and FLAC files.
Yate has a long list of features, including an innovative scripting system called actions. The app also supports integration with Discogs, MusicBrainz, AcoustID and iTunes.” ($20.00)
MediaRage: “A collection of powerful tools for media enthusiasts with a Macintosh using Mac OS X. Media Rage can read and write information stored in MP3, AAC/MP4, FLAC, AIFF, WAVE, BWF, and Ogg Vorbis audio files as well as EXIF (read only) tags in digital images. Media Rage can assist you in cataloging, organizing, sorting, and updating thousands of audio files with ease.” ($29.95)
Keyfinder. Plush lookin’ student project that classifies things by musical key, not to mention all the steps along the way – it can visualise chord structures, melodies and key changes too.