-
Unmixer: Loop Extraction with Repetition, with Dr. Jordan Smith and Tim de Reuse
Podcast: Play in new window | Download (Duration: 1:00:10 — 55.7MB)
Subscribe: Spotify | RSS | More
Music technology PhD Candidate Tim de Reuse recommends “Unmixer: An Interface for Extracting and Remixing Loops” by Jordan Smith,Yuta Kawasaki, and Masataka Goto, published in the proceedings of ISMIR 2019. Tim and Finn interview Jordan about the origins of this project, the algorithm behind the loop extraction, the importance of repetition in music, and the creative and playful applications of Unmixer.
Note: This conversation was recorded in December 2019. Techically issues with some tracks contributed to delays. Apologies for the choppy audio quality.
Time Stamps
- [0:01:40] Project Summary
- [0:05:05] Demonstration of Unmixer
- [0:14:27] Origins of the UnMixer project
- [0:19:44] Factorisation algorithm
- [0:28:37] Computational and musical objectives for factorisation
- [0:36:15] The Unmixer web interface
- [0:41:30] 2nd Demonstration, parameters and track selection
- [0:49:13] What Unmixer tells us about music
Show notes
- Recommended article:
- Smith, J, Kawasaki, Y, & Goto, M. (2019) Unmixer: An Interface for Extracting and Remixing Loops. Proceedings of 20th ISMIR meeting, Delft Netherlands.
- UnMixer website: https://unmixer.ongaaccel.jp/
- Project webpage
- Interviewee: Dr. Jordan BL Smith, Research Scientist at Tik Tok.Website, twitter
- Co-host: PhD Candidate Tim de Reuse, website, twitter
- Papers cited in the discussion:
- Smith, J. B., & Goto, M. (2018, April). Nonnegative tensor factorization for source separation of loops in audio. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 171-175). IEEE.
- Schmidhuber, J. (2009). Simple algorithmic theory of subjective beauty, novelty, surprise, interestingness, attention, curiosity, creativity, art, science, music, jokes. Journal of SICE, 48(1).
- Rafii, Z., & Pardo, B. (2012). Repeating pattern extraction technique (REPET): A simple method for music/voice separation. IEEE transactions on audio, speech, and language processing, 21(1), 73-84.
- Music sampled:
- Daft Punk, Random Access Memories (2013): Doing it Right (ft. Panda Bear)
- Martin Solveig & Dragonette, Smash (2011): Hello – Single Edit
- Mura Masa, Soundtrack To a Death (2014): I’ve Never Felt So Good
- Other references:
- Madeon’s Adventure Machine
- Chocolate Rain by Tay Zonday
Credits
The So Strangely Podcast is produced by Finn Upham, 2020. The closing music includes a sample of Diana Deutsch’s Speech-Song Illusion sound demo 1.
-
Episode 2: Aligned Hierarchies and Segmentation with Vincent Lostanlen and guest Katherine Kinnaird
Podcast: Play in new window | Download (Duration: 1:13:48 — 70.0MB)
Subscribe: Spotify | RSS | More
Data Scientist Vincent Lostanlen recommends Katherine Kinnaird’s “Aligned Hierarchies: A Multi-Scale Structure-Based Representation for Music-Based Data Streams”, published in the proceedings of ISMIR (2016). Vincent and Finn interview Dr. Kinnaird about this method for abstracting structure in music through repetition, how it has been implemented for fingerprinting on Chopin’s Mazurkas, and how Aligned Hierarchies could be used for other tasks and on other musics.
Show notes
- Recommended article:
- Kinnaird, K. M. (2016). Aligned Hierarchies: A Multi-Scale Structure-Based Representation for Music-Based Data Streams. In ISMIR (pp. 337-343). http://m.mr-pc.org/ismir16/website/articles/020_Paper.pdf
- Interviewee: Dr. Katie Kinnaird, Data Sciences Postdoctoral Fellow, Affiliated to the Division of Applied Mathematics at Brown University twitter @kmkinnaird
- Co-host: Dr. Vincent Lostanlen, Postdoctoral Researcher at the Cornell Lab of Ornithology, Visiting scholar at MARL at NYU, twitter: @lostanlen
- Papers cited in the discussion:
- M. Casey, C. Rhodes, and M. Slaney. Analysis of minimum distances in high-dimensional musical spaces. IEEE Transactions on Audio, Speech, and Language Processing, 16(5):1015 – 1028, 2008.
- J. Foote. Visualizing music and audio using self- similarity. Proc. ACM Multimedia 99, pages 77–80, 1999.
- M. Goto. A chorus-section detection method for musical audio signals and its application to a music listening station. IEEE Transactions on Audio, Speech, and Language Processing, 14(5):1783–1794, 2006.
- P. Grosche, J. Serrà, M. Müller, and J.Ll. Arcos. Structure-based audio fingerprinting for music retrieval. 13th International Society for Music Information Retrieval Conference, 2012.
Time Stamps
- [0:00:10] Intro with Vincent Lostanlen
- [0:17:22] Interview: Origins of the Aligned Hierarchies
- [0:30:22] Interview: Implementation & Fingerprinting on the Mazurkas
- [0:52:55] Interview: New applications and developments for Aligned Hierarchies
- [1:02:57] Closing with Vincent Lostanlen
Credits
The So Strangely Podcast is produced by Finn Upham, 2018.
The closing music includes a sample of Diana Deutsch’s Speech-Song Illusion Sound Demo 1.
- Recommended article: