{"id":66,"date":"2019-06-19T07:21:05","date_gmt":"2019-06-19T07:21:05","guid":{"rendered":"https:\/\/sail.usc.edu\/~mica\/wordpress\/?p=66"},"modified":"2021-10-15T06:57:34","modified_gmt":"2021-10-15T06:57:34","slug":"music-in-media","status":"publish","type":"post","link":"https:\/\/sail.usc.edu:\/ccmi\/music-in-media\/","title":{"rendered":"Music in Media"},"content":{"rendered":"\n<section class = \"section section--small section--white\">\n  <div class=\"container\">\n    <div class=\"grid grid--1-to-3\">\n      <h2>Project Summary<\/h2>\n      <div> <p> Music is an integral part of enjoyment and consumption of media. This project looks at how music is used in film, television, and advertisements. By analyzing how music is used in these contexts, we can better understand how music is used as directive, driving further inquiry into human affective experiences and music&#8217;s broad-reaching applications in multi-modal contexts.<\/p> <\/div>\n    <\/div>\n  <\/div>\n<\/section>\n\n\n\n\n<figure class=\"wp-block-video aligncenter\"><video controls src=\"https:\/\/sail.usc.edu\/~ccmi\/wp-content\/uploads\/2021\/10\/music_in_media_demo-1-1.mp4\"><\/video><figcaption>Video demonstration of the project. Sample clip shown from Parasite (2020) movie.<\/figcaption><\/figure>\n\n\n\n<section class = \"section section--small section--white\">\n  <div class=\"container\">\n    <header class=\"grid\">\n      <h2>Music&#8217;s Use in Film<\/h2>\n    <\/header>\n    <div class=\"grid grid--2\">\n      <div>\n        <img decoding=\"async\" src=\"https:\/\/sail.usc.edu\/ccmi\/wp-content\/uploads\/2021\/08\/Screenshot-from-2021-08-30-15-11-36.png\" class=\"full-width\" alt=\"\">\n      <\/div>\n      <div class=\"our-team\">\n        <p>Music plays a pivotal role in film and media. Music played during ads, movies, and television shows gives narrative cues and suggestions to the audience. Different styles of music can also convey different affect, and movies of a particular genre can contain \u201ccross-genre\u201d scenes <\/p>\n      <\/div>\n    <\/div>\n  <\/div>\n<\/section>\n\n\n\n<section class = \"section section--small section--white\">\n  <div class=\"container\">\n    <header class=\"grid\">\n      <h2>Music and Visual Features<\/h2>\n    <\/header>\n    <div class=\"grid grid--2 grid--reverse\">\n      <div>\n        <img decoding=\"async\" src=\"https:\/\/sail.usc.edu\/ccmi\/wp-content\/uploads\/2021\/08\/Screenshot-from-2021-08-30-15-07-36.png\" class=\"full-width\" alt=\"\">\n      <\/div>\n      <div class=\"our-team\">\n        <p>By combining the visual information contained in media (such as brightness and contrast) with the audio information contained in the same media (like musical features and dialogue), we can better capture what this media is trying to convey and impart on its audience.  <\/p>\n      <\/div>\n    <\/div>\n  <\/div>\n<\/section>\n\n\n\n<h2 class=\"wp-block-heading\">Recent News<\/h2>\n\n\n\n<p class=\"has-text-align-left\">06\/28\/2021 &#8211; Our paper on music genre classification was accepted for presentation at Content Based Multimedia Indexing (CBMI)! The paper&#8217;s title, &#8220;Loss Function Approaches for Multi-label Music Tagging&#8221; is available starting today.<\/p>\n\n\n\n<p class=\"has-text-align-left\">03\/31\/2021 &#8211; Our paper on movie genre classification using music in movies was accepted for publication at PLOSOne! The paper&#8217;s title, &#8220;A computational lens into how music characterizes genre in film,&#8221; is now available online.<\/p>\n\n\n\n<p>03\/18\/2021 &#8211; We await to hear word on our work involving movie genre classification using musical signatures. If accepted, our work will appear in PLOSOne journal.<\/p>\n\n\n\n<p>02\/01\/2021 &#8211; We await to hear word on our work involving music genre and mood classification. If accepted, our work will appear in Content Based Multimedia Indexing (CBMI). <\/p>\n\n\n\n<p>11\/25\/2020 &#8211; Our team won an international music tagging challenge called MediaEval, where we classified the musical genre and mood of 55,000 songs better than competitors from all over the world. It is a great honor to have our work be <a rel=\"noreferrer noopener\" href=\"https:\/\/www.google.com\/url?q=https%3A%2F%2Fmultimediaeval.github.io%2F2020-Emotion-and-Theme-Recognition-in-Music-Task%2Fresults&amp;sa=D&amp;sntz=1&amp;usg=AFQjCNHEA4jGv8Ewnp0sfCOQ9lh9yrdIMw\" target=\"_blank\">recognized<\/a>! The code that we used to train and run our best performing model is <a rel=\"noreferrer noopener\" href=\"https:\/\/www.google.com\/url?q=https%3A%2F%2Fgithub.com%2Fusc-sail%2Fmedia-eval-2020&amp;sa=D&amp;sntz=1&amp;usg=AFQjCNHvhOi_KotJjpv_C75YxIi9ooU_Kg\" target=\"_blank\">here<\/a>. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Selected Publications<\/h2>\n\n\n\n<ul><li>Knox, D., Greer, T., Ma, B., Kuo, E., Somandepalli, K. &amp; Narayanan, S. (June,  2021) &#8220;Loss Function Approaches for Multi-label Music Tagging.&#8221; <em>Content Based Multimedia Indexing.<\/em><\/li><li>Ma, B., Greer, T., Knox, D., &amp; Narayanan, S. (March, 2021) &#8220;A computational lens into how music characterizes genre in film.&#8221; <em>PLOSOne Journal<\/em>.<\/li><li>Knox, D., Greer, T., Ma, B., Kuo, E., &amp; Narayanan, S. (November, 2020) &#8220;MediaEval 2020 Emotion and Theme Recognition in Music Task:Loss Function Approaches for Multi-label Music Tagging.&#8221; <em>MediaEval 2020 Emotion and Theme Recognition in Music<\/em> (<strong>Competition Winner<\/strong>).<\/li><li>Greer, T., Mundnich, K., Sachs, M., &amp; Narayanan, S. (2020, May). &#8220;The Role of Annotation Fusion Methods in the Study of Human-Reported Emotion Experience During Music Listening.<em>&#8221; ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)<\/em> (pp. 776-780). IEEE.<\/li><li>Greer, T., Ma, B., Sachs, M., Habibi, A., and Narayanan, S. (2019). &#8220;A Multimodal View into Music&#8217;s Effect on Human Neural, Physiological, and Emotional Experience.&#8221; In <em>Proceedings of the 27th ACM International Conference on Multimedia (MM &#8217;19).<\/em> Association for Computing Machinery, New York, NY, USA, 167\u2013175.<\/li><\/ul>\n\n\n\n<section class = \"section section--small section--white\">\n  <div class=\"container\">\n    <div class=\"grid grid--1-to-3\">\n      <h2><\/h2>\n      <div> <p> <\/p> <\/div>\n    <\/div>\n  <\/div>\n<\/section>\n\n\n\n\n<section class = \"section section--white\">\n  <div class=\"container\">\n    <header class=\"grid\">\n      <h2>  Highlights from Studying Music in Media <\/h2>\n    <\/header>\n    <div class=\"grid grid--3\">\n      <div>\n        <h2 class=\"stats-number\"> <\/h2>\n        <h3 class=\"caps\"> Best-performing prediction model&#8217;s f1-score: .65<\/h3>\n        <p>  It is possible to use the musical cues of a movie to accurately predict a movie&#8217;s genre(s)<\/p>\n      <\/div>\n      <div>\n        <h2 class=\"stats-number\"> <\/h2>\n        <h3 class=\"caps\"> Tonal Features<\/h3>\n        <p> Were helpful in predicting movies with higher accuracy, especially horror films<\/p>\n      <\/div>\n      <div>\n        <h2 class=\"stats-number\"> 6\/7<\/h2>\n        <h3 class=\"caps\"> <\/h3>\n        <p> Film genres could be better predicted by using both musical features and visual cues<\/p>\n      <\/div>\n    <\/div>\n  <\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>Investigating and analyzing music&#8217;s place in film, television, and advertisement<\/p>\n","protected":false},"author":17,"featured_media":1110,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[32,4],"tags":[],"acf":[],"_links":{"self":[{"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/posts\/66"}],"collection":[{"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/users\/17"}],"replies":[{"embeddable":true,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/comments?post=66"}],"version-history":[{"count":15,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/posts\/66\/revisions"}],"predecessor-version":[{"id":1419,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/posts\/66\/revisions\/1419"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/media\/1110"}],"wp:attachment":[{"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/media?parent=66"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/categories?post=66"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sail.usc.edu:\/ccmi\/wp-json\/wp\/v2\/tags?post=66"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}