Physics-based Music Visualization

Information

• Publication Type: Bachelor Thesis
• Workgroup(s)/Project(s):
  • Rendering and Modeling
• Date: December 2013
• Date (Start): 15. October 2012
• Date (End): 20. December 2013
• Matrikelnummer: 9805067
• First Supervisor: Stefan Ohrhallinger
• Keywords: music, visualization, emotions

Abstract

Historically, there have been a number of approaches to analyze and explain the relationship between music and visual elements, particularly colors. Arnheim [1] has done important work in that context, as well as Palmer and Schloss [10] [16] [14] [13]. Palmer has shown in his ex- periments, that music and color are coupled through emotion, like Arnheim had assumed before. The goal of this thesis was to investigate this connection more in detail by considering also other visual parameters like motion, shape or size and to implement a prototype of a visualization application based on the insights gathered during our user studies. This application should be able to visualize music based on a flexible mapping and psychological knowledge. During the first part of our user studies, test persons were asked to rate parts of songs as well as animations without sound independent from each other but using the same rating scales. The results show strong correlations between single attributes and the perception of the test persons. During the second part of the user studies, the test persons were asked to rate the accordance between the songs from the first round and the visualizations created based on the results of the first round. Our assumptions could not be confirmed in that experiment. We try to determine the reasons, why the results of the second round were not as expected and what steps could be taken to refine our approach and implement it in a successful manner.

Additional Files and Images

Weblinks

No further information available.

BibTeX

@bachelorsthesis{giefing_juergen-2013-ba,
  title =      "Physics-based Music Visualization",
  author =     "Juergen Giefing",
  year =       "2013",
  abstract =   "Historically, there have been a number of approaches to
               analyze and explain the relationship between music and
               visual elements, particularly colors. Arnheim [1] has done
               important work in that context, as well as Palmer and
               Schloss [10] [16] [14] [13]. Palmer has shown in his ex-
               periments, that music and color are coupled through emotion,
               like Arnheim had assumed before. The goal of this thesis was
               to investigate this connection more in detail by considering
               also other visual parameters like motion, shape or size and
               to implement a prototype of a visualization application
               based on the insights gathered during our user studies. This
               application should be able to visualize music based on a
               flexible mapping and psychological knowledge. During the
               first part of our user studies, test persons were asked to
               rate parts of songs as well as animations without sound
               independent from each other but using the same rating
               scales. The results show strong correlations between single
               attributes and the perception of the test persons. During
               the second part of the user studies, the test persons were
               asked to rate the accordance between the songs from the
               first round and the visualizations created based on the
               results of the first round. Our assumptions could not be
               confirmed in that experiment. We try to determine the
               reasons, why the results of the second round were not as
               expected and what steps could be taken to refine our
               approach and implement it in a successful manner.",
  month =      dec,
  address =    "Favoritenstrasse 9-11/E193-02, A-1040 Vienna, Austria",
  school =     "Institute of Computer Graphics and Algorithms, Vienna
               University of Technology ",
  keywords =   "music, visualization, emotions",
  URL =        "https://www.cg.tuwien.ac.at/research/publications/2013/giefing_juergen-2013-ba/",
}