Preliminary Exploration of Music and Visual Video Integration: Taking Graduation Asterism·Echo as an Example
This paper introduces the creative process and technical implementation of the interactive multimedia work Asterism·Echo. Based on ancient Chinese observational data of Jupiter, the work generates line charts through celestial coordinate mapping and converts polyline trajectories into atonal musical motifs. Integrating human vocals, guqin, drums, strings, and synthesizers with multimodal mappings of Jupiter imagery, Dunhuang murals, and dance footage, the audio-visual content realizes interactive and immersive integration between music and vision. Adopting TouchDesigner and Logic Pro as core technical tools, the work maps sound frequencies and timbres to visual elements, thereby producing dynamic presentations including animations, particle flows, and light-shadow variations. During the creation, technical challenges such as data visualization, irregular rhythms, and fluid visual interaction were overcome. The work achieves in-depth integration of traditional Chinese cultural inheritance and technical implementation, demonstrating an innovative aesthetic path that bridges ancient natural science and contemporary artistic expression.
[1] Grant MJ, 2005, Serial Music, Serial Aesthetics: Compositional Theory in Post-War Europe. Cambridge University Press.
[2] Günther R, Jin JY, 1985, Oriental Music Cultures in the Nineteenth Century. China Federation of Literary and Art Circles Press.
[3] Huang ZX, 2026, Numbers Are Sight, Numbers Are Sound—A Case Study of Visual Electronic Work Test Pattern [time square]. Journal of Pingxiang University, 2026: 1–6.
[4] Gan De’s Tianwen Xingzhan, Taichu Calendar, Book of Han: Treatise on Astronomy, Dayan Calendar, Dunhuang Star Chart, History of the Song Dynasty: Treatise on Astronomy, Shoushi Calendar, Chongzhen Almanac, and the Archives of the Imperial Astronomical Bureau.
[5] Ding Z, Chen JJ, 2026, Revisiting the “Audio-Visual Contract”: Perception, Game and Reconstruction of Sound in AI-Generated Images. Contemporary Communication, 2026(1): 69–74.
[6] Li XJ, 2005, Verbal Figures and Visual Figures: On the Connotation of Rhetorical Devices in Moving Images. Film Art, 2005(3): 15–17.
[7] Li L, Wang ST, 2022, The Construction of Visual Language and Expression of Aesthetic Emotion in Interactive Art Teaching. Theory and Practice of Education, 42(18): 56–59.
