Research

PhD-Project MODAVIS (2022-2025)

  • Main Objectives
    • Create a framework to virtualize church organs and their coupled buildings.
    • Develop new digitization strategies with 3D-Techniques.
    • Record and virtualize 21 organs from different landscapes.
    • Analyze acoustical data with artificial neural networks.
    • Analyze organological relations and find visualization strategies.
    • Augment obtained audio data through artificial neural networks.
    • Develop a new standard for virtual acoustic objects (VAO) to include multimodal datasets.
    • Develop an open web platform for virtual acoustic objects.
    • More Info about the Progress of this Project will be posted on the Blog!

Project DISKOS (2021-2023)

  • Funded by the Federal Ministry of Education and Research (Germany)
  • Main Objectives:
    • Digitize historical mechanical disc players and discs.
  • Field of Work:
    • Analyze mechanical properties and sound production mechanisms of historical disc players.
    • Record discs, oscillators, noises and other relevant auditive information.
    • Convert scanned discs into MIDI-Files.
    • Integrate data into databases and web platform musiXplora.
    • Generate virtual instruments from obtained data.
    • Auralize the digitized discs through virtual instruments.
    • Develop strategies for photogrammetric capturing and 3D-editing.
    • Create interactive and playable 3D-Objects of disc players and discs.
Master Thesis (2020)
    • Title: Digitization of the Theatre Organ of the Museum for Musical Instruments of Leipzig University. Processes of a Functional Augmentation and Acoustical Virtualization.
Augmentation
  • Analyze the functional principles of every component of the theatre organ and electric signal pathways.
  • Use an A/D-Converter to adress the electropneumatic system digitally through MIDI.
  • Expand the electrically pre-programmed sound production through precise digital methods.
  • Develop a MIDI-Converter based on spectral similarity and let any MIDI-File play on the organ.
  • Develop an interface to play the organs percussion through a sequencer (e.g. an 808).
  • Develop an App to play the organ wirelessly through Bluetooth-MIDI.
  • Play the organ from any location worldwide through RTP-MIDI (which has been done from Lisbon-Leipzig).
  • Save and recall presets, patterns and develop an interface to use a loop machine.
  • Develop a graphical user interface to control every conventional and augmented function precisely.
Virtualization
  • Record every tone and effect in different variations & modulations.
  • Create maps and databases with logical relations and links between every component.
  • Develop a virtual copy of the theatre organ as a cross-platform standalone application and as a VSTi.
  • Integrate acoustical simulations like extended holding times, fluctuations, tremolos or coupling effects.
Project TASTEN (2018-2020)
  • Funded by the Federal Ministry of Education and Research (Germany)
  • Main Objectives:
    • Digitize 36 historical key instruments and 3500 piano rolls as multimodal datasets.
  • Field of Work:
    • Analyze sound production mechanisms of historical key instruments.
    • Record single tones, noises and other relevant auditive information from instruments.
    • Integrate data into databases and web platform musiXplora.
    • Generate virtual instruments from obtained data.
    • Record 300 piano rolls from self-playing piano.
    • Generate MIDI-Files from scanned piano rolls.
    • Auralize scanned piano rolls through a virtualized self-playing piano.
Bachelor Thesis (2017/2018)
  • Title: The Neural Synthesis. About the Functional Principles and Applications of Artificial Neural Networks in Digital Sound Synthesis.
  • Main Objectives:
    • Understand, how different neural network architectures work and how they can be used in audio signal processing.
    • Examination of timbre transfers and sound interpolation techniques.
    • Comparison with conventional synthesis methods.
    • Analysis of neural representations of sounds.