Skip to content

Commit

Permalink
Update paper.md
Browse files Browse the repository at this point in the history
  • Loading branch information
NatashaBertaina authored Jun 19, 2024
1 parent c3edef6 commit b5b0cdf
Showing 1 changed file with 10 additions and 6 deletions.
16 changes: 10 additions & 6 deletions paper/paper.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,9 +38,9 @@ Conventional teaching relies heavily on the presentation of visual information,

The overemphasis on visual modalities in education and scientific research restricts a holistic perception of the natural world. Embracing a multi-sensory approach that meaningfully integrates all senses is crucial to enhance comprehension and information analysis for all individuals, fostering a cohesive understanding of the natural world. This is the driving force behind the sonoUno team’s endeavors.

On the way to achieving this, sonification emerges as a powerful tool to expand learning opportunities and accessibility. Software such as sonoUno, xSonify, and StarSound, among others, demonstrate the potential of this form of data representation. Backing this notion there are research studies such as @wanda2011 and @foran2022, which showcase the effectiveness of these tools in the interpretation of astronomical data.
On the way to achieving this, sonification emerges as a powerful tool to expand learning opportunities and accessibility. Software such as sonoUno\footernote{\url{https://www.sonouno.org.ar/}}, xSonify\footernote{url\{https://sourceforge.net/projects/xsonify/}}, and StarSound\footernote{\url{https://www.jeffreyhannam.com/starsound/}}, among others, demonstrate the potential of this form of data representation. Backing this notion there are research studies such as @wanda2011 and @foran2022, which showcase the effectiveness of these tools in the interpretation of astronomical data.

Like any other new technique, sonification requires a process of teaching and training. For this reason, training tests were developed using tools such as PsychoPy (@bertainaA2022). This tool, intended for use in experiments in Python, is mainly used in behavioral sciences. Its desktop application is free and, due to its versatility, it was a viable option for designing the first set of training exercises. Its disadventage came with the web implementation. For running the same desktop-designed training exercises, a library called PJs was needed, which is not open source and does not allow to use files outside of the page offered by the PsychoPy project. To overcome these limitations, a new web platform, named sonoTrainings was specifically designed to host sonification training (@bertainaB2023; @bertainaA2023).
Like any other new technique, sonification requires a process of teaching and training. For this reason, training tests were developed using tools such as PsychoPy\footernote{\url{https://www.psychopy.org/}} (@bertainaA2022). This tool, intended for use in experiments in Python, is mainly used in behavioral sciences. Its desktop application is free and, due to its versatility, it was a viable option for designing the first set of training exercises. Its disadventage came with the web implementation. For running the same desktop-designed training exercises, a library called PJs was needed, which is not open source and does not allow to use files outside of the page offered by the PsychoPy project. To overcome these limitations, a new web platform, named sonoTrainings was specifically designed to host sonification training (@bertainaB2023; @bertainaA2023).

@fusco2015 employed tactile graphs as a multisensory learning technique, enabling the representation of diverse STEM educational resources for visually impaired students. Integrating sound with these tactile representations could further enhance multisensory learning.

Expand All @@ -59,17 +59,19 @@ While these initial studies lay the groundwork for the application of sonificati

## Web

sonoTrainings is a web platform specifically designed to host and manage sonification training exercises. It serves on the Django framework, a high-level and open-source web development environment. Django offers extensive documentation, which is up-to-date with the latest version (v.5.0.5), and facilitates the creation of complex websites by programming most components in Python. It stands out for its effective Model-View-Template architecture and enables the implementation of applications within the projects, functioning as independent modules that connect with others. This packaging approach makes it easier to reuse these applications in other projects. The developed web platform implements two applications within the project: one dedicated exclusively to the configuration and deployment of training exercises, and another for user registration management.
sonoTrainings is a web platform specifically designed to host and manage sonification training exercises. It serves on the Django framework\footernote{\url{https://www.djangoproject.com/}}, a high-level and open-source web development environment. Django offers extensive documentation, which is up-to-date with the latest version (v.5.0.5), and facilitates the creation of complex websites by programming most components in Python. It stands out for its effective Model-View-Template architecture and enables the implementation of applications within the projects, functioning as independent modules that connect with others. This packaging approach makes it easier to reuse these applications in other projects. The developed web platform implements two applications within the project: one dedicated exclusively to the configuration and deployment of training exercises, and another for user registration management.

The design of the sonoTrainings web platform’s training exercises drew inspiration from previous desktop training experiences developed using PsychoPy. In these desktop trainings, an image and sound were presented on the screen for a short duration, followed by a prompt asking participants to identify any detected signals. Each type of signal was presented in separate blocks, with brief intervals between blocks of different characteristics. Adapting this approach to the web platform, sonoTrainings divides each training session into at least two distinct blocks, each containing a group of signal presentations that share common characteristics.

The training deployment system is implemented using forms. This approach enables the recording of user responses in a database, ensuring that every training is completed. Each deployment constitutes a page of the form, allowing users to resume the training in case of interruptions. Previously provided responses are stored, and the system displays the pending deployments. To optimize the user experience, each page of the form presents a signal with its corresponding audio, image, and question (Figure 1). This reduces the cognitive load and facilitates the comprehension of the material.
The training deployment system is implemented using forms. This approach enables the recording of user responses in a database, ensuring that every training is completed. Each deployment constitutes a page of the form, allowing users to resume the training in case of interruptions. Previously provided responses are stored, and the system displays the pending deployments. To optimize the user experience, each page of the form presents a signal with its corresponding audio, image, and question n (\autoref{fig:fig1}). This reduces the cognitive load and facilitates the comprehension of the material.

To ensure the readability of the forms by assistive technologies, the development of sonoTrainings adheres to the Web Content Accessibility Guidelines (WCAG), implementing the recommendations outlined therein. Additionally, functionalities from the Bootstrap framework were integrated to enhance the fluidity, responsiveness, and overall user experience, catering to both users with or without assistive technologies.
To ensure the readability of the forms by assistive technologies, the development of sonoTrainings adheres to the Web Content Accessibility Guidelines (WCAG\footernote{\url{https://www.w3.org/WAI/standards-guidelines/wcag/es}}), implementing the recommendations outlined therein. Additionally, functionalities from the Bootstrap framework\footernote{\url{https://getbootstrap.com/}} were integrated to enhance the fluidity, responsiveness, and overall user experience, catering to both users with or without assistive technologies.

![description figure. \label{fig:fig1}](figures/fig1.png)

## Database

The data collected from the training plan is stored in a specially designed database. The architecture (Figure 2) of this database facilitates the management of training data and sonoTrainings platform users, utilizing a relational model and implemented using the SQLite database management system.
The data collected from the training plan is stored in a specially designed database. The architecture (\autoref{fig:fig2}) of this database facilitates the management of training data and sonoTrainings platform users, utilizing a relational model and implemented using the SQLite\footernote{\url{https://getbootstrap.com/}} database management system.

The sonoTrainings platform’s database structure comprises six primary entities:

Expand All @@ -84,6 +86,8 @@ This database is used to support the functionalities of a) training storage and

The entire website will be tested in the course on Multisensory Analysis of Scientific Data, which will be held between May and June 2024, and will consist of 8 weekly sessions (@casado2024).

![description figure. \label{fig:fig2}](figures/fig2.png)

# Conclusions

Data sonification is an innovative tool with great potential to complement and enrich data analysis in various fields of knowledge. However, its effective implementation requires systematic training to optimize the use of this technique, and sonoTrainings is the first step in this direction.
Expand Down

0 comments on commit b5b0cdf

Please sign in to comment.