On Translation of Sonar Stimulation to Proper Visual Representation Using a Photometrically Precise Method of Audible Waves Transformation
Subject Areas : Advanced Optical Techniques for Clinical MedicineSalman Mohajer 1 , S. Milad M. Mousavi 2
1 -
2 -
Keywords: Chromaticity, Light, Auditory Impaired, Transformation, Audible Sound,
Abstract :
This research presents a new and consistent approach to the transformation of audible acoustic waves, into definite colors of visible spectrum. The method of the transformation (namely, the main mapping function) is found by regarding how human eye and ear respond to sensory changes and then imposing physical and mathematical constraints vital to the viability of the transformation. Then, by constructing another method as to represent the corresponding color inside sRGB color space (namely, the rendering function), the output color can be shown inside a computer screen. This second function is obtained by applying modifications on normalized CIE tristimulus values for 2 degree field size photometrical data. Finally, the result is extended to properly translate a sound clip to color frames, changing with respect to the changes in the sound clip through time. Such algorithm for processing sound enables a person the deduction of sounds of different sources, through color vision with reasonable quality of details. The main application of such translation of sounds is to aid the Auditory Impaired. The other applications of such method includes simulating a certain type of Synesthesia, determining the cause of seismic waves by the color resulted from its visualization by this method.
[1] World Health Organization, “Deafness and Hearing Loss.” Accessed: May 02, 2024. https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss
[2] National Library of Medicine, “Hearing loss and deafness: Normal hearing and impaired hearing - InformedHealth.org - NCBI Bookshelf,” National Library of Medicine. Accessed: May 02, 2024. [Online]. Available: https://www.ncbi.nlm.nih.gov/books/NBK390300/
[3] C. Löfvenberg et al., “Prevalence of severe-to-Profound hearing loss in the adult Swedish population and comparison with cochlear implantation rate,” Acta Otolaryngol., vol. 142, no. 5, pp. 410–414, 2022, doi: 10.1080/00016489.2022.2073388.
[4] W. C. Stokoe, “Sign Language Structure,” Annu. Rev. Anthropol., vol. 9, no. 1, pp. 365–390, Oct. 1980, doi: 10.1146/annurev.an.09.100180.002053.
[5] N. C. Camgoz, S. Hadfield, O. Koller, H. Ney, and R. Bowden, “Neural Sign Language Translation,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 7784–7793, 2018, doi: 10.1109/CVPR.2018.00812.
[6] L. Turton and P. Smith, “Prevalence & characteristics of severe and profound hearing loss in adults in a UK National Health Service clinic,” Int. J. Audiol., vol. 52, no. 2, pp. 92–97, Feb. 2013, doi: 10.3109/14992027.2012.735376.
[7] G. J. Im et al., “Prevalence of severe-profound hearing loss in South Korea: a nationwide population-based study to analyse a 10-year trend (2006–2015),” Sci. Reports 2018 81, vol. 8, no. 1, pp. 1–9, Jul. 2018, doi: 10.1038/s41598-018-28279-z.
[8] W. Li, Z. Zhao, Z. Lu, W. Ruan, M. Yang, and D. Wang, “The prevalence and global burden of hearing loss in 204 countries and territories, 1990–2019,” Environ. Sci. Pollut. Res., vol. 29, no. 8, pp. 12009–12016, Feb. 2022, doi: 10.1007/S11356-021-16582-8/METRICS.
[9] Tehran Ear Clinic, “The Cost of Cochlear Implants, Do the insurance companies cover the fees?” Accessed: May 04, 2024. https://tehranearclinic.com/blog/cochlear-implant-cost
[10] TriHealth, “Surgical Treatment for Hearing Loss.” Accessed: May 04, 2024. https://www.trihealth.com/services/ear-nose-and-throat/ent-treatments-and-services/surgical-treatment-for-hearing-loss
[11] Forbes Health and Duke Department of Head and Neck Surgery & Communication Sciences, “How Much Do Cochlear Implants Cost?” Accessed: May 03, 2024. [Online]. Available: https://headnecksurgery.duke.edu/news/forbes-health-how-much-do-cochlear-implants-cost
[12] Cochlear Implant Brain and Behavior Lab, “What does the world sound like through a cochlear implant?” Accessed: May 04, 2024. https://cochlearimplant.lab.uconn.edu/cochlear-implant-information/sounds/
[13] C. Valli, C. L. Washington, and D. C. Gallaudet, Linguistics of American Sign Language: An Introduction (3rd Ed.), vol. 1. 2003. Accessed: May 24, 2024.
[14] O. Koller, J. Forster, and H. Ney, “Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers,” Comput. Vis. Image Underst., vol. 141, pp. 108–125, Dec. 2015, doi: 10.1016/j.cviu.2015.09.013.
[15] W. C. Hayes, “Sound to light visual vocalization system,” US3572919A, 1968 Accessed: May 19, 2024. [Online]. Available: https://patents.google.com/patent/US3572919A/en?oq=US3572919+(A)
[16] C. Lee, “Sound to light converter and its method,” KR20050089440A, 2004 Accessed: May 19, 2024. [Online]. Available: https://patents.google.com/patent/KR20050089440A/en?oq=KR20050089440
[17] M. Kurihara and J. Fujimori, “Sound to light converter and sound field visualizing system,” US20120097012A1, 2012 Accessed: May 19, 2024.https://patents.google.com/patent/US20120097012A1/en?oq=us20120097012A1
[18] A. Blok, “Sound-to-light graphics system,” WO1994022128A1, 1994 Accessed: May 19, 2024.https://patents.google.com/patent/WO1994022128A1/en?oq=WO9422128
[19] L. Ok-kyung, “Speaker generating a light corresponding to a sound source,” KR20050062950A, 2003 Accessed: May 19, 2024.https://patents.google.com/patent/KR20050062950A/en?oq=KR20050062950
[20] K. Gil-ho, “Method for transforming sound to color and a light emitting speaker employing the sound to color transformation function,” KR20080021201A, 2006 Accessed: May 19, 2024.https://patents.google.com/patent/KR20080021201A/en?oq=KR20080021201+(A)
[21] D. H. Sliney, “What is light? The visible spectrum and beyond,” Eye, vol. 30, no. 2, p. 222, Feb. 2016, doi: 10.1038/EYE.2015.252.
[22] K. Gil-ho, “Apparatus for emiting light using led according to sound pitch, sound volume or tone color,” KR20050034772A, 2003 Accessed: May 19, 2024. [Online]. Available: https://patents.google.com/patent/KR20050034772A/en?oq=KR20050034772+(A)
[23] A. Takeda, A. Yoshikawa, O. Ochi, T. Ogino, and Y. Mizushima, “Light to sound converter,” JPS56154634A, 1980 Accessed: May 19, 2024. https://patents.google.com/patent/JPS56154634A/en?oq=JPS56154634+(A)
[24] Bruno A. Olshausen, “logs-and-music (Psych 129 - Sensory Processes).” Accessed: Aug. 02, 2024.http://www.rctn.org/bruno/psc129/handouts/logs-and-music/logs-and-music.html
[25] D. Purves, G. J. Augustine, D. Fitzpatrick, and et al., Neuroscience - The Audible Spectrum. Sinauer Associates, 2001. Accessed: May 24, 2024.https://www.ncbi.nlm.nih.gov/books/NBK10924/
[26] T. J. Bruno and P. D. N. Svoronos, “CRC handbook of fundamental spectroscopic correlation charts,” CRC Handb. Fundam. Spectrosc. Correl. Charts, pp. 1–226, Jan. 2005, doi: 10.1201/9780849332500.
[27] Amplifion, “What is the range of human hearing? | Amplifon UK.” Accessed: May 24, 2024. [Online]. Available: https://www.amplifon.com/uk/audiology-magazine/human-hearing-range
[28] International Commission on Illumination, “CIE cone-fundamental-based spectral tristimulus values for 2 degree field size | CIE.” Accessed: Aug. 04, 2024. [Online]. Available: https://cie.co.at/datatable/cie-cone-fundamental-based-spectral-tristimulus-values-2-degree-field-size
[29] Y. Ohno et al., “The Basis of Physical Photometry, 3rd Edition, CIE 018:2019,” 2019. doi: 10.25039/TR.018.2019.
[30] M. Anderson, R. Motta, S. Chandrasekar, and M. Stokes, “Proposal for a standard default color space for the Internet - sRGB,” in Final Program and Proceedings - IS and T/SID Color Imaging Conference, 1996, pp. 238–246. Accessed: Aug. 04, 2024. [Online]. Available: https://www.color.org/sRGB.xalter
[31] J. W. Cooley and J. W. Tukey, “An Algorithm for the Machine Calculation of Complex Fourier Series,” Math. Comput., vol. 19, no. 90, p. 297, 1965, doi: 10.2307/2003354.
[32] L. I. Bluestein, “A Linear Filtering Approach to the Computation of Discrete Fourier Transform,” IEEE Trans. Audio Electroacoust., vol. 18, no. 4, pp. 451–455, 1970, doi: 10.1109/TAU.1970.1162132.
