View source for Voice analysis

{{Short description|Component of speech recognition}}
{{more citations needed|date=February 2011}}
'''Voice analysis''' is the study of [[Speech communication|speech]] sounds for purposes other than linguistic content, such as in [[speech recognition]]. Such studies include mostly medical analysis of the [[human voice|voice]]  ([[phoniatrics]]), but also [[speaker identification]].<ref>{{cite journal
  |last=Sarangi|first=Susanta |author2=Sahidullah, Md |author3=Saha, Goutam
  |title=Optimization of data-driven filterbank for automatic speaker verification
  |journal=Digital Signal Processing |date=September 2020 |volume=104 
  |article-number=102795 |doi= 10.1016/j.dsp.2020.102795|arxiv=2007.10729|s2cid=220665533 }}</ref>  More controversially, some believe that the truthfulness or [[Speech emotion recognition|emotional state of speakers]] can be determined using [[voice stress analysis]] or layered voice analysis.

==Analysis methods==
Voice problems that require voice analysis most commonly originate from the vocal folds or the laryngeal musculature that controls them, since the folds are subject to collision forces with each vibratory cycle and to drying from the air being forced through the small gap between them, and the laryngeal musculature is intensely active during speech or singing and is subject to tiring. However, dynamic analysis of the vocal folds and their movement is physically difficult. The location of the vocal folds effectively prohibits direct, invasive measurement of movement. Less invasive imaging methods such as [[x-ray]]s or [[ultrasound]]s do not work because the vocal cords are surrounded by cartilage, which distorts image quality. Movements in the vocal cords are rapid, [[Fundamental frequency|fundamental frequencies]] are usually between 80 and 300 [[Hertz|Hz]], thus preventing usage of ordinary video. [[Stroboscope|Stroboscopic]], and high-speed videos provide an option, but to see the vocal folds a fiberoptic probe leading to the camera must be positioned in the throat, which makes speaking difficult. In addition, placing objects in the pharynx usually triggers a gag reflex that stops voicing and closes the larynx. In addition, stroboscopic imaging is only useful when the vocal fold vibratory pattern is closely periodic.

The most important{{According to whom|date=February 2022}} indirect methods are currently [[inverse filter]]ing of either microphone or oral airflow recordings and [[electroglottograph]]y (EGG).{{Citation needed|date=November 2021}} In inverse filtering, the speech sound (the radiated acoustic pressure waveform, as obtained from a microphone) or the oral airflow waveform from a circumferentially vented (CV) mask is recorded outside the mouth and then filtered by a mathematical method to remove the effects of the vocal tract. This method estimates the glottal input of voice production by recording output and using a computational model to invert the effects of the vocal tract. The other kind of noninvasive indirect indication of vocal fold motion is the electroglottography, in which electrodes placed on either side of the subject's throat at the level of the vocal folds record the changes in the conductivity of the throat according to how large a portion of the vocal folds are touching each other. It thus yields one-dimensional information of the contact area. Neither inverse filtering nor EGG are sufficient to completely describe the complex 3-dimensional pattern of vocal fold movement, but can provide useful indirect evidence of that movement.

Another way to conduct voice analysis is to look at voice characteristics. Some characteristics of voice are [[phonation]], [[Pitch (music)|pitch]], [[loudness]], and rate. These characteristics can be used to evaluate a person's voice and can aid in the voice analysis process. Phonation is typically tested by looking at different types of data collected from a person such as words with long vowels, words with many phonemes, or just typical speech. A person's pitch can be evaluated by making the person produce the highest and lowest sounds they can, as well as sounds in between. A keyboard can be used to aid in this process. Loudness is valuable to look at because for certain people, loudness affects the way they produce certain sounds. Some people need to speak louder for certain phonemes in comparison to others just so they can produce them.{{Citation needed|date=November 2021}} This can be tested by asking the person to use the same amount of loudness while singing a scale. Rate is also important because it looks at how fast or slow a person speaks.

<ref>{{cite book|last1=Hapner|first1=Edie|last2=Stemple|first2=Joseph|title=Voice Therapy: Clinical Case Studies|date=2014|publisher=Plural Publishing}}</ref>

==Use in medicine==
A medical study of the voice can be, for instance, analysis of the voice of patients who have had a [[Polyp (medicine)|polyp]] removed from their [[vocal cords]] through an operation. Computerized methods can be used to assess such issues in an objective manner.<ref>{{Cite journal|last1=Toran|first1=SiKC|last2=Lal|first2=B. K.|date=2010|title=Objective voice analysis for vocal polyps following microlaryngeal phonosurgery|url=https://www.nepjol.info/index.php/KUMJ/article/view/3555|journal=Kathmandu University Medical Journal|language=en|volume=8|issue=2|pages=185–189|doi=10.3126/kumj.v8i2.3555|pmid=21209532|issn=1812-2078|doi-access=free}}</ref> An experienced voice therapist can quite reliably evaluate the voice, but this requires extensive training and is still subjective.

Another active research topic in medical voice analysis is [[vocal loading]] evaluation. The vocal cords of a person who speaks for an extended time suffer from tiring—that is, the process of speaking exerts a load on the vocal cords and tires the tissue. Among professional voice users (e.g., teachers, sales people) this tiring can cause voice failures and sick leaves. Voice analysis has been studied as an objective means to evaluate such problems.<ref>{{Cite journal|last1=Stemple|first1=Joseph C.|last2=Stanley|first2=Jennifer|last3=Lee|first3=Linda|date=1995|title=Objective measures of voice production in normal subjects following prolonged voice use|journal=Journal of Voice|volume=9|issue=2|pages=127–133|doi=10.1016/s0892-1997(05)80245-0|pmid=7620534|issn=0892-1997}}</ref>

Voice analysis was an important factor in the study of vocal cord paralysis. It effects different functions of the vocal cords, from speech to breathing and voice analysis is used to study the effectiveness of [[Thyroplasty]] (medialization thyroplasty) improvements on the vocal cords after the surgery. Traditional voice recording is used in pre-operation to record the voices of chosen patients to be compared with the post-operation usage, along with more complex recordings using an  [https://www2.ims.uni-stuttgart.de/EGG/frmst2.htm electroglottograpy], [[photoglottography]],<ref>{{Cite journal |last1=Gerratt |first1=Bruce R. |last2=Hanson |first2=David G. |last3=Berke |first3=Gerald S. |last4=Precoda |first4=Kristin |date=1991-01-01 |title=Photoglottography: A clinical synopsis |url=http://www.sciencedirect.com/science/article/pii/S0892199705801730 |access-date=2020-12-16 |journal=Journal of Voice |volume=5 |issue=2 |pages=98–105 |language=en |doi=10.1016/S0892-1997(05)80173-0|url-access=subscription }}</ref> and [[videokymography]]. Medical professionals have the ability to read and understand the results from the complex recordings, but knowledge from a voice professional is needed within these experiments for accurate results. Voice experts were an important to tie the physical examination of the vocal cords to the neurological examination to ensure the success of the surgery because of their trained ear. Perceptual evaluation of voice is heavily reliant on [[Phonation|voice quality]], a factor assessed preferably by voice specialists ([[Speech–language pathology|speech therapists]]). A professional voice analyzer has a trained ear and can block out excess variants that can be deceptive from the results.<ref>{{Cite journal|last1=Chowdhury|first1=Kanishka|last2=Saha|first2=Somnath|last3=Saha|first3=Vedula Padmini|last4=Pal|first4=Sudipta|last5=Chatterjee|first5=Indranil|date=2013-03-23|title=Pre and Post Operative Voice Analysis After Medialization Thyroplasty in Cases of Unilateral Vocal Fold Paralysis|journal=Indian Journal of Otolaryngology and Head & Neck Surgery|volume=65|issue=4|pages=354–357|doi=10.1007/s12070-013-0649-3|issn=2231-3796|pmc=3851511|pmid=24427598}}</ref>

==Use in forensics==

Voice analysis is used in a branch of [[forensic science]] called [[audio forensics]]. These analyses are generally performed on evidence for the purposes of evaluating the authenticity of the audio in question, enhancing features of the audio that may be hidden beneath distracting background noise, interpreting the audio from the perspective of a forensic expert,<ref>Maher, Robert C. (2018). ''Principles of Forensic Audio Analysis''. Modern Acoustics and Signal Processing. Cham: Springer International Publishing. pp. 1–2. [[Doi (identifier)|doi]]:10.1007/978-3-319-99453-6. {{ISBN|978-3-319-99452-9}}.</ref> or in some cases for the purposes of [[speaker identification]].<ref>{{Cite book|last1=Solan|first1=Lawrence M.|title=Speaking of Crime|last2=Tiersma|first2=Peter M.|date=2004|publisher=University of Chicago Press|doi=10.7208/chicago/9780226767871.001.0001|isbn=978-0-226-76793-2}}</ref>

An expert will employ a variety of techniques in their analysis. The minimum of procedures are "critical listening, [[waveform]] analysis, and [[Spectrum analyzer#Audio frequency uses|spectral analysis]]".<ref name=":0">Maher, Robert C. (2018). ''Principles of Forensic Audio Analysis''. Modern Acoustics and Signal Processing. Cham: Springer International Publishing. pp. 48–49. [[Doi (identifier)|doi]]:10.1007/978-3-319-99453-6. {{ISBN|978-3-319-99452-9}}.</ref> Critical listening involves a thorough breakdown of both foreground and background sounds through repetitive listening.<ref name=":0" /> Waveform analysis visualizes the audio for the examiner to see any irregularities that may occur. Spectral analysis visualizes the frequency of the audio for an examiner to pick out features of interest.<ref name=":0" />

One case in which audio played a larger role is the [[Trial of George Zimmerman|Trayvon Martin case]], where a recording of a call made to the police was analyzed to determine if background screams came from [[George Zimmerman]] or from [[Trayvon Martin|Martin]].

=== Forensic Voice ===
Experts in forensic voice analyze recordings by examining transmitted and stored speech, enhancing it and decoding it for criminal investigations, court trials, and federal agencies.

To utilize audio recordings in court, a forensic phonetician must authenticate the recording to detect tampering, enhance the audio, and interpret the speech. Their first job is to ensure that the speech in the recording being used is comprehensible. Oftentimes, samples have poor sound quality due to environmental factors such as wind or movement. Other times the sound degradation is due to technological issues within the recording device. Any investigative work on speaker identification cannot be done until the recording is of proper quality. Different solutions for poor comprehensibility are done using computer programs that allow the user to filter and eliminate noise. Computer software is also able to convert the speech to spectra and waveforms, which is useful for the forensic phonetician. However, any work done on the recording should be done after a copy of the original recording is made.

A main part of the forensic phonetician's job is speaker identification. The interpretation process might include piecing together a timeline, transcribing the dialog, and identifying unknown or unintelligible sounds in the audio recording. In court, the expert ultimately serves to explain the facts surrounding the audio evidence, providing an explanation of relevant acoustical and physical principles to explain what is evidenced by the recording. Reports are made to include detailed information, if there is a section of the recording that is not comprehensible or is inaudible, an explanation of what was happening (in the recording), and a description of what is missing from the recording.

=== Speaker Identification ===
Voice analysis has a role in [[Speaker recognition|speaker identification]]. This is when the identity of a speaker is unknown, and has to be identify from an array of other voices or suspects when pertaining to a crime investigation or court trial.  Proper identification of speaker and voices particularly for criminal cases depend on a list of factors, like familiarity, exposure, delay, tone of voice, voice disguising, and accents. Familiarity with a speaker increases the chances of properly identifying a voice, and distinguishing it. The amount of exposure to a voice also aids in correctly identifying a voice, even if it is an unfamiliar one. A hearer that listen to a longer utterance or was exposed to a voice more often is better at recognizing a voice, than someone who perhaps was only able to hear one word. A delay between the time of hearing a voice and the time of identifying the speaker also decreases the prospect of identifying the correct speaker. The [[Tone (linguistics)|tone of voice]] affects the ability to identify the right speaker. If the tone does not match that of the speaker at the time of comparison, it will prove to be more difficult to analyse. Disguise of the voice, for example when a speaker is whispering, will also hinder the ability to accurately match and identify the speaker. In some cases, individuals who speak the same language as the speaker whose voice is being analysed will have an easier time identifying them because of the [[Stress (linguistics)|accent and stress]] of the voice. Speaker identification is additionally complicated by distortions from the technical method of recording and speaker based issues, such as emotional states or alternative motives causing a discrepancy between their voice and that of a recording. The methods of speaker identification in forensics include the use of earwitnesses who are used to identify voices they have heard, the aural-perceptual approach conducted by a specialist regarding the suprasegmentals of an individual's speech, and computer-based approaches.

==See also==
{{colbegin}}
* [[Audio signal processing]]
* [[Digital signal processing]]
* [[Speech processing]]
* [[Stuttering]]
* [[Voice biometrics]]
{{colend}}

==References==
<references />

==External links==
*[https://web.archive.org/web/20090118004846/http://www.voicematters.net/ Voice Problems and Vocal Disorder Online Community (VoiceMatters.net)]

[[Category:Voice technology]]
[[Category:Biometrics]]
[[Category:Human voice]]