Part 1. Defining key concepts in temporal processing
Analyzing temporal processing concepts and procedures separately is helpful for understanding the subjects and literature associated with temporal processing, hearing loss, and amplification.
|is a member of the faculty in the Department of Speech Pathology and Audiology at West Virginia University, Morgantown, WVa.|
Temporal processing refers to the processing of acoustic stimuli over time. Speech stimuli and other background sounds vary over time, making temporal processing an important component in the ability to understand speech in quiet and in background noise. Hearing care professionals need to be familiar with the various aspects of temporal processing for two key reasons:
1) Children with auditory processing problems have difficulty in the temporal processing of auditory stimuli, and these difficulties can hinder their acquisition of speech, language, and reading;
2) Older individuals can also have temporal processing deficits which can affect their ability to understand speech and to benefit from amplification.
The following provides information about the various aspects of temporal processing that have been reported in the literature. It should be noted that there is considerable overlap across the various measures. (Editor’s Note: Part 2, “Temporal Processing, Hearing Loss, and Amplification,” will appear in the June issue of HR.)
Temporal resolution generally refers to the lower limits of the auditory system to resolve time, and can be measured by:
Gap detection: For humans, to detect a brief gap between two stimuli, a minimum time-gap is necessary. Otherwise, the two stimuli will be perceived as one stimulus.
Within-channel gap detection threshold: This is the minimum time necessary to detect gaps between sounds that have the same spectrum (eg, a 1000 Hz tone before and after the gap).1,2
Across-channel gap detection threshold: This is the minimum time necessary to detect gaps between sounds that are spectrally dissimilar (eg, tone and noise) or sounds that are presented to two ears.1,3
Detection of temporal modulation: Temporal modulation refers to a reoccurring change (eg, frequency or amplitude) in the signal over time. The degree of change determines the modulation depth of the signal. We need to have a minimum modulation depth to detect that a stimulus is modulated or changing in some way.4,5 This depth is related to the modulation rate of the stimulus, which refers to the frequency with which the signal changes over time.
Duration discrimination: This is the minimum difference in duration necessary to perceive that two otherwise identical stimuli are different in duration.6 Note that duration discrimination is affected by temporal integration which makes longer-duration sounds appear louder. Duration discrimination can also be affected by changes in the frequency composition of the signal.
Gap-duration discrimination: This is the minimum difference in duration necessary between two silent intervals (or gaps, marked by acoustic stimuli on both sides of the gap) to perceive that the duration of the two silent intervals is different.
Temporal Asynchrony Tasking
Temporal asynchrony is the presentation of two or more different stimuli that differ relative to signal timing. When assessing a temporal asynchrony task, the temporal alignment of two stimuli differs, and the listener’s task is to differentiate between the two stimuli.
Temporal asynchrony detection: Thresholds can be measured for detecting temporal asynchrony in the onset or offset of complex signals composed of many sinusoidal components.7,8 The components either form a harmonic series or are uniformly spaced on a logarithmic frequency scale. In the standard synchronous stimulus, all components start and stop synchronously. In the comparison stimulus, asynchrony is created by starting (onset asynchrony) or stopping (offset asynchrony) only one or certain components before or after the other components in the complex. The listener’s task is to discriminate between the standard and the comparison stimulus. Signal size or the asynchrony in turning on or off components is varied. Thresholds for detecting onset asynchrony in harmonic signals can be as low as 0.2 ms but are about 10 times larger (2 ms) for detecting offset asynchrony.
Temporal asynchrony discrimination: In temporal asynchrony discrimination testing, a standard asynchronous stimulus can be created by linearly delaying successive components of a complex stimulus. Another asynchronous comparison stimulus is created by altering the temporal position of a single component in the complex relative to its temporal position in the standard stimulus.9 The listener’s task is to discriminate between the standard and the comparison stimulus.
Temporal ordering refers to our ability to perceive a sequence of sounds.
Temporal order threshold: This is the minimum time-gap between sound sequences necessary to correctly perceive the order of incoming stimuli (eg, click-tone-tone). This time-gap is generally larger than the gap necessary to just perceive that there is a gap between two sounds1 and depends on the number of stimuli in the sequence of items to be judged.
Temporal order judgment: We can measure the ability of individuals to correctly order sound sequences after providing sufficient gaps between those sounds.10,11 Some individuals may have difficulty in ordering sound sequences even after sufficient time-gaps are provided between sounds. For example, if the sound sequence consists of variations in pitch (eg, low-low-high), the individual may report an incorrect sequence (eg, high-low-high).
The precedence effect (also known as the principle of the first wave-front) relates to how a signal that precedes subsequent signals (eg, echoes) dominates our perception of that sound.27 In other words, the auditory system suppresses signals that occur within about 40 ms after the earlier arriving sound, provided that the later occurring signals are softer than the original signal.
Temporal masking refers to the ability of one sound to mask another sound that precedes and/or follows it.12,13 Thus, temporal masking can be considered in three ways:
Forward masking: The masker is presented, then the signal is presented after a brief time-delay.
Backward masking: The masker follows the signal after a brief time interval.
Combined backward and forward masking: The signal is separated briefly in time by a masker that precedes it and another masker that follows it.
Temporal Integration or Temporal Summation
Temporal integration refers to the ability of the auditory system to add up information over time or over duration up to a critical duration.
Temporal summation at auditory thresholds:
Temporal summation due to increase in stimulus-duration: Auditory thresholds can improve with increases in the duration of the stimulus.14,15 For example, if an individual has a threshold of 15 dB for a stimulus lasting 20 ms, the thresholds may be 10 dB better (5 dB) for a stimulus that is 200 ms long. The ear appears to integrate power over an integration time frame of about 200 ms. Thus, auditory thresholds do not improve substantially with increases in stimulus-duration beyond 200 ms. Note that, if the stimulus duration is too long (eg, 2 min), the thresholds can become worse. This is referred to as adaptation.
Temporal summation due to increase in stimulus-rate: Auditory thresholds can also improve due to increases in stimulus rates.16,17 This is partially due to the fact that, at higher rates, more stimuli are presented within a short period. Thus, more energy is added over time in faster repetition. Such improvement in thresholds may also be related to neural facilitation. In addition, at relatively low stimulus rates (1 to 4 per second), thresholds may also improve due to more opportunities to detect the stimulus16 (eg, stimuli presented at a rate of 4 per second, have a better chance for detection than stimuli presented at a rate of 1 per second).
Temporal summation of loudness at supra-threshold levels:
Supra-threshold temporal summation due to increase in stimulus-duration: This refers to the increase in the perceived loudness of the stimulus with increase in stimulus duration.18,19 Stated differently, when two equally intense stimuli of differing durations are compared, the stimulus with longer duration sounds louder.
Supra-threshold temporal summation due to increase in stimulus-rates: This refers to an increase in the perceived loudness of the stimulus with increases in stimulus-rate; the stimulus presented at the higher rate is perceived as being louder.20
Temporal summation in acoustic reflex thresholds:
Temporal summation of acoustic reflex thresholds: This is the improvement in acoustic reflex thresholds apparent with increase in duration of stimuli.21,22
Rate-induced facilitation of acoustic reflex thresholds: This is the improvement in acoustic reflex thresholds apparent with increase in stimulus rate.23,24,25
Temporally Degraded Speech
Rapid speech: Speech that is spoken at a faster rate requires faster auditory processing for comprehension of the spoken message. For example, TV and radio commercial announcers often speak at relatively faster rates.
Time-compressed speech: In time-compressed speech, speech is compressed by removing tiny segments from the message and bringing the remaining elements together. This type of speech also requires faster processing for comprehension of the spoken message. In addition, comprehension of such a speech sample may also require the ability to fill in the missing segments (closure).
Reverberant speech: Speech reverberates when the original spoken message is mixed with reflections of the message from surrounding surfaces such as walls, floors, etc. This can cause distortion of the speech signal due to the temporal smearing.
Speech in competing background: Speech often occurs in noise, which may result in temporal masking in addition to direct masking of the signal. Processing of such stimuli also requires temporal segregation of the speech and the competing signal.
Temporally jittered speech: In this case the speech is jittered by varying the timing of the various segments of the speech sound-file. More specifically, the sequence of amplitude values in the sound-file is changed by shifting them slightly earlier or later in the sequence.26 This type of speech attempts to simulate neural asynchrony or the inability of auditory neurons to fire in a synchronous fashion to a single phase of the incoming stimuli. In contrast, neural synchrony, or phase locking, is the normal characteristic of auditory nerve fibers to synchronously fire during one phase of the stimulus. The temporal jitter is only applied to the low frequency components of the speech signal since phase-locking is most prominent in the lower frequencies.
Binaural Temporal Processing
Binaural temporal processing requires the processing of stimuli over time by both ears. For this type of processing to occur stimuli presented to two ears must be compared at some central location in the auditory system.
Between-ears (across channel) gap detection: This is the ability to detect gaps between sounds that are being presented to two ears.
Between-ears temporal order judgment: This is the ability to correctly judge the order of sounds being presented at two ears.
Dichotic temporal masking: This is similar to the forward and/or backward masking described earlier, except that the probe-signal is presented to one ear and the masking signal is presented to the other ear.
Sound localization: Our ability to determine the direction of sound is partially dependent on the differences in the arrival time of the sound at the two ears. For example, we perceive the sound as coming from the left side if the sound arrives sooner at the left ear when compared to the right ear. Our ability to encode such interaural time differences diminishes with increasing frequency. However, the localization of complex sounds is also dependent on temporal cues. Temporal cues are available at high frequencies in such complex sounds due to the interaural delays in the amplitude envelopes of these sounds.
Time-intensity trade: The lateralized image of a signal arriving earlier in time at one ear can be brought back to a center location by making the later-arriving signal at the other ear louder. For example, if a signal is presented earlier to the left ear as compared to the right ear, the sound image is perceived in the left ear. This effect can be cancelled by making the late-arriving sound to the right ear louder than that presented to the left ear. Thus, in this case the advantage of the earlier arriving signal can be traded off by making the sound louder in the other ear.28
Masking level difference: The perception of signals (tonal or speech) in noise can be improved by changing the phase of the masker in relation to the signal at the two ears. For example, it is easier to detect a signal presented in phase at the two ears in the presence of noise presented out of phase at the two ears compared to the condition where both signal and noise are presented in phase to both ears.29
1. Hirsh IJ. Auditory perception of temporal order. J Acoust Soc Am. 1959;31(6):759-767.
2. Purcell DW, John SM, Schneider BA, Picton TW. Human temporal auditory acuity as assessed by envelope following responses. J Acoust Soc Am. 2004;116(6):3581-3593.
3. Heinrich A, Alain C, Schneider BA. Within- and between-channel gap detection in the human auditory cortex. Neuroreport. 2004;15(13): 2051-2056.
4. Viemeister NF. Temporal modulation transfer functions based upon modulation thresholds. J Acoust Soc Am. 1979;66(5): 1364-1380.
5. Lorenzi C, Simpson MI, Millman RE, Griffiths TD, Woods WP, Rees A, Green GG. Second-order modulation detection thresholds for pure-tone and narrow-band noise carriers. J Acoust Soc Am. 2001;110(5 Pt 1):2470-2478.
6. Hellstrom A, Rammsayer TH. Effects of time-order, interstimulus interval, and feedback in duration discrimination of noise bursts in the 50- and 1000-ms ranges. Acta Psychol (Amst). 2004;116(1): 1-20.
7. Zera J, Green DM. Detecting temporal onset and offset asynchrony in multicomponent complexes. J Acoust Soc Am. 1993;93(2): 1038-1052.
8. Zera J, Green DM. Effect of signal component phase on asynchrony discrimination. J Acoust Soc Am. 1995;98(2, Pt 1): 817-827.
9. Zera J, Green DM. Detecting temporal asynchrony with asynchronous standards. J Acoust Soc Am. 1993;93(3):1571-1579.
10. Warren RM, Obusek CJ, Farmer RM, Warren RP. Auditory sequence: confusion of patterns other than speech or music. Science. 1969;164(879): 586-587.
11. Musiek FE. Frequency (pitch) and duration pattern tests. J Am Acad Audiol.1994;5(4):265-268.
12. Elliott LL. Backward and forward masking of probe tones of different frequencies. J Acoust Soc Am. 1962;34(8):1116-1117.
13. Hartley DEH, Moore DR. Auditory processing efficiency deficits in children with developmental language impairments. J Acoust Soc Am. 2002;112(6):2962-2966.
14. Bekesy GV. Zur Theories des horens. Physik. Zeits. 1927;30:115. Quoted in: Munson WA. The growth of auditory sensation. J Acoust Soc Am. 1947;19(4):584.
15. Neubauer H, Heil P. Towards a unifying basis of auditory thresholds: the effects of hearing loss on temporal integration reconsidered. J Assoc Res Otolaryngol. 2004;5(4):436-458.
16. Garner WR. Auditory thresholds of short tones as a function of repetition rates. J Acoust Soc Am. 1947;19(4):600-608.
17. Beattie RC; Rochverger I. Normative behavioral thresholds for short tone-bursts. J Am Acad Audiol. 2001;12(9):453-461
18. Miller GA. The perception of short bursts of noise. J Acoust Soc Am. 1948;20(2):160-170.
19. Buus S, Florentine M, Poulsen T. Temporal integration of loudness in listeners with hearing losses of primarily cochlear origin. J Acoust Soc Am. 1999;105(6):3464-3480.
20. Darling RM, Price LL. Temporal summation of repetitive click stimuli. Ear Hear. 1989;10 (3):173-177.
21. Moller AR. Acoustic reflex in man. J Acoust Soc Am. 1962;34(9B):1524-1534.
22. Cacace AT, Margolis RH, Relkin EM. Threshold and suprathreshold temporal integration effects in the crossed and uncrossed human acoustic stapedius reflex. J Acoust Soc Am. 1991;89(3): 1255-1261.
23. Johnsen NJ, Terkildsen K. The normal middle ear reflex thresholds towards white noise and acoustic clicks in young adults. Scand Audiol. 1980;9(3):131-135.
24. Rawool VW. Effect of aging on the click-rate induced facilitation of acoustic reflex thresholds. J Gerontol Biol Sci Med Sci. 1996;51(2):B124-31
25. Fielding ED, Rawool VW. Acoustic reflex thresholds at varying click rates in children. Int J Pediatr Otorhinolaryngol. 2002;63(3):243-252.
26. Miranda TT, Pichora-Fuller MK. Temporally jittered speech produces performance intensity, phonetically balanced rollover in young normal hearing listeners. J Am Acad Audiol. 2002;13:50-58.
27. Yost WA, Soderquist DR. The precedence effect: revisited. J Acoust Soc Am. 1984;76 (5):1377-1383.
28. Moushegian G, Jeffress LA. Role of interaural time and intensity differences in the lateralization of low-frequency tones. J Acoust Soc Am. 1959;31(11):1441-1445.
29. Hirsh IJ. The influence of interaural phase on interaural summation and inhibition. J Acoust Soc Am. 20 1948; 20(4): 536-544.
Correspondence can be addressed to HR or Vishakha W. Rawool, PhD, Dept of Speech Pathology and Audiology, West Virginia University, PO Box 6122, Morgantown, WV 26506-6122; e-mail: [email protected]