Exploring the Impact of Two Feedback Types on Speech Intelligibility, Precision, and Naturalness

Abstract

This pilot study examined the impact of feedback type on learning a novel speech task, as measured by listener ratings, and will inform procedures for future investigations within a larger sample size. Twenty-four native monolingual English-speaking college-aged adults participated in a single training session to learn novel Hindi phrases. Participants were randomly placed into one of three feedback groups: knowledge of performance (KP), knowledge of results (KR), or a combined KP + KR condition. Participant performance was assessed at 1 day and 1 week post-training. Participant responses were audio recorded and judged for intelligibility, precision, and naturalness by native Hindi speakers, blind to the feedback conditions, via rating scales. At 2 days post-training, participants in the KP and KP + KR feedback conditions were rated as performing better than participants in the KR condition on all three perceptual measures. At 1 week post-training, participants in the KP feedback condition were judged to be superior across all three perceptual measures. Preliminary findings suggest that augmented feedback enhances learning, especially when skills are considered novel and learners are unable to rely on their own internal feedback. These results may have implications for the application of motor learning principles into clinical practice for persons with motor speech disorders.

Keywords

feedback - motor learning - training - speech

Disclosure

L.B. and E.B.M. received salary for conducting this and other research and have declared that no other competing interests existed at the time of publication. A.T. received salary while completing a portion of this project and has declared that no other competing interests existed at the time of publication.

Publication History

Article published online:
23 May 2023

• References

• Adams, S. G., & Page, A. (2000). Effects of selected practice and feedback variables on speech motor learning. Journal of Medical Speech-Language Pathology, 8, 215–220
• Adams, S. G., Page, A. D., & Jog, M. (2002). Summary feedback schedules and speech motor learning in Parkinson's disease. Journal of Medical Speech-Language Pathology, 10(4), 215–220
• Anderson, D. I., Magill, R. A., & Sekiya, H. (2001). Motor learning as a function of KR schedule and characteristics of task-intrinsic feedback. Journal of Motor Behavior, 33, 59–66
• Austermann Hula, S. N., Robin, D. A., Maas, E., Ballard, K. J., & Schmidt, R. A. (2008). Effects of feedback frequency and timing on acquisition, retention, and transfer of speech skills in acquired apraxia of speech. Journal of Speech, Language, and Hearing Research: JSLHR, 51, 1088–1113
• Baddeley, A. D., & Longman, D. J. A. (1978). Influence of length and frequency of training session on rate of learning to type. Ergonomics, 21(8), 627–635
• Ballard, K. J., Granier, J. P., & Robin, Donald A. (2000). Understanding the nature of apraxia of speech: theory, analysis, and treatment. Aphasiology, 14(10), 969–995
• Ballard, K. J., Maas, E., & Robin, D. A. (2007). Treating control of voicing in apraxia of speech with variable practice. Aphasiology, 21(12), 1195–1217
• Ballard, K. J., Smith, H. D., Paramatmuni, D., McCabe, P., Theodoros, D. G., & Murdoch, B. E. (2012). Amount of kinematic feedback affects learning of speech motor skills. Motor Control, 16(1), 106–119
• Ballard, K. J., Wambaugh, J. L., Duffy, J. R., Layfield, C., Maas, E., Mauszycki, S., & McNeil, M. R. (2015). Treatment for acquired apraxia of speech: a systematic review of intervention research between 2004 and 2012. American Journal of Speech-Language Pathology, 24(2), 316–337
• Bislick, L. (2020). A phonomotor approach to apraxia of speech treatment. Journal of American Speech-Language Pathology, 29, 2109–2130
• Bislick, L. P., Oelke, M., & Kendall, D. (2014). Phonomotor rehabilitation of apraxia of speech. Journal of Medical Speech-Language Pathology, 21(1), 15–31
• Bislick, L. P., Weir, P. C., Spencer, K., Kendall, D., & Yorkston, K. M. (2012). Do principles of motor learning enhance retention and transfer of speech skills? A systematic review. Aphasiology, 26(5), 709–728
• Bislick, L. P., Weir, P. C., & Spencer, K. A. (2013). Investigation of feedback schedules on motor learning in individuals with apraxia of speech. Journal of Medical Speech-Language Pathology, 20(4), 18–23
• Clark, H. M., & Robin, D. A. (1998). Generalized motor programme and parameterization accuracy in apraxia of speech and conduction aphasia. Aphasiology, 12, 7–8, 699–713
• Croce, R., Horvat, M., & Roswal, G. (1996). Augmented feedback for enhanced skill acquisition in individuals with traumatic brain injury. Perceptual and Motor Skills, 82(2), 507–514
• Cullen, K. E., & Mitchell, D. E. (2017). Memory Systems in Learning and Memory: A Comprehensive Reference (J. H. Bryne, ed.). Academic Press
• Duffy, J. R. (2013). Motor Speech Disorders: Substrates, Differential Diagnosis, and Management (3rd ed.). Mosby
• Gibbons, J. D., & Chakraborti, S. (2011). Nonparametric Statistical Inference (5th ed.). Boca Raton, FL: Chapman & Hall/CRC
• Grimme, B., Fuchs, S., Perrier, P., & Schöner, G. (2011). Limb versus speech motor control: a conceptual review. Motor Control, 15(1), 5–33
• Hemayattalab, R., & Rostami, L. R. (2010). Effects of frequency of feedback on the learning of motor skill in individuals with cerebral palsy. Research in Developmental Disabilities, 31(1), 212–217
• Jones, K., & Croot, K. (2016). The effect of blocked, random and mixed practice schedules on speech motor learning of tongue twisters in unimpaired speakers. Motor Control, 20(4), 350–379
• Jonsdottir, J., Cattaneo, D., Recalcati, M., Regola, A., Rabuffetti, M., Ferrarin, M., & Casiraghi, A. (2010). Task-oriented biofeedback to improve gait in individuals with chronic stroke: motor learning approach. Neurorehabilitation and Neural Repair, 24(5), 478–485
• Kaipa, R. (2013). Evaluation of principles of motor learning in speech and non-speech-motor learning tasks. [Doctoral dissertation, published online]. University of Canterbury. Accessed February 10, 2023 at: http://hdl.handle.net/10092/10349
• Kaipa, R., Robb, M., & Jones, R. (2017). The effectiveness of constant, variable, random, and blocked practice in speech-motor learning. Journal of Motor Learning and Development, 5(1), 103–125
• Katz, W. F., McNeil, M. R., & Garst, D. M. (2010). Treating apraxia of speech (AOS) with EMA-supplied visual augmented feedback. Aphasiology, 24(6–8), 826–837
• Keele, S. W. (1968). Movement control in skilled motor performance. Psychological Bulletin, 70, 387–403
• Kim, I. S., Lapointe, L. L., & Stierwalt, J. A. (2012). The effect of feedback and practice on the acquisition of novel speech behaviors. American Journal of Speech-Language Pathology, 21, 89–100
• Knock, T. R., Ballard, K. J., Robin, D. A., & Schmidt, R. A. (2000). Influence of order of stimulus presentation on speech motor learning: a principled approach to treatment for apraxia of speech. Aphasiology, 14(5–6), 653–668
• Laerd Statistics. (2016). Kendall's coefficient of concordance, W, using SPSS Statistics. Statistical tutorials and software guides. Accessed February 10, 2023 at: https://statistics.laerd.com/
• Lauber, B., & Keller, M. (2014). Improving motor performance: Selected aspects of augmented feedback in exercise and health. European Journal of Sport Science, 14(1), 36–43
• Leddy, M. (1999). The biological bases of speech in people with Down syndrome. In: Miller J, Leddy M, & Leavitt LA, (eds), Improving the Communication of People with Down Syndrome (pp. 61–80). Baltimore, MD: Paul H Brookes Publishing
• Levin, M. F., & Demers, M. (2021). Motor learning in neurological rehabilitation. Disability and Rehabilitation, 43(24), 3445–3453
• Lisman, A. L., & Sadagopan, N. (2013). Focus of attention and speech motor performance. Journal of Communication Disorders, 46(3), 281–293
• Lowe, M. S., & Buchwald, A. (2017). The impact of feedback frequency on performance of a novel speech motor learning task. Journal of Speech, Language, and Hearing Research: JSLHR, 60, 1712–1725
• Lubold, N., Borrie, S. A., Barrett, T. S., Willi, M., & Berisha, V. (2019). Do conversational partners entrain on articulatory precision? Interspeech, 2019, 1931–1935
• Maas, E., Robin, D. A., Austermann Hula, S. N., Freedman, S. E., Wulf, G., Ballard, K. J., & Schmidt, R. A. (2008). Principles of motor learning in treatment of motor speech disorders. American Journal of Speech-Language Pathology, 17, 277–298
• Magill, R. A. (2004). Motor Learning and Control: Concepts and Applications (7th edn.). New York: McGraw-Hill
• Maier, M., Ballester, B. R., & Verschure, P. F. M. J. (2019). Principles of neurorehabilitation after stroke based on motor learning and brain plasticity mechanisms. Frontiers in Systems Neuroscience, 13, 74
• McKechnie, J., Ahmed, B., Gutierrez-Osuna, R., Murray, E., McCabe, P., & Ballard, K. J. (2020). The influence of type of feedback during tablet-based delivery of intensive treatment for childhood apraxia of speech. Journal of Communication Disorders, 87, 106026
• Molier, B. I., Van Asseldonk, E. H. F., Hermens, H. J., & Jannink, M. J. A. (2010). Nature, timing, frequency and type of augmented feedback; does it influence motor relearning of the hemiparetic arm after stroke? A systematic review. Disability and Rehabilitation, 32, 1799–1809
• Mollaei, F., Shiller, D. M., Baum, S. R., & Gracco, V. L. (2016). Sensorimotor control of vocal pitch and formant frequencies in Parkinson's disease. Brain Research, 1646, 269–277
• Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699
• Newell, K. M., Carlton, M. J., & Antoniou, A. (1990). The interaction of criterion and feedback information in learning a drawing task. Journal of Motor Behavior, 22, 536–552
• Newell, K. M., & Carlton, M. J. (1987). Augmented information and the acquisition of isometric tasks. Journal of Motor Behavior, 19, 4–12
• Newell, K. M., Quinn, J. T., & Carlton, M. J. (1987). Kinematic information feedback and task constraints. Applied Cognitive Psychology, 1, 273283
• Newell, K. M., Quinn, J. T., Sparrow, W. A., & Walter, C. B. (1983). Kinematic information feedback for learning a rapid arm movement. Human Movement Science, 2, 255–270
• Nunes, M. E. S., Souza, M. G. T. X., Basso, L., Monteiro, C. B. M., Corrêa, U. C., & Santos, S. (2014). Frequency of provision of knowledge of performance on skill acquisition in older persons. Frontiers in Psychology, 5, 1454
• Onla-or, S., & Winstein, C. J. (2008). Determining the optimal challenge point for motor skill learning in adults with moderately severe Parkinson's disease. Neurorehabilitation and Neural Repair, 22(4), 385–395
• Park, J. H., & Shea, C. H. (2003). Effect of practice on effector independence. Journal of Motor Behavior, 35(1), 33–40
• Park, J. H., & Shea, C. H. (2005). Sequence learning: response structure and effector transfer. The Quarterly Journal of Experimental Psychology. A, Human Experimental Psychology, 58(3), 387–419
• Preston, J. L., Brick, N., & Landi, N. (2013). Ultrasound biofeedback treatment for persisting childhood apraxia of speech. American Journal of Speech-Language Pathology, 22(4), 627–643
• Rice, M. S., & Hernandez, H. G. (2006). Frequency of knowledge of results and motor learning in persons with developmental delay. Occupational Therapy International, 13(1), 35–48
• Rice, M. S., Fertig, P. A., Maitra, K. K., & Miller, B. K. (2008). Reduced feedback: motor learning strategy in persons with Alzheimer's disease. Physical & Occupational Therapy in Geriatrics, 27(2), 122–138
• Robertson, E. M., Pascual-Leone, A., & Miall, R. C. (2004). Current concepts in procedural consolidation. Nature Reviews. Neuroscience, 5, 576–582
• Ronsse, R., Puttemans, V., Coxon, J. P., Goble, D. J., Wagemans, J., Wenderoth, N., & Swinnen, S. P. (2011). Motor learning with augmented feedback: modality-dependent behavioral and neural consequences. Cerebral Cortex (New York, N.Y.), 21, 1283–1294
• Saemi, E., Porter, J. M., Ghotbi-Varzaneh, A., Zarghami, M., & Maleki, F. (2012). Knowledge of results after relatively good trials enhances self-efficacy and motor learning. Psychology of Sport and Exercise, 13(4), 378–382
• Samudravijaya, K., Rao, P. V. S., & Agrawal, S. S. (2000). Hindi speech database. In: Sixth International Conference on Spoken Language Processing Beijing, China
• Sasisekaran, J., Smith, A., Sadagopan, N., & Weber-Fox, C. (2010). Nonword repetition in children and adults: effects on movement coordination. Developmental Science, 13(3), 521–532
• Scheiner, L. R., Sadagopan, N., & Sherwood, D. E. (2014). Effects of blocked versus random practice on speech motor skill acquisition and retention. Journal of Motor Learning and Development, 2(2), 29–36
• Schmidt, R. A. (2003). Motor schema theory after 27 years: reflections and implications for a new theory. Research Quarterly for Exercise and Sport, 74(4), 366–375
• Schmidt, R. A. (1975). A schema theory of discrete motor skill learning. Psychological Review, 82(4), 225–260
• Schmidt, R. A. (1988). Motor Control and Learning. Champaign, IL: Human Kinetics
• Schmidt, R. A., & Lee, T. D. (2011). Motor Control and Learning: Behavioral Emphasis. Champaign, IL: Human Kinetics
• Schmidt, R. A., & Bjork, R. A. (1992). New conceptualizations of practice: common principles in three paradigms suggest new concepts for training. Psychological Science, 3(4), 207–217.
• Schmidt, R. A., Lee, T. D., Winstein, C. J., Wulf, G., & Zelaznik, H. N. (2019). Motor Control and Learning: A Behavioral Emphasis. Champaign, IL: Human Kinetics.
• Schmidt, R. A., & Lee, T. D. (2005). Motor Control and Learning: A Behavioral Emphasis. Champaign, IL: Human Kinetics
• Sharma, D. A., Chevidikunnan, M. F., Khan, F. R., & Gaowgzeh, R. A. (2016). Effectiveness of knowledge of result and knowledge of performance in the learning of a skilled motor activity by healthy young adults. Journal of Physical Therapy Science, 28(5), 1482–1486
• Shea, C. H., Lai, Q., Black, C., & Park, J. H. (2000). Spacing practice sessions across days benefits the learning of motor skills. Human Movement Science, 19(5), 737–760
• Sidaway, B., Bates, J., Occhiogrosso, B., Schlagenhaufer, J., & Wilkes, D. (2012). Interaction of feedback frequency and task difficulty in children's motor skill learning. Physical Therapy, 92(7), 948–957
• Spencer, K. A., & Rogers, M. A. (2005). Speech motor programming in hypokinetic and ataxic dysarthria. Brain and Language, 94(3), 347–366
• Spielman, J., Ramig, L. O., Mahler, L., Halpern, A., & Gavin, W. J. (2007). Effects of an extended version of the Lee Silverman voice treatment on voice and speech in Parkinson's disease. American Journal of Speech-Language Pathology, 16(2), 95–107
• Steinhauer, K., & Grayhack, J. P. (2000). The role of knowledge of results in performance and learning of a voice motor task. Journal of Voice, 14(2), 137–145.
• Van der Merwe, A. (2009). A theoretical framework for the characterization of pathological speech sensorimotor control. In: M. R. McNeil (ed.), Clinical Management of Sensorimotor Speech Disorders (2nd ed.). Thieme
• Van der Merwe, A. (2011). A speech motor learning approach to treating apraxia of speech: rationale and effects of intervention with an adult with acquired apraxia of speech. Aphasiology, 25(10), 1174–1206
• van Vliet, P. M., & Wulf, G. (2006). Extrinsic feedback for motor learning after stroke: What is the evidence? Disability and Rehabilitation, 28(13-14), 831–840
• Varley, R., Whiteside, S., Windsor, F., & Fisher, H. (2006). Moving up from the segment: a comment on Aichert and Ziegler's syllable frequency and syllable structure in apraxia of speech, brain and language, 88, 148-159, 2004. Brain and Language, 96, 235–239
• Wambaugh, J. L., Nessler, C., Cameron, R., & Mauszycki, S. C. (2013). Treatment for acquired apraxia of speech: examination of treatment intensity and practice schedule. American Journal of Speech-Language Pathology, 22(1), 84–102
• Wambaugh, J. L., Nessler, C., Wright, S., & Mauszycki, S. C. (2014). Sound production treatment: Effects of blocked and random practice. American Journal of Speech-Language Pathology, 23(2), S225–S245
• Weir-Mayta, P., Hamilton, A., Stockton, J. D., & Munoz, C. (2022). Feedback schedule effects on speech motor learning in older adults. Physical Activity and Health, 6(1), 228–245
• Weir-Mayta, P., Spencer, K. A., Daliri, A., Bierer, S., & Ondish, P. (2019). Feedback schedule effects on speech motor learning in older adults. International Journal of Aging Research, 2, 33
• Woldag, H., Stupka, K., & Hummelsheim, H. (2010). Repetitive training of complex hand and arm movements with shaping is beneficial for motor improvement in patients after stroke. Journal of Rehabilitation Medicine, 42, 582–587
• Wright, D. L., Black, C. B., Immink, M. A., Brueckner, S., & Magnuson, C. (2004). Long-term motor programming improvements occur via concatenation of movement sequences during random but not during blocked practice. Journal of Motor Behavior, 36(1), 39–50
• Wulf, G., & Schmidt, R. A. (1997). Variability of practice and implicit motor learning. Journal of Experimental Psychology. Learning, Memory, and Cognition, 23(4), 987–1006
• Wulf, G., McConnel, N., Gärtner, M., & Schwarz, A. (2002). Enhancing the learning of sport skills through external-focus feedback. Journal of Motor Behavior, 34(2), 171–182
• Yorkston, K. M., Beukelman, D. R., Strand, E. A., & Bell, K. R. (1999). Management of Motor Speech Disorders in Children and Adults (2nd ed.). Austin, TX: Pro-Ed
• Young, D. E., & Schmidt, R. A. (1992). Augmented kinematic feedback for motor learning. Journal of Motor Behavior, 24(3), 261–273