Abstract
Prior research has shown that the direction of a user’s focus affects the perception of tactile cues. Additionally, user agency over touch stimulation has been shown to affect tactile perception. With the development of more complicated haptic and multi-sensory devices, simple tactile cues are rarely used in isolation and the effect of focus direction and of user agency on the perception of a sequence of tactile cues is unknown. In this study, we investigate the effect of both of these variables, focus direction and agency, on the perception of a cue sequence. We found that the direction of user focus and user sense of agency over tactile stimulation both had a significant effect on the accurate perception of a cue sequence. These results are presented in consideration for developing better haptic devices that account for users’ focus on and control over these devices.
This work was supported by the National Science Foundation under Grant No. CMMI-1830146. This material is also based upon work supported by the National Science Foundation Graduate Research Fellowship Program under Grant No. 1842494. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.
You have full access to this open access chapter, Download conference paper PDF
Similar content being viewed by others
Keywords
1 Introduction
Wearable haptic devices have prospered in the consumer world and become the subject of much recent haptics research aiming to expand their capabilities. These devices commonly leverage sequences of tactile cues such as vibration [11, 17], skin stretch [1, 5], and squeeze [2, 13] in a perceptually distinct manner to the other senses, thus avoiding the negative consequences of sensory overload [10]. However, prior work has indicated the perception of tactile stimuli can change due to the direction of a user’s focus (also referred to as attention in literature from other fields) [9, 16] across the body and across multiple senses [3, 8]. For brevity in this paper, we define focus direction as the aforementioned direction of a user’s focus, either across the body spatially or across multiple senses. To inform future research in developing sequences of tactile stimulation in increasingly complicated environments, one goal of this work is to understand the effect of focus direction on tactile perception.
In addition, there are differences in the perception of haptic cues that are “actively touched,” where the user purposefully feels the environment as opposed to “passively touched,” where the user reflexively senses a stimulus that has been applied to their skin [7]. These two “modes” of touch differ distinctly in the amount of agency, or control, the user has over the tactile stimulation. The effect of agency on tactile perception has not been well studied and is particularly relevant given new research directions, including studies on how to deliver rich information during active interaction with the environment, such as in responsive virtual reality [13, 15], and motion feedback for prostheses [1, 18]. Passive tactile interactions have also been investigated in prior work on delivering language cues through phonemes [6, 17], and navigation cues [4]. The relevance of this type of research motivates the second goal of this work: to understand the role of agency on tactile perception.
To address these goals, we investigate the effect of focus direction and agency on the perception of tactile cues.
2 Methods
We tested participants’ ability to accurately discriminate a single target vibration cue from a sequence of vibrations at different spatial locations on the forearm. We measured participant accuracy as the proportion of correct responses out of all trials presented in each condition while varying focus direction and agency. For this study, focus direction refers to the orientation of the participant’s focus, either spatially across the skin or across two sensory modalities (touch and sound). Agency refers to the participant’s ability to directly control the onset of stimulation or lack thereof. Our objective was to determine if these variations in focus direction and agency affected participants’ ability to complete the task accurately.
2.1 Participants
A total of 18 participants (7 female, 14 right-handed, 19–28 years old, average age 24) took part in this study. All participants in the study were healthy adults and did not suffer any cognitive or motor impairment that would affect their ability to perform the experiment. All participants gave informed consent and all procedures and methods of the experimental protocol were approved by the Rice University Institutional Review Board (IRB-FY2019-49).
2.2 Experimental Hardware
This experiment used a modified version of the Vibro-Tactile Sleeve (VT-Sleeve) used in Macklin et al. [11]. The VT-Sleeve features 6 vibrotactile actuators (Compact Audio Exciter; Tectonic; Part No. TEAX14C02-8) embedded in a compression sleeve (Under Armour) with custom 3D-printed housings. The vibrotactors were each press-fit into their respective 3D-printed housing, which clipped into slits in the compression sleeve. The vibrotactors were placed 60mm apart on the sleeve when relaxed with 3 vibrotactors on the ventral side of the arm and 3 vibrotactors on the dorsal side. The sleeve held each vibrotactor snugly against the skin as shown in Fig. 1. The sleeve was adjusted on all participants such that the vibrotactors on each side of the forearm were sufficiently separated to satisfy the two-point discrimination threshold reported for successive touch stimuli [12]. Wiring powering each vibrotactor was routed through another small slit in the compression sleeve directly next to the housing element, ensuring no direct contact between the wiring and skin. These wiring elements connected to a quick release ribbon cable connector, which in turn connected the tactors to a custom amplifier.
All tactile cues were 250 ms envelope sine waves presented 400 Hz for the target cue and 100 Hz for the distraction cues. Extensive pilot testing was done to verify that these characteristics resulted in clear and distinct vibrotactile cues. Tactile cues were rendered with Syntacts using a digital-to-analog converter (MOTU 24Ao USB) with signals amplified through the Syntacts V3.0 amplifier [14].
2.3 Experimental Conditions
The experimental task required participants to identify the location of the target cue out of a sequence of 6 vibrotactile cues delivered on the forearm. The cue sequence was randomized such that each vibrotactor vibrated once and the target cue could appear at anytime during the sequence. All sequences had one target cue and five distraction cues. All cue durations were 250 ms, with a 400 ms pause between the presentation of each cue. After each sequence, the participant used their mouse to indicate which vibrotactor they thought delivered the target cue to the forearm. This basic tactile task varied in each condition to shift focus direction or to adjust agency over sequence presentation in each trial. These variations made up the 6 conditions in this experiment to investigate the various combinations of focus direction and agency.
Focus direction was split into three categories: double focus, where participants were given a separate auditory task to perform simultaneously with the basic tactile task (as described above); wide focus, where the participant performed the basic task; and narrow focus, where the participant was told which side of the forearm the target would appear and therefore would only consider 3 of the 6 vibrotactors. The double focus task presented participants with the basic tactile task while simultaneously asking them to perform an auditory task that started in tandem with the tactile sequence. This auditory task presented a sequence of 6 auditory beeps 440 Hz each separated by 750 ms through the participant’s headphones. These beeps were presented with two perceptually distinct volumes: one quiet and one loud. The participant was asked to count the number of loud beeps out of the 6 in the sequence while simultaneously performing the basic tactile task. While each participant was instructed to perform both tasks to the best of their ability, we report participant accuracy in completing the tactile task only, as the purpose of the auditory task was only to direct focus across two tasks. The wide focus category presented the basic tactile task with 6 cues in sequence to the participant and asked them to identify the location of the target cue. The narrow focus task informed the participant about which side of the forearm the target cue was going to appear via arrow icons presented in the GUI. This directed the participant’s focus onto the 3 tactors on one side of the forearm. The participant then received the sequence of 6 cues and was asked where the target cue appeared.
Agency variations were split into only two categories: active, where the participants had a button to start the vibrotactile sequence; and passive, where the participants were allowed 30 s after each sequence was displayed to provide their response before the trial automatically advanced. The conditions in this experiment crossed these two categories such that there were 6 conditions for each participant presented in a random order: double focus passive, double focus active, wide focus passive, wide focus active, narrow focus passive, and narrow focus active.
2.4 Procedure
Participants were seated in front of a computer screen with their left hand placed on the table and their right hand using a computer mouse. The participant wore the vibrotactile sleeve on their left forearm as described in Sect. 2.2. The participant wore noise canceling headphones playing pink noise throughout the experiment to isolate them from any outside auditory stimulation. After receiving instructions from the experimenter, the participant interacted with a GUI on the computer to begin the experiment. Participants started with 5 practice trials and received feedback on the correct response in each trial. After practice, participants responded to 20 identification trials in a randomly selected condition as described in Sect. 2.3. Participants repeated this process for all six conditions.
3 Results
Participant accuracy was calculated for each condition based on the number of correct responses out of the 20 trials presented. For double focus conditions, accuracy scores were calculated solely on the participant’s ability to complete the tactile task. Two participants were non-compliant with instructions and their accuracy scores were below random chance (\({\approx }16.7\%\)) for a majority of the experimental conditions. For these reasons the data from these two subjects were excluded from data analysis. The mean and standard deviation for each condition group are reported in Table 1. Figure 2 shows the spread of participant accuracy across the six conditions in this experiment. The narrow conditions showed the highest mean accuracy while the double conditions showed the lowest. Additionally while there was little variation in the means between the active agency and passive agency conditions, the average standard deviations in the active conditions were generally larger than the average standard deviations in the passive conditions.
A two way repeated measures ANOVA was performed to analyze the effect of focus direction and agency on participant accuracy. This ANOVA showed that both focus direction and agency had a statistically significant effect on participant accuracy after Greenhouse—Geisser correction (Focus Direction: \(F(2,30)=4.05\), \(p<.05\), Agency: \(F(1,15)=5.40\), \(p<.05\)). There was no statistically significant interaction between focus direction and agency (\(F(2,30)=.60\), \(p=.54\)). Subsequent post-hoc pairwise t-tests performed between groups also showed no statistically significant difference between groups after Bonferroni correction.
4 Discussion
Results from this experiment confirm that there is a significant effect of focus direction and of agency on a participant’s accuracy in perceiving a target tactile stimulus out of a randomly ordered sequence of five distraction stimuli and one target stimulus. This matches our expectations that the direction of participant focus on tactile stimuli and participant agency over tactile stimuli affect their ability to perceive the cue accurately. Contrary to our expectations however, the differences in accuracy between double, wide, and narrow focus and between active and passive agency were smaller than expected. After correction there were no significant differences in between condition groups, despite anecdotal increased confidence in the narrow focus conditions over the double focus conditions. Although between-group results were not shown to be significant in this initial investigation, these results suggest that between-group effects may exist for both focus direction and agency. Follow-up studies with a wider participant pool and designed to look more directly at focus direction and agency may show more granular differences between focus direction and agency groups.
5 Conclusion
We conducted a study to investigate the effect of focus direction and agency on participant accuracy in the perception of sequences of vibrotactile cues. Our experiment used a custom vibrotactile sleeve to deliver sequences of vibration stimuli to a user across six conditions that varied the direction of the participants’ focus on and the participants’ agency over each trial. Results from this experiment indicate focus direction and agency both have a significant effect on accuracy in perceiving a specific tactile stimulus out of a sequence. Further research is required to learn more comprehensively about specific differences in between levels of focus direction and levels of agency.
References
Battaglia, E., Clark, J.P., Bianchi, M., Catalano, M.G., Bicchi, A., O’Malley, M.K.: Skin stretch haptic feedback to convey closure information in anthropomorphic, under-actuated upper limb soft prostheses. IEEE Trans. Haptics 12(4), 508–520 (2019). https://doi.org/10.1109/TOH.2019.2915075
Casini, S., Morvidoni, M., Bianchi, M., Catalano, M., Grioli, G., Bicchi, A.: Design and realization of the CUFF - clenching upper-limb force feedback wearable device for distributed mechano-tactile stimulation of normal and tangential skin forces. In: 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1186–1193, September 2015. https://doi.org/10.1109/IROS.2015.7353520
Chica, A.B., Sanabria, D., Lupiáñez, J., Spence, C.: Comparing intramodal and crossmodal cuing in the endogenous orienting of spatial attention. Exp. Brain Res. 179(3), 353–364 (2007). https://doi.org/10.1007/s00221-006-0798-7
Chinello, F., Pacchierotti, C., Bimbo, J., Tsagarakis, N.G., Prattichizzo, D.: Design and evaluation of a wearable skin stretch device for haptic guidance. IEEE Robot. Autom. Lett. 3(1), 524–531 (2018). https://doi.org/10.1109/LRA.2017.2766244
Clark, J.P., Kim, S.Y., O’Malley, M.K.: The rice haptic rocker: altering the perception of skin stretch through mapping and geometric design. In: 2018 IEEE Haptics Symposium, pp. 192–197, March 2018. https://doi.org/10.1109/HAPTICS.2018.8357175
Dunkelberger, N., et al.: A multisensory approach to present phonemes as language through a wearable haptic device. IEEE Trans. Haptics 14(1), 188–199 (2021). https://doi.org/10.1109/TOH.2020.3009581
Gibson, J.J.: Observations on active touch. Psychol. Rev. 69(6), 477–491 (1962). https://doi.org/10.1037/h0046962
Gray, R., Mohebbi, R., Tan, H.Z.: The spatial resolution of crossmodal attention: implications for the design of multimodal interfaces. ACM Trans. Appl. Percept. 6(1), 4:1–4:14 (2009). https://doi.org/10.1145/1462055.1462059
Halfen, E.J., Magnotti, J.F., Rahman, M.S., Yau, J.M.: Principles of tactile search over the body. J. Neurophysiol. 123(5), 1955–1968 (2020). https://doi.org/10.1152/jn.00694.2019. https://journals.physiology.org/doi/full/10.1152/jn.00694.2019
Lipowski, Z.J.: Sensory and information inputs overload: behavioral effects. Compr. Psychiatry 16(3), 199–221 (1975). https://doi.org/10.1016/0010-440X(75)90047-4. http://www.sciencedirect.com/science/article/pii/0010440X75900474
Macklin, A.S., Yau, J.M., O’Malley, M.K.: Evaluating the effect of stimulus duration on vibrotactile cue localizability with a tactile sleeve. IEEE Trans. Haptics 14(2), 328–334 (2021). https://doi.org/10.1109/TOH.2021.3079727
Mancini, F., et al.: Whole-body mapping of spatial acuity for pain and touch. Ann. Neurol. 75(6), 917–924 (2014). https://doi.org/10.1002/ana.24179. https://onlinelibrary.wiley.com/doi/abs/10.1002/ana.24179
Meli, L., Hussain, I., Aurilio, M., Malvezzi, M., O’Malley, M.K., Prattichizzo, D.: The hBracelet: a wearable haptic device for the distributed mechanotactile stimulation of the upper limb. IEEE Robot. Autom. Lett. 3(3), 2198–2205 (2018). https://doi.org/10.1109/LRA.2018.2810958
Pezent, E., Cambio, B., O’Malley, M.K.: Syntacts: open-source software and hardware for audio-controlled haptics. IEEE Trans. Haptics 14(1), 225–233 (2021). https://doi.org/10.1109/TOH.2020.3002696
Pezent, E., et al.: Tasbi: multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality. In: 2019 IEEE World Haptics Conference (WHC), pp. 1–6, July 2019. https://doi.org/10.1109/WHC.2019.8816098
Spence, C., Gallace, A.: Recent developments in the study of tactile attention. Can. J. Exp. Psychol./Revue canadienne de psychologie expérimentale 61(3), 196–207 (2007). https://doi.org/10.1037/cjep2007021
Tan, H.Z., et al.: Acquisition of 500 English words through a TActile Phonemic Sleeve (TAPS). IEEE Trans. Haptics 13(4), 745–760 (2020). https://doi.org/10.1109/TOH.2020.2973135
Witteveen, H.J.B., de Rond, L., Rietman, J.S., Veltink, P.H.: Hand-opening feedback for myoelectric forearm prostheses: performance in virtual grasping tasks influenced by different levels of distraction. J. Rehabil. Res. Dev. 49(10), 1517–1526 (2012). https://doi.org/10.1682/jrrd.2011.12.0243
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
Copyright information
© 2022 The Author(s)
About this paper
Cite this paper
Zook, Z.A., O’Malley, M.K. (2022). Effect of Focus Direction and Agency on Tactile Perceptibility. In: Seifi, H., et al. Haptics: Science, Technology, Applications. EuroHaptics 2022. Lecture Notes in Computer Science, vol 13235. Springer, Cham. https://doi.org/10.1007/978-3-031-06249-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-031-06249-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06248-3
Online ISBN: 978-3-031-06249-0
eBook Packages: Computer ScienceComputer Science (R0)