IEEE Trans Haptics November 2020 PMID 31944990

Towards Multisensory Perception: Modeling and Rendering Sounds of Tool-Surface Interactions.

Shihan Lu, Yang Chen, Heather Culbertson

Full text PDF Download social card

Mentions

Peak: 3 in May 2020

across 2 sources since May 2020

Extended reach

1,909

potential audience

Total likes

Video views

1,086

Mentions per month

May 2020 – Mar 2022

Where it's discussed

X / Twitter3 posts
YouTube2 videos

AI synopsis

What people are saying

The discussions highlight curiosity and support for the article, with mentions of demo videos and the significance of combining sound modeling with tactile feedback. The tone varies from enthusiastic to analytical, reflecting a positive reception but not a complete consensus on its revolutionary potential.

AgreementModerate agreement

Most discussions show support for the article's innovative approach to modeling sounds, with some emphasizing its usefulness in virtual interactions.

InterestHigh interest

Posts express high interest, often referencing demo videos and the potential applications in haptic technology and virtual experiences.

EngagementModerate engagement

Participants engage by sharing examples of demos or related applications, indicating a moderate depth of involvement.

ImpactModerate impact

The discussions suggest the research could influence future developments in multisensory feedback, although explicit claims of groundbreaking impact are limited.

Abstract in brief

The article proposes a statistical, data-driven approach to model and generate realistic sounds of tool-surface interactions in real time by analyzing recorded audio signals and using wavelet tree models based on the velocity of interaction.
The method segments recorded sounds, labels each segment with the average velocity, and uses fast wavelet transforms to build wavelet tree models, which are then used to synthesize sounds during interaction based on the user’s current velocity.
A user study found that virtual sounds combined with real haptic feedback better convey surface textures like roughness and hardness, while perception of slipperiness mainly relies on touch cues.]

Read the full abstract

All mentions

Real-Time Sound Modeling for Tool-Surface Interactions in Virtual Environments

This presentation discusses a data-driven approach for real-time modeling and rendering of sounds in tool-surface interactions. The method analyzes recorded audio, segments sounds by velocity, and uses wavelet tree…

Shihan Lu · May 20, 2020 743 views

Real-Time Sound Modeling for Tool-Surface Interactions in Haptics

This demo applies a data-driven method to model and render touch-produced sounds in real time. It recreates realistic sounds using a statistical learning approach, enhancing perception accuracy of surface textures…

Shihan Lu · May 23, 2020 344 views

Shihan Lu

@ShihanLu · X

Sound Modeling and Rendering in Tool-Surface Interactions, short ToH paper #haptics #sound https://t.co/Dq1VbBRTmj https://t.co/8StajgPB79

Mar 10, 2022 · 58 followers View post →

Shihan Lu

@ShihanLu · X

Our demo video, Sound Modeling and Rendering in Tool-Surface Interactions #demo #haptics https://t.co/FasYD5yONl

Mar 10, 2022 · 58 followers View post →

ｔ１

@soppypopsy · X

面白い技術 Demo video, Lu et al., Sound Modeling and Rendering in Tool-Surface Inte... https://t.co/AMl5DxQlno

May 27, 2020 · 1 like · 708 followers View post →