Sci Robot May 2024 PMID 38809998

Microsaccade-inspired event camera for robotics.

Botao He, Ze Wang, Yuan Zhou, Jingxi Chen, Chahat Deep Singh, Haojia Li, Yuman Gao, Shaojie Shen, Kaiwei Wang, Yanjun Cao, Chao Xu, Yiannis Aloimonos, Fei Gao, Cornelia Fermüller

Mentions

52
Peak: 12 in Jul 2024
across 5 sources since May 2024

Extended reach

168,197
potential audience

Total likes

180

Video views

6,110

Mentions per month

May 2024 – Jun 2025

Where it's discussed

  • News26 articles
  • X / Twitter19 posts
  • YouTube3 videos
  • Facebook2 posts
  • Blogs2 articles

AI synopsis

What people are saying

The discussions emphasize the novelty of mimicking human eye movements to enhance visual perception, with phrases like 'improving texture perception' and 'significantly outperforming standard cameras' demonstrating excitement and recognition of the research's potential impact. Technical references and mentions of real-world applications show deep engagement and appreciation for the study's significance.

AgreementModerate agreement

Most discussions recognize the value of mimicking human microsaccades to improve camera technology, indicating general support for the research.

InterestHigh interest

Posts consistently highlight the innovative approach and potential applications, showing high curiosity and engagement with the topic.

EngagementHigh engagement

Several discussions include technical details, comparisons to human vision, and implications for robotics, reflecting active analysis and interest.

ImpactModerate impact

Participants believe that this development could significantly advance robotics and imaging technology, although some debate the current limitations.

Abstract in brief

  • Neuromorphic vision sensors, or event cameras, enable ultra-fast visual perception but struggle with capturing edges parallel to motion due to intrinsic limitations.
  • Inspired by human microsaccades—tiny involuntary eye movements—the authors designed a system called the artificial microsaccade-enhanced event camera (AMI-EV) that incorporates a rotating wedge prism to improve texture stability.
  • Testing shows that AMI-EV significantly outperforms standard and other event cameras in real-world scenarios, enhancing robotics' ability to perceive both low-level and high-level visual tasks.

Top posts

Most liked on X and Bluesky
Michael F. Chiang, MD
@NEIDirector · X

From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve robots, smartphones & other image-capturing devices. @CFermuller @BotaoUMD @umiacs @umdcs @SciRobotics: https://t.co/0OYYJUif5M https://t.co/X8ECInavNC

Jul 11, 2024 · 20 likes · 8 shares · 9,735 followers View post →
Science Robotics
@SciRobotics · X

In humans, #microsaccades prevent fixated objects from fading in vision. A rotating wedge prism does the same work for an #EventCamera that senses highly dynamic objects, according to a new study in Science #Robotics. https://t.co/qM1JPUqio3 https://t.co/nEiKoY7sIB

Jun 4, 2024 · 9 likes · 1 share · 27,671 followers View post →
Science Robotics
@SciRobotics · X

Researchers added a rotating wedge prism to enhance event camera texture perception, imitating the effect of #microsaccades in human vision. Learn more in Science #Robotics: https://t.co/QNqC2Vb3tB @umiacs @ZJU_China https://t.co/326krYKw3x

May 31, 2024 · 7 likes · 3 shares · 27,671 followers View post →
PRG UMD
@prgumd · X

Jun 21, 2024 · 6 likes · 1 share · 48 followers View post →
C Zhang
@ChongZitaZhang · X

Two recent papers from Nature and Science Robotics show that it's *good* (not just possible) to use event cameras/sensors for mobile robots: https://t.co/fhsc2GrXRD https://t.co/SQOtb6KoQV We need advanced perception for animal-level advanced sensorimotor skills.

May 29, 2024 · 5 likes · 5,466 followers View post →
maz
@dynamicsoar · X

論文の方 ( https://t.co/aT4yKYCiKF ) は読めないけど、sony のいうとこの event-based vision sensor (EVS) の話で、「静止物体が検知できない」点を眼球の微細運動 (microsaccade) で解決してるっぽい。カメラ自体動かすのは大変そうだけど液晶シャッタ方式に比べて何かが良いんだな https://t.co/53EhNoGCzG

Jul 1, 2024 · 2 likes · 2,411 followers View post →

All mentions

Oleksandr Nikitin
@oleksandr_now · X

raw sensors are kind of hard to improve right now (they're effectively photon counters for some time already), but CPUs are improved so we can combine the data acquired in much more clever ways than just averaging https://t.co/RCClOof3Jf

Jun 1, 2025 · 1 like · 554 followers View post →
The Silicon Hill
@TheSiliconHill · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 63,889 followers View post →
UMD Science
@UMDscience · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 4,163 followers View post →
Dr. Kemar E. Green
@dr_kgreen · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 2,835 followers View post →
UMIACS
@umiacs · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 2,076 followers View post →
mahjabeen choudhury
@echopushpa · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 138 followers View post →
UMD Department of Computer Science
@umdcs · X

RT @NEIDirector: From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve…

Jul 11, 2024 · 8 shares · 6,433 followers View post →
Michael F. Chiang, MD
@NEIDirector · X

From @UofMaryland and @ZJU_China: a new camera that mimics the tiny movements of the human eye (microsaccades) to improve robots, smartphones & other image-capturing devices. @CFermuller @BotaoUMD @umiacs @umdcs @SciRobotics: https://t.co/0OYYJUif5M https://t.co/X8ECInavNC

Jul 11, 2024 · 20 likes · 8 shares · 9,735 followers View post →
maz
@dynamicsoar · X

論文の方 ( https://t.co/aT4yKYCiKF ) は読めないけど、sony のいうとこの event-based vision sensor (EVS) の話で、「静止物体が検知できない」点を眼球の微細運動 (microsaccade) で解決してるっぽい。カメラ自体動かすのは大変そうだけど液晶シャッタ方式に比べて何かが良いんだな https://t.co/53EhNoGCzG

Jul 1, 2024 · 2 likes · 2,411 followers View post →
Ishan Tamrakar
@Ishantjr · X

RT @prgumd:

Jun 21, 2024 · 1 share · 29 followers View post →
PRG UMD
@prgumd · X

Jun 21, 2024 · 6 likes · 1 share · 48 followers View post →
Science Robotics
@SciRobotics · X

In humans, #microsaccades prevent fixated objects from fading in vision. A rotating wedge prism does the same work for an #EventCamera that senses highly dynamic objects, according to a new study in Science #Robotics. https://t.co/qM1JPUqio3 https://t.co/nEiKoY7sIB

Jun 4, 2024 · 9 likes · 1 share · 27,671 followers View post →
Shigekazu Ishihara
@shigekzishihara · X

RT @SciRobotics: Researchers added a rotating wedge prism to enhance event camera texture perception, imitating the effect of #microsaccade…

May 31, 2024 · 3 shares · 7,073 followers View post →
Science Robotics
@SciRobotics · X

Researchers added a rotating wedge prism to enhance event camera texture perception, imitating the effect of #microsaccades in human vision. Learn more in Science #Robotics: https://t.co/QNqC2Vb3tB @umiacs @ZJU_China https://t.co/326krYKw3x

May 31, 2024 · 7 likes · 3 shares · 27,671 followers View post →
Research Radiance
@realmofresearch · X

Microsaccade-inspired Event Camera for Robotics: Neuromorphic vision sensors or event cameras have made the visual perception of extremely low reaction time possible, opening new avenues for high-... https://t.co/mDcc0nTYFG

May 31, 2024 · 53 followers View post →
Life Science Publications
@lsn_publication · X

Microsaccade-inspired event camera for robotics. #science #publication #research #publications https://t.co/U0gMnITslG

May 30, 2024 · 111 followers View post →
C Zhang
@ChongZitaZhang · X

Two recent papers from Nature and Science Robotics show that it's *good* (not just possible) to use event cameras/sensors for mobile robots: https://t.co/fhsc2GrXRD https://t.co/SQOtb6KoQV We need advanced perception for animal-level advanced sensorimotor skills.

May 29, 2024 · 5 likes · 5,466 followers View post →
Botao He
@BotaoUMD · X

May 29, 2024 · 11 followers View post →
Robotics Papers
@OWW · X

Microsaccade-inspired Event Camera for Robotics. https://t.co/rmMB5Yj2mf

May 29, 2024 · 1,591 followers View post →