A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina

Zhenghao Long; Xiao Qiu; Chak Lam Jonathan Chan; Zhibo Sun; Zhengnan Yuan; Swapnadeep Poddar; Yuting Zhang; Yucheng Ding; Leilei Gu; Yu Zhou; Wenying Tang; Abhishek Kumar Srivastava; Cunjiang Yu; Xuming Zou; Guozhen Shen; Zhiyong Fan

doi:10.1038/s41467-023-37581-y

A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina

Nat Commun. 2023 Apr 8;14(1):1972. doi: 10.1038/s41467-023-37581-y.

Authors

Zhenghao Long^{1

2

3}, Xiao Qiu^{1

2

3}, Chak Lam Jonathan Chan¹, Zhibo Sun^{1

2}, Zhengnan Yuan^{1

2}, Swapnadeep Poddar^{1

2

3}, Yuting Zhang¹, Yucheng Ding^{1

2

3}, Leilei Gu⁴, Yu Zhou^{1

2

3}, Wenying Tang¹, Abhishek Kumar Srivastava^{1

2}, Cunjiang Yu⁵, Xuming Zou⁶, Guozhen Shen⁷, Zhiyong Fan^{8

9

10

11}

Affiliations

¹ Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong SAR, China.
² State Key Laboratory of Advanced Displays and Optoelectronics Technologies, HKUST, Clear Water Bay, Kowloon, Hong Kong SAR, China.
³ Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, HKUST, Clear Water Bay, Kowloon, Hong Kong SAR, China.
⁴ Qingyuan Research Institute, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, No. 800 Dongchuan Road, 200240, Shanghai, China.
⁵ Department of Engineering Science and Mechanics, Department of Biomedical Engineering, Department of Materials Science and Engineering, Materials Research Institute, Pennsylvania State University, University Park, PA, 16802, USA.
⁶ Key Laboratory for Micro/Nano Optoelectronic Devices of Ministry of Education & Hunan Provincial Key Laboratory of Low-Dimensional Structural Physics and Devices, School of Physics and Electronics, Hunan University, Changsha, 410082, China.
⁷ School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing, 100081, China.
⁸ Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong SAR, China. eezfan@ust.hk.
⁹ State Key Laboratory of Advanced Displays and Optoelectronics Technologies, HKUST, Clear Water Bay, Kowloon, Hong Kong SAR, China. eezfan@ust.hk.
¹⁰ Guangdong-Hong Kong-Macao Joint Laboratory for Intelligent Micro-Nano Optoelectronic Technology, HKUST, Clear Water Bay, Kowloon, Hong Kong SAR, China. eezfan@ust.hk.
¹¹ Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong SAR, China. eezfan@ust.hk.

Abstract

Spherical geometry, adaptive optics, and highly dense network of neurons bridging the eye with the visual cortex, are the primary features of human eyes which enable wide field-of-view (FoV), low aberration, excellent adaptivity, and preprocessing of perceived visual information. Therefore, fabricating spherical artificial eyes has garnered enormous scientific interest. However, fusing color vision, in-device preprocessing and optical adaptivity into spherical artificial eyes has always been a tremendous challenge. Herein, we demonstrate a bionic eye comprising tunable liquid crystal optics, and a hemispherical neuromorphic retina with filter-free color vision, enabled by wavelength dependent bidirectional synaptic photo-response in a metal-oxide nanotube/perovskite nanowire hybrid structure. Moreover, by tuning the color selectivity with bias, the device can reconstruct full color images. This work demonstrates a unique approach to address the color vision and optical adaptivity issues associated with artificial eyes that can bring them to a new level approaching their biological counterparts.

Publication types

Research Support, Non-U.S. Gov't

MeSH terms

Color Vision*
Humans
Nanowires*
Oxides
Retina / physiology
Visual Prosthesis*

Substances

perovskite
Oxides