image: Conceptual diagram of complex amplitude modulated holographic data storage view more
Credit: OEA
A new publication from Opto-Electronic Advances, 10.29026/oea.2023.220157 discusses lensless complex amplitude demodulation based on deep learning in holographic data storage.
In the era of big data, global data volume is growing exponentially. The development of numerous technologies depends on massive data and also generates massive data. Data mining, storage, and protection are becoming increasingly important. The development of traditional data storage technology can no longer keep up with the speed of data generation, and new high-density, long-lasting, and low-cost storage methods need to be developed. Traditional data storage technology basically stores one-dimensional data on a two-dimensional surface. To break through the limitations of existing technologies, we need to think from storage dimension increasing. Holographic data storage seems to be a feasible solution. It uses interference between information light encoding patterns and reference light encoding patterns to record holograms in the medium. When reading, only the reference beam is used to diffract the information light pattern from the hologram. Holographic data storage technology has the characteristics of three-dimensional volume storage and two-dimensional data transmission, which enables higher storage density and faster data transmission speed, making it a powerful competitor for the next generation of storage technology. In fact, holographic data storage technology has been proposed for 60 years, but it has not yet been practically applied. One of the reasons is that traditional holographic data storage uses only amplitude modulation, which does not correspond to the theoretical intention of holography, and the actual storage density achieved is far from the theoretical value. To fully exploit the advantages of holographic data storage, complex amplitude modulation must be used for recording and reading. However, the technical bottleneck lies in phase reading, as the phase cannot be directly obtained by detectors. The problem with using interference to read the phase is that the system is unstable and not conducive to practicality, while traditional non-interference methods often require iterative calculations, which reduce data transmission speed. This article proposes to use the intensity image of near-field diffraction to simultaneously and non-iteratively read amplitude and phase information accurately without interference, solving the key technical bottleneck of holographic data storage complex amplitude modulation. The core of this model lies in using an end-to-end convolutional neural network to extract high-frequency and low-frequency image features from near-field diffraction patterns, corresponding to modulation of phase and amplitude encoding. Based on the training of the neural network, a network with generalization ability is established to accurately predict new complex amplitude encoding information. Essentially, deep learning accumulates enough redundant feature information in the time dimension to compensate for the dimensional loss problem caused by the inability to detect phase in space. There is a good point of integration between deep learning and holographic data storage. Unlike other imaging applications, because the encoding of holographic data storage is controllable, this encoding prior can be used to consciously modulate the encoding rules, producing more differentiated data samples and making deep learning more efficient.
The research group of Prof. Xiaodi Tan from Fujian Normal University proposed a deep learning-based near-field diffraction decoding system, which can accurately read both amplitude and phase information in a non-interferometric, non-iterative and fast way, thus solving the key technical bottleneck of complex amplitude modulation in holographic data storage. The success of combining deep learning with holographic data storage depends on three key points. One of the key points is the lensless near-field diffraction intensity detection. The lensless system and the choice of near-field distance are both to ensure that the light field has certain diffraction effects, so that the phase changes can be transmitted to the intensity distribution through diffraction, while the amplitude features are still preserved. In simulation and experiments, this correspondence exists within a certain range, and the specific diffraction distance depends on factors such as the spatial frequency and complexity of the input encoding. For example, if the encoding has a high spatial frequency, the diffraction effect is stronger, and the near-field diffraction distance should be shorter. The second key point is to find the feature differences between amplitude and phase. Since both amplitude and phase are learned from the near-field diffraction intensity map, there must be distinguishable points to prevent confusion between them. We found that the feature that determines the amplitude learning network is the intensity distribution of the low-frequency part, while the feature that determines the phase learning network is the phase difference pattern of the high-frequency part. This enables the same near-field diffraction intensity map to reconstruct amplitude and phase separately without interference. The third key point is unequal interval encoding. Usually, uniform encoding has a larger encoding interval, which can reduce the encoding reconstruction interference, but in this method, the phase difference combination generated by the uniform interval encoding is completely the same, and deep learning cannot distinguish the corresponding diffraction features. Therefore, non-uniform encoding can greatly improve the diversity of samples, so that the deep learning network can accurately identify complex amplitude encoding.
This work not only has applications in the field of holographic data storage, but also has an impact on other fields of computational imaging based on deep learning. The unclear physical meaning of the "black box" of deep learning limits its application. In the field of holographic data storage, the encoding can be freely designed, providing research targets with prior knowledge. Therefore, by establishing an evaluation mechanism for deep learning complex amplitude encoding and decoding, analyzing the relationship between different encoding conditions and the efficiency of deep learning decoding, it is possible to determine which encoding rules are more suitable for deep learning decoding, formulate optimization strategies for complex amplitude encoding in holographic data storage, and iteratively optimize between encoding and decoding based on this strategy. This can give structured physical functions to the parameters of the deep neural network structure and lay a foundation for opening up the "black box" of deep learning.
# # # # # #
The Information Photonics Research Center of Fujian Normal University was established in the summer of 2018. Its research purpose is to achieve spatiotemporal transformation of information using photonics methods. The research center currently has 10 full-time teachers, 4 part-time teachers, and over 40 doctoral and postgraduate students. The main research directions of the research center are holographic optical storage, polarized holography, holographic materials, information display technology, and so on. Among them, the coaxial holographic storage technology studied can overcome the inevitable problems of short lifespan and high energy consumption of current mainstream magnetic recording technology and can meet the urgent need for ultra-long-term storage of massive data in the era of big data. Since its establishment, the Research Center has undertaken multiple projects such as national key research and development plan projects and key projects of the National Natural Science Foundation, with a research funding of nearly 50 million yuan. More than 200 academic and conference papers have been published in high-level journals at home and abroad. The Research Center attaches importance to cooperation with domestic and foreign research institutions. Good cooperative relationships have been established with the Institute of Optoelectronics, CAS, Beijing University of Technology, Shanghai University of Technology, etc., as well as with the University of Tokyo, Osaka University, Wakayama University, Utsunomiya University, Kobe University, Arizona Optical Center, etc. in Japan and abroad. The goal of the Research Center is to place China in the international advanced ranks in the field of holographic optical storage technology and information display, actively achieve the commanding heights of intellectual property rights and standards for optical storage and information display, promote industrial development, and cultivate international talents in the field of information optics.
# # # # # #
Opto-Electronic Advances (OEA) is a high-impact, open access, peer reviewed monthly SCI journal with an impact factor of 8.933 (Journal Citation Reports for IF2021). Since its launch in March 2018, OEA has been indexed in SCI, EI, DOAJ, Scopus, CA and ICI databases over the time and expanded its Editorial Board to 36 members from 17 countries and regions (average h-index 49).
The journal is published by The Institute of Optics and Electronics, Chinese Academy of Sciences, aiming at providing a platform for researchers, academicians, professionals, practitioners, and students to impart and share knowledge in the form of high quality empirical and theoretical research papers covering the topics of optics, photonics and optoelectronics.
# # # # # #
More information: http://www.oejournal.org/oea
Editorial Board: http://www.oejournal.org/oea/editorialboard/list
All issues available in the online archive (http://www.oejournal.org/oea/archive).
Submissions to OEA may be made using ScholarOne (https://mc03.manuscriptcentral.com/oea).
ISSN: 2096-4579
CN: 51-1781/TN
Contact Us: oea@ioe.ac.cn
Twitter: @OptoElectronAdv (https://twitter.com/OptoElectronAdv?lang=en)
WeChat: OE_Journal
# # # # # #
Hao JY, Lin X, Lin YK, Chen MY, Chen RX et al. Lensless complex amplitude demodulation based on deep learning in holographic data storage. Opto-Electron Adv 6, 220157 (2023). doi: 10.29026/oea.2023.220157
# # # # # #