Abstract: |
Optical Neural Networks (ONNs) have recently been explored for energy-efficient and high-throughput image processing and inference tasks, leveraging optical fully connected matrix-vector multiplication (MVM). However, current ONN architectures mainly rely on monochromatic light from digital images, making it challenging to classify real-world images with diverse colors. In this research, we introduce an ONN system that integrates with conventional display technology, utilizing a red, green, and blue (RGB) pixel array. In a proof-of-concept demonstration, we conducted 22 epochs of iterative training using a rank-4 kernel for standard convolution, allowing for accurate classification of color images from five different fruit categories. The ONN achieved 100% accuracy on the training dataset and maintained strong performance on modified test datasets, even with added noise. Our analysis demonstrated high operational efficiency, achieving over 94% classification accuracy per MAC operation while consuming less than 17 aJ of optical energy on average. This setup provided substantial throughput, reaching approximately 2.36 teraMAC/s. Additionally, we showcased depth-wise convolution using a rank-3 kernel, separating the system into R, G, and B channels. This architecture successfully classified complex patterns consisting of three MNIST handwritten digits encoded in RGB. Our approach represents a significant advancement in optical computing and neuromorphic vision, emphasizing the potential of optical convolution operations across multiple wavelength channels. |