Real-time Vision-based Hand Gesture to Text Interpreter by Using Artificial Intelligence with Augmented Reality Element is a device that can interpret sign language to text in real-time. This communicator used a machine learning approach with a slight touch of deep learning elements, which are OpenCV, MediaPipe, and TensorFlow algorithms. Those algorithms have been used to differentiate the hand from other objects, detect the movement and coordinate of hands and perform imagery data analysis to produce output instantly in real-time. The camera will detect the user's hand movement, and the output will be produced on an LCD monitor. This project has been developed by using Python programming language. 13,000 of ASL's alphabets and 5,000 of ASL's number imagery datasets have been collected and trained by using cloud platforms which are Google Teachable Machine and Google Colab. The training process produced 99.85% of accuracy for the alphabets and 100% accuracy for the number. Finally, the constructed machine learning algorithm able to display alphabets and numbers on an LCD monitor by performing ASL's alphabet and number hand gesture in real-time. The performance of the prototype has been analyzed and experimented by two users at plain and noise background with different determined distances.
