Hong Kong faces a severe shortage of Sign Language Interpreters, with only 50 registered interpreters to reach a quarter million people with hearing disabilities. Due to the limitation, interpreters need to be booked months in advance, and may be inaccessible due to high fees for some. This leads to a feeling of social exclusion for the Deaf and Hard of Hearing, as their needs for accessibility go unmet in social scenarios in their daily lives. To tackle this problem, we are building a Sign Language Translation AI using computer vision and AI technology. This solution can help meet the urgent unmet demands for Sign Language Interpreters for non-essential scenarios (social events, religious gatherings etc) to optimize the current backlogged booking procedure. Our solution will allow communities to adopt more socially inclusive communication channels, and foster an accessible and fair society.