Ubitus, a leading cloud streaming provider, was selected on October 10, 2024, for Japan’s Ministry of Economy, Trade, and Industry (METI) and New Energy and Industrial Technology Development Organization (NEDO) GENIAC Program. This initiative focuses on advancing “Post-5G Information and Communication System Infrastructure R&D,” where Ubitus will develop a 405B AI large language model (LLM) optimized for tourism and cultural content, made open source.
The six-month project will utilize 256 NVIDIA H100 GPUs for training, targeting three major East Asian languages—Chinese, Japanese, and Korean. Ubitus’ model, based on Llama 3.1, will use 200 billion words for pre-training and focus on tourism-related applications such as multilingual Q&A, real-time recommendations, cultural insights, and translation services, powered by Retrieval-Augmented Generation (RAG) technology.
Ubitus will collaborate with Deepreneur on data collection, with Deepreneur managing Japanese data and Ubitus focusing on Traditional Chinese and Korean. The LLM will be integrated into local government, transportation, and tourism-related services to enhance interactions between travelers and local communities.
As part of a broader open-source initiative, Ubitus will release the 405B LLM for developers worldwide, providing a cost-effective alternative to mainstream models like GPT-4. This open access is expected to drive innovation in industries like customer service, education, and healthcare.
Wesley Kuo, CEO of Ubitus, expressed excitement about the project, stating, “This initiative highlights our commitment to leading AI innovation in East Asia. Our model aims to transform tourism and other sectors reliant on language and cultural understanding.”
The grant underscores Ubitus’ role as a leader in cloud technology and AI, furthering its mission to deliver innovative AI solutions across various industries.
Source Link
