New NTT service : Multilingual object recognition system.

Guidebooks, and even tour guides, could soon be a thing of the past for anyone visiting Japan as a new service will allow you to just point your phone at a building and get all the info you need.

Telecom giant Nippon Telegraph and Telephone has developed the multilingual guide system, which displays descriptions of objects framed on smartphone or tablet screens.

The system, which the company aims to introduce by the 2020 Tokyo Olympics in anticipation of a large influx of tourists, can also translate Japanese text shown on objects — such as signage and products in stores — into the user’s preferred language and display it in real-time.

When the system recognizes an object, it searches a cloud-based database for the corresponding object then displays a text description of it.

The system will enhance the tourist experience in a number of ways, allowing them to decipher train lines and stations on railway maps, the ingredients of unfamiliar dishes on menus, and descriptions on plaques at tourist spots, the company said.

For example, tourists wanting to know the background of Tokyo Skytree, the world’s tallest self-supporting communications tower, need only point a smart device at it and a description of the tower will be displayed. Similarly, those concerned about the ingredients of unfamiliar Japanese food for health or religious reasons can read a description of the dish via a smart device before placing their order.

NTT aims to make the system available at wide range of locations, including public facilities and convenience stores. The system is currently being tested in restaurants at Tokyo’s Haneda Airport, translating Japanese menus into Chinese.

According to NTT, the main advantage of the system lies in its low cost, thanks to its smaller database compared to other image-search technologies, which require massive amounts of stored image data.

The system’s lower storage requirement is due in part to its ability to try to match an object being viewed with one of 10 likely candidate images. To further determine the identity of the object, the system analyzes the overall setting and any text in the scene.

The system works even when viewing objects from angles, NTT said.

As Japan attracts increasing numbers of foreign tourists, providing them with information in their native language is a growing issue, especially in areas outside of major cities where signage and posters usually are in Japanese only.

According to Japan’s Tourism Agency, the number of foreign visitors who stayed in hotels or other lodgings totaled 70.8 million in 2016. The number who stayed outside of the major metropolitan areas of Tokyo, Osaka and Nagoya increased 13.2% from a year ago to 28.4 million.

Enjoy our free content ? Try our Legend services.

  • Star Level
  • Access to Grendz and the right to READ and SHARE our science techie green pins
  • The right to WRITE and SHARE your OWN science techie green pins
  • WEEKLY mind-blowing e-report with trends and news, never miss what is grendzing.
  • Customization Capability on which trends categories you want us to follow closer.
  • P2P Advice From our team and members
  • Our iOS or Android app for free
  • First to know about new trends and news
  • Weekly social media promotions (through Grendz social media presence) of your own pins (tech, science, green related) that may include: Your own service, products, PR or/and business related
  • Technology Procurement Grendz Researchers can search for specific technologies or innovations that matches your company business and give you contacts and information that will help you to aquire or implement those technologies (Limit to 3 procurement requests per month)
  • Team Members Company access to up to 3 members included in the company legend package.
  • No ads and no sales pitch
  • 24h Support (via e-mail)
  • Cancel anytime your renewal
The Plain Vanilla Level
Most Popular
$999One Time Fee/Forever Access
Give it a share: