Targeting a Robotic Brain Capable of Thoughtful Communication

The Hagiwara Lab in the Department of Information and Computer Science of Keio University's Faculty of Science and Technology is trying to realize a robotic brain that can carry on a conversation, or in other words, a robotic brain that can understand images and words and can carry on thoughtful communication with humans.

"Even now, significant progress is being made with robots, and tremendous advancements are being made with the control parts. However, we feel like R&D with regards to the brain has been significantly delayed. When we think about what types of functions are necessary for the brain, the first thing that we as humans do is visual information processing. In other words, the brain needs to be able to process what is seen. The next thing is the language information processing that we as humans implement. By using language capabilities, humans are able to perform extremely advanced intellectual processing. However, even if a robotic brain can process what it sees and use words, it is still lacking one thing, specifically, feelings and emotions. Therefore, as a third pillar, we're conducting research on what is called Kansei Engineering, or affective information processing."

The Hagiwara Lab has adopted an approach of learning from the information processing of the human brain. The team is trying to construct a robotic brain while focusing on three elements: visual information processing, language information processing, and affective information processing, and an even more important point is integrating these three elements.

"With regards to visual information processing, by using a neural network as well, we're trying to recognize items through mechanisms based on experience and intuition in the same manner that is implemented directly by humans without having to use three-dimensional structures or perform complicated mathematical processing. In the conventional object recognition field, patterns from the recognized results are merely converted to symbols. However, by adding language processing to those recognized results, we can comprehensively utilize knowledge to get a better visual image. For example, even if an object is recognized as being a robot, knowledge such as the robot has a human form, or it has arms and legs can also be used. Next will be language information processing because processing of language functions is becoming extremely important. For example, even as a robot, the next step would be for it to recognize something as being cute, not cute, mechanical, or some other type of characteristic. Humans naturally have this type of emotional capability, but in current robotic research, that type of direction is not being researched much. Therefore, at our lab, we're conducting research in a direction that enables robots to understand what they see, to use language information processing to understand what they saw as knowledge, and to then comprehensively use the perspective of feelings and emotions like those of humans as well."

The robotic brain targeted by the Hagiwara Lab is one that is not merely just smart. Instead, the lab is targeting a robotic brain with emotions, feelings, and spirit that will enable it to interact skillfully with humans and other environments. To achieve this, the lab is conducting a broad range of research from the fundamentals of Kansei Engineering to applications thereof in fields such as entertainment, design, and healing.

"Most of the robots thus far move exactly as they are programmed to do. However, within the next 10 years, and perhaps even sooner, I believe that robots will be steadily introduced into the home. And when that happens, the interface with humans, which are the users, will be extremely important. For example, if you have a robot that can undergo a variety of movements rather than being a robot like this that doesn't move, and if amongst those various movements, there is movement that looks like fluctuation, then communication is occurring amongst that movement, or if the contact time with the robot becomes longer, then of course the robot will be able to understand even the user's feelings and personality, and it can then respond and act accordingly. We're trying to build a robot that is capable of that type of attentiveness."




Related Articles

JAPANESE ROBOTS: Should Japan Ban Robot Romance?
Emotionally capable machines and/or software are coming soon, but large numbers of young Japanese people developing romantic relationships with them would only compound a persistent and arguably unstoppable demographic emergency.

Bandai today announced the release of a super alloy robot "Cho-gokin! Cho-gattai! SF Robot Fujiko F. Fujio Characters".

If you are a real Fujiko F. Fujio fan, you must have got an intense craving for it!

It comes with 6 small robots of the most popular characters created by Fujiko F. Fujio. By putting all the 6 robots together, you can make a 22cm tall robot.

6 characters:

Yoriko Takahashi - April 16, 2014

While there are a great deal of fancy cleaning robots such as Roomba available in the market, CCP is going to start selling another casual, reasonable cleaning robot - Mofa -  in mid-May.

Speaking about CCP, they released the cute and fluffy reasonable microfiber robotic mop ball called MOCORO last year.

Honda Walk Assist, which supports gait rehabilitation, will be released for customers on a leasing basis in November. The device has been in development since 1999 and it has taken almost 17 years since the project's launch to become a viable product with practical use. - Honda Motor Europe - ASIMO was promoting science in Slovakia

ASIMO is back again.  He has traveled to Bratislava, Slovakia to attend European Researchers' Night to help give inspiration to the country's next generation of scientists and engineers.

Daft Punk Action Figures - From Japan, of Course -

Postmodern French TechnoFunk Action Figures? 
Okay, so musicians often have likenesses of themselves created and marketed, but they aren't generally what would be be considered "action figures," i.e., posable, articulable, and in this case thoroughly high-quality mini-facsimiles. No, see - Daft Punk hold a special place in the global pop-cultural consciousness. 

iREX 2013 Primer -
The Japan Robot Association (JARA) and Nikkan Kogyo Shimbun are gearing up to host the 20th bi-ennial iREX International Robot Exhibition here in Tokyo. This is Japan’s Big Show, and naturally, AkihabaraNews is going to be all over it - here’s a bit of what to expect:
Baxter Coming to Japan -

Attention Kawada, Yaskawa, Nachi, Fanuc - Your American Nemesis is Coming!

Japanese Technology from the Future SATURDAY but was Supposed to Be Friday!

This week it’s Japan thinking about investing a bunch of cash and tech into cancer treatment in India, which is nice, NTT Data Canada has significantly upped some jobs predictions in Nova Scotia, and even we're saying "NTT Data Canada?", and SCHAFT Robotics has left the DARPA building, which is kind of a bummer, but intriguing. 

• • •

Sharp even added a "MOE" feature to this vacuum cleaner.  

From Sharp's home cleaning robot series, COCOROBO, a premium model called COCOROBO Imouto Ver. RX-CLV1-P will be out for sale for a limited time. Imouto means younger sister in Japanese.


Sharp has developed a health care support chair which combines a range of sensors for checking the user's health. It can simultaneously record your blood pressure, temperature, body motion, and pulse waveform, storing the data in the cloud.

Terrie's Take: Skymark Airlines: Death by Obstinance, Japan's New Robot Hotel, and More!
Terrie’s Take is a selection of Japan-centric news collected and collated by long-time resident and media business professional Terrie Lloyd. AkihabaraNews is pleased to present Terrie’s learned perspective; we all could use another take on the news - here’s Terrie’s: