Targeting a Robotic Brain Capable of Thoughtful Communication

The Hagiwara Lab in the Department of Information and Computer Science of Keio University's Faculty of Science and Technology is trying to realize a robotic brain that can carry on a conversation, or in other words, a robotic brain that can understand images and words and can carry on thoughtful communication with humans.

"Even now, significant progress is being made with robots, and tremendous advancements are being made with the control parts. However, we feel like R&D with regards to the brain has been significantly delayed. When we think about what types of functions are necessary for the brain, the first thing that we as humans do is visual information processing. In other words, the brain needs to be able to process what is seen. The next thing is the language information processing that we as humans implement. By using language capabilities, humans are able to perform extremely advanced intellectual processing. However, even if a robotic brain can process what it sees and use words, it is still lacking one thing, specifically, feelings and emotions. Therefore, as a third pillar, we're conducting research on what is called Kansei Engineering, or affective information processing."

The Hagiwara Lab has adopted an approach of learning from the information processing of the human brain. The team is trying to construct a robotic brain while focusing on three elements: visual information processing, language information processing, and affective information processing, and an even more important point is integrating these three elements.

"With regards to visual information processing, by using a neural network as well, we're trying to recognize items through mechanisms based on experience and intuition in the same manner that is implemented directly by humans without having to use three-dimensional structures or perform complicated mathematical processing. In the conventional object recognition field, patterns from the recognized results are merely converted to symbols. However, by adding language processing to those recognized results, we can comprehensively utilize knowledge to get a better visual image. For example, even if an object is recognized as being a robot, knowledge such as the robot has a human form, or it has arms and legs can also be used. Next will be language information processing because processing of language functions is becoming extremely important. For example, even as a robot, the next step would be for it to recognize something as being cute, not cute, mechanical, or some other type of characteristic. Humans naturally have this type of emotional capability, but in current robotic research, that type of direction is not being researched much. Therefore, at our lab, we're conducting research in a direction that enables robots to understand what they see, to use language information processing to understand what they saw as knowledge, and to then comprehensively use the perspective of feelings and emotions like those of humans as well."

The robotic brain targeted by the Hagiwara Lab is one that is not merely just smart. Instead, the lab is targeting a robotic brain with emotions, feelings, and spirit that will enable it to interact skillfully with humans and other environments. To achieve this, the lab is conducting a broad range of research from the fundamentals of Kansei Engineering to applications thereof in fields such as entertainment, design, and healing.

"Most of the robots thus far move exactly as they are programmed to do. However, within the next 10 years, and perhaps even sooner, I believe that robots will be steadily introduced into the home. And when that happens, the interface with humans, which are the users, will be extremely important. For example, if you have a robot that can undergo a variety of movements rather than being a robot like this that doesn't move, and if amongst those various movements, there is movement that looks like fluctuation, then communication is occurring amongst that movement, or if the contact time with the robot becomes longer, then of course the robot will be able to understand even the user's feelings and personality, and it can then respond and act accordingly. We're trying to build a robot that is capable of that type of attentiveness."




Related Articles


They once had little to do with actual robotics, but two product iterations and 15 years later, about to release their 3rd-generation kit, Lego is at the top of educational, DIY, and plain old fun robot building. MINDSTORMS EV3 is coming, and the robo-geekosphere is buzzing. And whirring.

• • •

Legos, Robots, and Education

Reno J. Tibke - June 07, 2014

JTFF - Japanese Technology from the Future Friday! -

This week it’s octopedal Japanese electronics conglomerate OMRON getting its

Headless Robot Chasing a Laser Pointer (is so dang cute) -
We hate to use the word ‘cute’ when discussing robotics, but… Come on now...just have a watch and tell us that ain’t the case. You can’t. Unless you’re mean, uptight, and cold, cold of heart.

Reno J. Tibke - June 22, 2014

SCENE IN TOKYO: Tokyo Toy Store -
Long before Michael Bay, and even before Hasbro's incarnation, Transformers were Takara Tomy's Microman and Diaclone, and Nintendo's Super Mario, long a global phenomenon, was first a game for Nintendo's Japan-only Famicom console.

Reno J. Tibke - August 30, 2014

Japanese Robots: Pepper Gallery!


Why Does Japan Get Dyson's New 360 Eye Robo-Vacuum First? -
The steadily plodding iterations of iRobot’s Roomba and its legion of copycats are old hat, and the collective We aren’t really impressed anymore. While the 360 Eye performs the same task, it stands out, and just kinda has that new robot smell. The talking points/broad strokes/things to know are:
Robots in 2014 -

Contributor Sean P. Bullock is a materials manufacturing professional, robotics nerd-enthusiast, citizen scholar, and manager of the unofficial DARPA Robotics Challenge Facebook page.

• • •

SCENE IN TOKYO: Robotic Helper Climbs Stairs in Shinjuku Station (Weekend Flashback)
While Japanese train stations have evolved considerably over the years, e.g., markedly fewer smoking areas and newspaper stands and a lot more ramps and elevators, there remain innumerable platforms and station services closed off to wheeled vehicles or those unable to negotiate stairs...

Just Saying
Yes, it matters that they're Korean!
...because, of course, is "Japan & Asia Tech • Cool and Cultural News." So, we saw this cool robot news, could hear in the accent that these researchers are actually from Korea, and boom: justification! (in fact, according to their MIT profiles, they both studied at Yonsei University in Seoul)

Murata Manufacturing recently unveiled a team of 10 robots called the Murata Cheerleaders, which dance in formation while balancing on top of balls.

The Murata Cheerleaders are Murata’s fourth generation of robots, following the bicycle-riding MURATA BOY in 1991, the second MURATA BOY in 2005, and the unicycle-riding MURATA GIRL in 2008. All of these robots incorporate Murata’s proprietary core technology.

Sharp Launching Robot Smartphone "RoBoHoN"
A robot-style smartphone "RoBoHoN" will be released in early 2016. It's invented by Sharp and a robot genius, Tomotaka Takahashi. In addition to provide basic smartphone features, RoBoHoN is able to talk, walk, dance, and recognize human faces. It can also become a projector.
Hello!MiP is a two-wheeled robot controlled with human hand gestures. You can control Hello!MiP just by using hand gestures without touching it - called Control Mode. There are other modes through which you can enjoy the robot as well, such as Dance Mode.