Targeting a Robotic Brain Capable of Thoughtful Communication

The Hagiwara Lab in the Department of Information and Computer Science of Keio University's Faculty of Science and Technology is trying to realize a robotic brain that can carry on a conversation, or in other words, a robotic brain that can understand images and words and can carry on thoughtful communication with humans.

"Even now, significant progress is being made with robots, and tremendous advancements are being made with the control parts. However, we feel like R&D with regards to the brain has been significantly delayed. When we think about what types of functions are necessary for the brain, the first thing that we as humans do is visual information processing. In other words, the brain needs to be able to process what is seen. The next thing is the language information processing that we as humans implement. By using language capabilities, humans are able to perform extremely advanced intellectual processing. However, even if a robotic brain can process what it sees and use words, it is still lacking one thing, specifically, feelings and emotions. Therefore, as a third pillar, we're conducting research on what is called Kansei Engineering, or affective information processing."

The Hagiwara Lab has adopted an approach of learning from the information processing of the human brain. The team is trying to construct a robotic brain while focusing on three elements: visual information processing, language information processing, and affective information processing, and an even more important point is integrating these three elements.

"With regards to visual information processing, by using a neural network as well, we're trying to recognize items through mechanisms based on experience and intuition in the same manner that is implemented directly by humans without having to use three-dimensional structures or perform complicated mathematical processing. In the conventional object recognition field, patterns from the recognized results are merely converted to symbols. However, by adding language processing to those recognized results, we can comprehensively utilize knowledge to get a better visual image. For example, even if an object is recognized as being a robot, knowledge such as the robot has a human form, or it has arms and legs can also be used. Next will be language information processing because processing of language functions is becoming extremely important. For example, even as a robot, the next step would be for it to recognize something as being cute, not cute, mechanical, or some other type of characteristic. Humans naturally have this type of emotional capability, but in current robotic research, that type of direction is not being researched much. Therefore, at our lab, we're conducting research in a direction that enables robots to understand what they see, to use language information processing to understand what they saw as knowledge, and to then comprehensively use the perspective of feelings and emotions like those of humans as well."

The robotic brain targeted by the Hagiwara Lab is one that is not merely just smart. Instead, the lab is targeting a robotic brain with emotions, feelings, and spirit that will enable it to interact skillfully with humans and other environments. To achieve this, the lab is conducting a broad range of research from the fundamentals of Kansei Engineering to applications thereof in fields such as entertainment, design, and healing.

"Most of the robots thus far move exactly as they are programmed to do. However, within the next 10 years, and perhaps even sooner, I believe that robots will be steadily introduced into the home. And when that happens, the interface with humans, which are the users, will be extremely important. For example, if you have a robot that can undergo a variety of movements rather than being a robot like this that doesn't move, and if amongst those various movements, there is movement that looks like fluctuation, then communication is occurring amongst that movement, or if the contact time with the robot becomes longer, then of course the robot will be able to understand even the user's feelings and personality, and it can then respond and act accordingly. We're trying to build a robot that is capable of that type of attentiveness."




Related Articles

Japanese Robot Movies -

Gymnast robot celebrates Tokyo’s successful 2020 Olympic bid with a triple backflip off the bar, and back onto the bar, industrial r

Riding, Demoing, and Dismounting Skeletonics -

Getting in/on, Demoing, and Getting out of a Team Skeletonics Exoskeletal Suit
in a pretty small room)

Over the weekend we visited a conceptual capital, a Mecca of sorts, of super-powered, executive-level Japanese geekdom: Maker Faire: Tokyo 2013.

We’ve been in love with Team Skeletonics’ human-powered exoskeleton for years, and all throughout, it's pretty much been the same mechanical and aesthetic configuration. But it now looks like they’ve been refining in the background, and might be bringing something new out to play.

• • •

Introduced way back in 2008, seven years after the Segway, Toyota's Winglet finally got to come out and play last week; practical trials are underway. Like the Segway (pretty much exactly), it’s a single rider, self-balancing mobility device. Toyota calls it a robot. Yeah... No.

Takara Tomy introduced their new entertainment robot series OMNIBOT, and they are going to release the first 2 robots - Hello!MiP and Hello!Zoomer - on June 21.

In this article, we would like to talk about Hello!MiP.

ATLAS Robot Unboxing - DARPA Robotics Challenge

Ohhh boy, an unboxing video that’s not just filler, but 500% justifiable.


Yaskawa Electric has developed an ankle assist walking device, to help people who've had a stroke to walk more easily, by encouraging a longer and more confident gait.

Reno J. Tibke - January 11, 2014

JTFF - Japanese Technology from the Future Friday! -

This week, well, they say dancing around screaming “I TOLD YOU SO!” isn’t very polite, but we will because SCHAFT Robotics' co-founder publicly declared J-startup culture moribund and is building his own investment fund, Nintendo pwned some patent trolls, and maybe, just maybe, SONY LIVES!

• • •

iDiots, by Big Lazy Robot -

Our personal telecommunications devices, our smartphones, have long been well beyond simple "phones." They're broadly applicable, technologically disruptive information and media vectors.

To celebrate the 30th anniversary of the Transformers film series, Takara Tomy is going to release fully posable Transformers Movie Advanced Series figures on May 17.

Transformers at AkihabaraNews

In 2015, you could become best friends with an amiable and attentive humanoid robot, like the relationship of Nobita and Doraemon (minus the Yojigen-poket)!