Signal processing technology to extract required information from image, sound, and biometric signals

At Keio University, the Mitsukura Laboratory, in the Department of System Design Engineering, researches how to extract required information from biometric , image, audio signal data. To achieve this, the researchers utilize technologies such as signal processing, machine learning, pattern recognition, artificial intelligence, and statistical processing.

"Our research has three research projects : image processing, audio signal processing, and biometric signal processing. In image processing, we're researching how to embed and extract motion. In audio signal processing, we construct the systems which divide into the scores automatically. And in biometric signal processing, we determine the meaning of brain waves(EEG) and convert thoughts to text."

In image signal processing research, the Mitsukura Lab works on position matching between real and virtual space, which is the basis for AR technology. These researchers are developing a method for estimating the orientation of a face at high speed with high precision, to link the motion of an actual person with an animation. Another research topic at the Mitsukura Lab is expression recognition, using information about changes in the eyebrows and corners of the mouth. The Lab is also researching how to overlay virtual data used in head-mount displays in the real world.

In audio signal processing research, we studied the ability to automatically determine which direction a sound is coming from, by using multiple mike signals. The researchers are developing a system to automatically direct the mike toward the person talking in a videoconference, and a robot to track a talking person. The Lab is also working to develop a system for inputting information by whistling.

In research on biometric signal processing, the Lab is developing a system to operate computers and devices by reading brain waves(EEG) and EOGs.

In brain-wave(EEG) signal processing, the Lab is doing a wide range of R&D. One research project is a system to determine the user's likes / dislikes and convert them to text form. Another research project is to evaluate sound quality from brain waves(EEG).

Signal processing technology using EOGs, obtained around the eyes, is being utilized in R&D on steering a wheelchair by winking.

Signal processing technology is expected to have a diverse range of applications, including healthcare, entertainment, and wearable devices.

In the Mitsukura Lab, the researchers are using the many algorithms they've developed so far to advance such R&D further, in ways that contribute to society.

"At the present stage, for example, it's said that Google Glass will become very popular, but with that, you have to wear glasses. Wearing glasses itself is unnatural for people. The same is true for brain-wave(EEG) systems; if something's unnatural, people won't do it for long. The first thing we have to do is create a system that can read brain waves(EEG) in a natural manner. Next, in conjunction with that, we need a system that can communicate emotions between people, in a way that resembles using the telephone to communicate thoughts. I think we might be able to communicate emotions even without a telephone."





Related Articles

At Keio University, the Takahashi Laboratory, in the Department of System Design Engineering (Faculty of Science and Technology) is doing research to develop products and systems that are useful to society, through an approach called model-based control.


This is an interactive optic fiber cloth. It is made of side-emitting diffusive optic fibers so computer controlled light patterns can be displayed on it, and by attaching light receivers as well as light emitters, optical signals can be input using infrared light.

"Originally, we came across the light-emitting fabric, where light is emitted from the optical fiber surface. Conversely, we thought it could be used to input data by receiving light through the surface. So, we've created this kind of interface."

Together with Dr. Cisotto, Associate Professor Ushiba, in the Department of Biosciences and Informatics, is working to reveal the mechanism by which newly acquired knowledge and information is transmitted and evolves among organisms with intelligence.
At Keio University, the Imai Laboratory, in the Department of Information and Computer Science (Faculty of Science and Technology), is doing three research projects to make communication easier.

At the Morita Lab in the Department of Mechanical Engineering of the Keio University Faculty of Science, researchers are advancing with research and development of unique robots from the perspective of mechanisms, control, skill, and an integration of each of these areas.

The Hagiwara Lab in the Department of Information and Computer Science of Keio University's Faculty of Science and Technology is trying to realize a robotic brain that can carry on a conversation, or in other words, a robotic brain that can understand images and words and can carry on thoughtful communication with humans.

At Keio University, the Sugiura Laboratory, in the Department of Mechanical Engineering (Faculty of Science and Technology) is investigating various phenomena through analysis and experiment. These phenomena involve coupling between electromagnetics and mechanical dynamics, as well as nonlinear dynamics. Currently, the researchers are focusing on three topics. The first is nonlinear oscillations in superconductive magnetic suspension systems. In such systems, objects are levitated, so energy loss due to friction is very low.

At Keio University, the Ishigami Laboratory, in the Faculty of Science and Technology, Department of Mechanical Engineering, is investigating robotic mobility systems. The main mission of this group is to perform fundamental and applied research for application to extreme environments, notably lunar and planetary rovers.

"In our lab, we focus on field robotics that works for extreme environments."

The Ikaga Research Laboratory of Keio University’s System Design Engineering Department conducts research on the core issue of sustainability in terms of both architecture and urban planning. The group examines how this informs both the design of domestic environments to actively promote health, and urban environments conducive to a low-carbon approach. Currently the lab is focusing on three main themes: health, intellectual productivity, and low-carbon.

In the Department of Applied Chemistry at Keio University's Faculty of Science and Technology, the Katayama Laboratory is doing research in the field of electrochemistry.

One aspect of the Lab's research is investigating electrochemical reactions in electrolytes called ionic liquids, and applying them to technologies, including new batteries and electroplating.

The Takao Laboratory of Keio University’s Faculty of Science and Technology Department of Applied Chemistry is engaged in the research and development of artificially creating various organic compounds extracted from natural sources.

The keyword in the Tetsuya Suzuki Laboratory of the Department of Mechanical Engineering at Keio University is ''nanomaterials''. The researchers in the Suzuki Lab are working to develop high-performance thin-film materials and to analyze such materials at the atomic level. In particular, Diamond-like Carbon, or DLC for short, is the main target. The researchers improve the DLC films and apply them in a variety of fields.

Suzuki & Citterio Laboratory designs and synthesizes functional dyes that change color or produce light by reacting with a specific substance. It develops nano-sized functional materials such as particles and polymers, and develops sensing technology that utilizes fluorescent and luminescent molecules, providing imaging inside the body which had been impossible until now.
As part of a project to commemorate the 75th anniversary of Keio University’s Faculty of Science and Technology, the University has started an innovative research project involving the industrial, government, and academic sectors. This project is called the Keio Innovation Foundry, or KIF.
The Keio University Smart Network Research Center, which is led by Professor Naoaki Yamanaka in the Department of Information and Computer Science, is researching smart infrastructure using IT, in particular smart grids and next-generation power control networks.