The advancement of the information society brings forth an era of augmented stress due to an increase in information and complexity of communication, leading to various social problems such as a rise in the number of employees taking leaves of absence due to mental illnesses. Although efforts to reduce stress in the past have included work style reforms, more attention is now given to measure and address internal stress factors through therapeutic techniques such as mindfulness. IN response, NeU has developed a “Stress Manager” smartphone app that aims to reduce stress and improve stress tolerance by applying brain science knowledge and sensor technology to measure real-time brain activity in any everyday environment.
Mindfulness is the psychological process of “calming one’s mental state of mind”, which is achieved by focusing one’s conscious awareness on the present moment. Studies have confirmed that mindfulness has positive effects on an individual’s mental state such as stress reductions; and in brain science, calming of the mind is thought to be associated with the relatively reduced activity in the default mode network (DMN), a brain network implicated in self-related thinking and mind wandering. By attaching NeU’s ultra-compact brain sensor (XB-01) to the center of the forehead, together with a dedicated app that supports meditation while monitoring DMN activity levels in real-time, individuals are able to learn, practice and master meditation techniques to help reduce stress.
For this solution, the required equipment is NeU’s ultra-compact brain sensor (XB-01) and a dedicated app which is compatible with Android OS and iOS. During breathing meditation, to measure the degree of calming in the DMN, the sensor is mounted at the center of the forehead, slightly above the eyebrows and is monitored in real-time by pairing the device with a smartphone.
Breathing meditation is a technique commonly practiced in mindfulness, and by focusing on breathing alone, influences such as surrounding stimuli and distractions can be blocked-out and the brain can relax. In this app, by monitoring the DMN activity levels with a brain sensor and performing breathing meditation, individuals can check their degree of calmness in real-time for a more effective meditation. During meditation, the change in DMN activity is analyzed in three ways: rise, constant and decline; and are displayed in both color and sound. At the end of the meditation, the degree of calmness of both the DMN and heart rate are indexed numerically and displayed together with applicable comments. By continuing this meditation technique, individuals can expect a reduction in stress, an increase in concentration, newfound motivation for creative thinking and even develop compassion for others.
Under stressful conditions, individuals may have increased heart rates or their minds may go “blank”, but their physiological activities are usually considered to be difficult to control by their own will. However, if the heart rate and brain activity is monitored with sensors, and with some practice, individuals will be able to perform “biofeedback training”. Moreover, according to research done at Tohoku University, continuous “biofeedback training” can reduce overall stress response and improve stress tolerance. This is not only a powerful method to help cope with stress, but also to reduce subjective stress and reduce stress hormones.
In this app, the same ultra-compact brain sensor (XB-01) which is used to measure DMN will now be attached to the left side of the forehead (left dorsolateral prefrontal cortex), so that training to raise or lower the heartbeat or brain activity by oneself can be performed. During training, for example, controlling flying objects on the screen to get them to move up or down with the mind can be done through the brain sensor. In practice mode, examples of images that raises or lowers brain activity will be displayed as “control tips”; however, in the actual training mode, individuals can perform the training in their own preferred manner.
NeU believes that practicing the two methods mentioned above will lead to a significant reduction in stress and improve stress tolerance, but in order to make this a habit and to perform the training continuously, a “self-check” section to show any changes in the individual’s state of mind, and a “lessons” section have also been added to the app so that aspects of theory and skill can be incorporated into the “mindful” experience. The following figure shows the overall concept and screen examples:
This app is supervised by Dr. Ryuta KAWASHIMA, NeU’s CTO and the Director of Tohoku University’s Institute of Development, Aging and Cancer (IDAC), together with Dr. Taishu KAWANO, renowned monk and psychiatrist.
*Please note: above screenshots and contents are subject to change.
NeU in collaboration with FOVE (who developed the world’s first home-use VR eye tracking head mounted display), have developed an integrated device enabling simultaneous measurement of brain activity and eye gaze information. With a simple system consisting of only a PC and a head mounted display, we have achieved high-precision gaze information and collective brain activity measurements. Pictured below is “FOVE 0”, the world’s first VR eye-tracking head mount display for household use:
NeU has been developing neuro-marketing services centered on cerebral blood flow measurements and have achieved verifiable results from more than 50 companies. At NeU, we measure the brain’s blood flow strength in the prefrontal cortex that controls empathy and working memory, and together with expertise in evaluating an individual’s interest in advertisements and products, led to the development of NeU-VR.
NeU-VR provides services from eye-tracking VR re-generators, dedicated head-mounted displays integrated with NIRS brain activity measurement sensors covering the prefrontal cortex of the brain, and specialized PC applications. Simultaneous measurement of brain activity, heart rate and various gaze information (such as viewpoint coordinates, blinking and pupil diameter) during an individual’s VR experience is now possible.
It is also known that individual preferences and degree of concentration can be inferred from biometric indicators such as gaze and pupil diameter. By combining these multiple bioindicators, we believe that we can objectively visualize a user’s interest during their VR experience. Pictured below is a VR head-mounted display that integrates brain measurement and eye-tracking sensors:
NeU-VR is a flexible system that can be used across-industries such as designing facilities and houses, showrooms, automobiles and so forth. Design confirmation during a trial production or a mock-up model can reduce production cost and time while increasing efficiency. By visualizing and numerically expressing the intuitive reactions of individuals during the initial stages of a project can provide vital data in the long-run. Moreover, evaluating VR contents is not only valuable in the entertainment industry, but is also becoming an important tool in the manufacturing process where analyzing brain activity and gaze information of VR users, and then clarifying their interests and concentration areas are valuable. Lastly, NeU-VR is a service that can further enhance the current role of the virtual reality realm, such as in market research where we can provide consistent feedback on research design, data acquisition and analysis.
*This product is not meant for medical use.
The need to acquire information on purchasing and consuming activities of individuals to provide better and improved products and services is on the rise each year. Traditionally, subjective assessment of individuals were done through questionnaires, interviews and so forth, and video recording of individual observations were also conducted, but in addition to problems with objective results from subjective assessments, video analysis could not be done at the same time, resulting to prolonged analysis and the inability for real-time analysis. Therefore, to solve these issues, NeU and NSD jointly developed a smartphone based application that incorporates all aspects of consumer behavior into the NeU-VIS technology.
1. AI technology (NSD)
Using AI technology, videos from an eye-glass type camera are analyzed in real-time together with data conversion on the smartphone (connected via USB), resulting in real-time language processing of recognized objects for practical marketing service.
2. Brain measurement technology and brain science knowledge (NeU)
By analyzing the time series signal obtained from the portable brain activity measurement device in real-time, it is now possible to use this technology to estimate whether the individual had an interested in a certain product or service based on the level of brain activity.
NeU-VIS consists of an eye-glasses type camera (by Infinitegra Co., Ltd.), a brain activity measurement device (NeU’s HOT-000), and an app dedicated to smartphones. On smartphones, video data is sent in real-time from the eye-glass type camera via a USB. At the same time, brain activity data is analyzed on the smartphone app, and the brain activity level and linguistic viewing information are displayed on the smartphone concurrently. Then, the analyzed data is stored in the smartphone, greatly reducing time and labor to perform data analysis. Furthermore, the information recorded on the smartphone can be transmitted via Wi-Fi connection in real time to any PC.
NeU-VIS is suitable for a wide range of target investigations for example: in terms of the distribution industry, our system can be used in the design of shops, store shelves, various showrooms, and so forth. In terms of manufacturing, NeU-VIS can be used in the design evaluation of cars and its user interfaces. Moreover, it can also be suitable for corporate customers who are seeking a more intuitive consumer reaction and response.
*This product is not meant for medical use.
The advertiser requests to understand the target audience better, and to use the responses for better product marketing and branding.
Demographic selection of an audience pool based on product target factors. Please note: the number of participants will depend on the content of the survey and plan of action.
Selected participants with be requested to gather at NeU’s laboratory in Tokyo, where a brain measurement device (HOT-1000) will be placed on each participant’s forehead while they watch a predetermined TV commercial. Concurrently, brain measurement data will be accumulated into the cloud server.
NeU’s highly-trained professional staff will utilize the multivariate AI “ExBrain Analyzer” which is specialized for biometric data analysis (such as eliminating body motion noise during the observation process and to reduce the influence of skin blood flow component) and other aspects that are relevant for the accuracy of the measurement data.
Beginning with the experiment’s purposes, NeU will summarize the hypotheses, experiment designs and analyze the results into a comprehensive report. The overall report, in addition to the standard questionnaire analysis, will include the types of reactions and impressions from the participants’ brain activities. The comprehensive report will then be delivered securely and confidentially.
Based on the findings of the comprehensive report, NeU will hold a debriefing about all the contents of the report, giving the client (advertiser) valuable insight from the aspect of brain science to make sound decisions and to formulate the next plan of action for an effective advertising campaign.
To verify that smartphone commercials are a more effective advertisement tool than conventional TV commercials (implementation period dates to October 2017).
Men in their 30s to 50s with a keen interest in automobiles and with a household annual income of more than Y10 million Yen (around $100,000 USD/year). A total of 44 participants with this criteria were selected.
1) A viewer watches a recorded TV show including a commercial beforehand at home.
2) Afterwards, the viewer visits the measurement site at a later date and is placed into groups (hereinafter referred to as “TV groups”) that watch commercials during a TV program. Another set of groups watch the same commercials on a smartphone (hereinafter referred to as “smartphones groups”). Both the groups’ brain activities related to “interest and empathy” and “memory” will be observed.
3) TV viewing of the “TV group” will watch a specific commercial in an environment similar to that of their home. On the other hand, the “smartphone group” participants will be allowed to browse any site, during which they will watch a commercial from “CMerTV Perfect View™ Network”.
In sum, the results seem to show that brain activity is much higher for smartphones viewers who watch a commercial while actively browsing through different sites and reading through articles and so forth.
Compared with watching TV, smartphone viewing showed higher brain activity, especially when comparing the impressions of the same commercial for smartphone and TV (CM 2). Here, a noticeable difference in brain activity was seen; please refer to Figure 1.
In this area of analysis, results were comparable with those when watching TV and viewing a smartphone. When comparing the same commercial for smartphones and TV (CM 2), difference in brain activity was seen; please refer to Figure 2.
*Please note:
A. CM 1 to CM 6 are videos commercial that are shown while watching TV. The commercials shown by CM 2 and on a smartphone are similar.
B. The label [smartphone] is the average. The difference was also confirmed when compared with the data at the time of the first viewing.
The target audience consisted of men and women in their 20s to 30s who have a special interest in sports. They were asked to watch a general program (including commercials) and a LIVE Japanese soccer game broadcast (with a soccer themed commercial). As the participants watched, brain activity of the forehead region was measured using NeU’s portable brain activity measuring device, the HOT-1000.
Brain activity revealed that watching theme-focused commercials that are related to the LIVE broadcast content showed higher brain activity compared to watching “general contents”. The results indicate that viewers showed twice as much more interest for commercials with a soccer “theme” than those without.
Based on these findings, we can expect that brain activity will be higher when watching commercials during high-profile sports broadcasts, which can give advertisers a competitive edge to appeal a product or service effectively. The following diagram shows the comparison of brain activities of general content commercials to that of a more theme-focused content viewed during a LIVE broadcast:
NeU has verified through this innovative case study that themed-focused commercials is an effective advertisement tool to reach out to a target audience, and that the advertisement effect varies not only on the audience, but the contents being advertised as well.
NeU will continue to make ground-breaking discoveries such as this example to push the boundaries of effective advertisement campaigns worldwide.
In this solution, we first verify the effective impression of a TV video advertisement, and then create a digest movie from extracted sections showing high brain activity. The effectiveness of both CM versions were verified from the perspective of brain science with the HOT-1000 attached to viewers:
In this verification process, a viewer watches an ordinary CM, and brain activity measurements were recorded. Brain activity showed the following:
Next, sections that showed higher brain activity were extracted, and a digest movie was created. The result of watching the newly edited video by a similar viewer revealed the following:
Brain activity of the extracted sections showed an upward trend in both interest and memory. Overall, the increase in brain activity related to memory was around 1.6 times mores when compared to the data from the original CM. Videos created through this solution is intended to be distributed through the Perfect View™ Network (PVN), which is CMerTV ‘s smartphone video advertisement network.
The Perfect View™ Network is a unique platform that distributes video advertisements to all domestic premium media, a format where overlay video advertisements are shown when users visit their site. PVN features a 100% in-view rate and a high complete reproduction rate (52%), contributing to digital advertising which has become a hot topic in recent years.
Traditionally, TV’s were considered to be the center of advertisements, but with the emergence of smartphones and other devices, cross media exposure has become a crucial tool. NeU and CMerTV’s solution is truly groundbreaking and it can enhance the effectiveness of smartphone video advertisements to a greater degree worldwide.
Pharmacies, supermarkets, shopping malls, health and rehabilitation classes, public halls, sports and gymnasiums, nursing homes and care facilities, and many more places are just a few of the examples where NeU-Up can make a difference!
For measurement results, a choice of either an A4 full-color or thermal paper version are available. The results take into consideration the person’s age, head rotation speed, attention, memory and the correct answer rate. An example of a full-color evaluation print out is shown below.
CareTEX, which is Japan’s largest gathering of businesses in the healthcare industry, was an excellent arena to showcase NeU-Up’s simple interface. Users solves simple problems displayed on a touch panel, then brain activity is analyzed and results printed. This simple and easy-to-use set-up can be placed in pharmacies, daycare centers, nursing homes, clinics and so forth.
1. NeU-Up’s brain activity measuring application
2. Android-based tablet
3. Housing
4. Brain sensor (HOT-1000)
5. Brain sensor security cable
6. USB charging adapter
7. USB cable
8. Instruction manual
Display = 10.1 inch
OS = Android 7.0
Dimensions (W ✕ D ✕ H mm) = 240 ✕ 170 ✕ 7mm
Weight = Approximately 500 g
Measurement area = Frontal
Data communication method = Bluetooth
External Dimensions (W ✕ D ✕ H mm) = 204.1 ✕ 131.6 ✕ 53.3mm
Weight = Approximately 125 g
Removable top panel (W ✕ D ✕ H mm): 310 X 550 X 300mm
Without the top panel (W ✕ D ✕ H mm): 310 X 300 X 300mm
Weight = Approximately 600 g
*This product is not meant for medical use.
Changes in color and sound, and intensity of light takes visualizing brain activity to a whole new level. Brain activity data is sent by Bluetooth from the HOT-1000 to the N-Pod, where the data is processed by a custom microcomputer and then converted to expressions of light and sound.
When brain activity is high, the brightness of the light (left images) intensifies, and when brain activity is to a minimal (right image), the light intensity faint:
Through casual and informal brain activities, users can strengthen their concentration and memory for a better learning experience. These activities apply to students as well as professionals who wish to improve their work productivity. To enhance learning, it is important to be able to perceive the degree of your concentration level so that you can make gradual improvements, and the N-Pod’s real-time feedback system through colors, light intensity and sounds make this possible for learners. This will ultimately create a brain that learns more efficiently.
It is important for individuals to know how well a brain training programs works, and the N-Pod can find the optimum brain training program that is best suited to each individual. Even proven brain training programs do not have the same effect on every individual, and the N-Pod helps to select the most suitable content for the individual by showing the person’s brain activity through light or sound, with real-time neuro-feedback.
By training to control your brain activity, individuals can find better ways to cope with daily mental stresses. Training to “self-control” one’s brain reduces mental stress levels, shown by a decrease in cortisol concentration levels in saliva (a stress hormone). The N-Pod can “know” your brain activity in real-time, anytime, anywhere. Furthermore, by attempting to change the color, strength, and sound of the N-Pod’s feedback, the user can “self-control” his or her brain’s activities with ease, even in the case of rehabilitation programs.
Pictured is one of the many possible applications of the N-POD, especially for rehabilitation exercises through game-play such as Japan’s famous “Uribo Tataki”, which is a popular game among children and adults where players use a “hammer’ to “smash” randomly appearing object knows as “uribo”. As the game progresses, the speed and number of objects that pop-up increases, and the amount of physical movement needed to keep-up with the game gradually intensifies. To visualize brain activity during game play, NeU’s HOT-1000 is placed on the forehead of the player and is synced with the N-POD.
*This product is not meant for medical use.
Since the HOT-1000 is a compact and light-weight headset, it does not interfere with driving habits during brain activity measurements. The program starts instantly as soon as the user clicks the iPhone’s [START] button.
Images from road and driving environments are seamlessly recorded through the iPhone camera that is installed on the vehicle’s windshield. Moreover, GPS and acceleration data are also recorded simultaneously. Time synchronized brain activity and pulse information can also be obtained at the same time.
The acquired data is saved as one file on the cloud server, making it unnecessary to synchronize and edit data on a personal computer. The user can check the data on the iPhone application immediately.
Brain activity can be easily measured in various environments and applications with this compact and light weight headset.
1. Body
2. USB cable
3. Instruction manual
Measurement area: forehead section
Data communication method: Bluetooth 4.0LE
External dimensions (W ✕ D ✕ H mm) = 204.1 X 136.6 X 53.3mm
Weight: Approximately 125 g
Power supply: 2 AAA batteries or via micro USB cable
*This product is not meant for medical use.
NeU measured the driving situation and brain activity of elderly drivers and examined the correlation between driving safety and measurement data by comparing the results to the evaluation score given by the instructor.
Latitude and Longitude GPS data of the driving course:
By measuring acceleration and brain activity while driving, there was a correlation between the way an elderly drives and the instructor’s evaluation score.
The smaller the variance in acceleration, the higher the evaluation score.
When driving on a curved path, those with low right-side prefrontal cortex activity tend to drive safer.
*This product is not meant for medical use.