PRE2020 Group 1 State of the Art

From Control Systems Technology Group
Jump to navigation Jump to search

Return to the main page: Main page

State of the art

Here, the State of the Art is given. It is divided into several topics. Each topic starts with a small summary of the State of the Art and after that the summarized articles concerning that topic are given.

Screening System for detecting COVID-19 symptoms and safety rules compliance

To verify the feasibility of an automatic system which screens subjects for COVID-19 virus using cough sounds some research needed to be done. Several research topics have been investigated such as: COVID-19 detection trough cough sound, conventional techniques to diagnose COVID-19, thermal imagery for mass fever screening and infrared technology for temperature sensing in humans.

An alternative method to screen subjects for COVID-19 would be through cough samples. Currently, research is being done by a couple of groups in the UK and USA. Resulting high accuracy of the algorithm has encouraged a mass collection of cough samples, even through the use of mobile APPs.

General guidelines and techniques to diagnose the COVID-19 virus. Some of the discussed techniques for diagnosis are molecular tests (PCR and serologic test), CT scans and emerging protein tests.

Several articles discussing the efficacy of infrared skin thermometers and infrared imaging in COVID-19 screening are presented. The conclusion is that handheld infrared thermometers have a low sensitivity and should not be used as a screening system. While discussions arise when assessing the usefulness of mass fever screening using thermal imaging. Many factors need to be taken into account such as: camera resolution, ambient temperature, distance from the camera and even marketing.


AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app. (A. Imran, et al. 2020).[1]

This paper discusses an alternate way of testing for covid-19, since the current testing:

  • Requires people to move through public places which could spread the virus
  • Puts medical staff at risk for the personal
  • Costs a lot
  • Not everyone goes to a medical facility to get tested

The solution they came up with is to make an smartphone app that does a preliminary test based on your cough to see if you have covid-19 or not.

The reason for choosing this method is because:

  • Prior studies have shown different respiratory syndromes have distinct features
  • Coughing is the way the virus is mostly spread.
  • There are less medical conditions that cause cough than fever

The steps taken for the making of the smartphone app are to first test if covid-19 has specific coughing characteristics (Results show there are). Second to train an engine that can distinguish a cough from background noise. third to train an engine that can distinguish between the different types of coughs and fourth to check the feasibility of the app. The accuracy of the proposed app is encouraging enough to support large scale testing.

Exploring Automatic Diagnosis of COVID-19from Crowdsourced Respiratory Sound Data (C. Brown, et al. 2020).[2]

Very similar research project as [1], but conducted by the University of Cambridge. Their research also tries to detect COVID-19 trough cough noises and respiration. Their research differs on two aspects. First, this study only uses crowdsourced audio recordings, while [1] uses data recorded in controlled environments. Secondly, this study uses simple machine learning (SVM) while [1] use a end-to-end deep learning model, which often overfit results when small samples are used.

Semantics and types of cough. (K. F. Chung, et al., 2009) [3]

Semantics of cough was very confusing and unorganized since also classification of cough type was dependent from methods used and form clinic-to-clinic.

Definition of cough

• First definition: Three-phase expulsive motor act:

  1. Inspiratory effort (inspiratory phase)
  2. Forced expiratory effort (compressive phase)
  3. Rapid airflow (expulsive phase)

• Forced expiratory manoeuvre against a closed glottis producing a sound

Types of cough

Coughs identified by their cause (e.g. asthma, reflux). Coughs are defined by their characteristics (e.g. wet, moist, chesty). Coughs can be acute (i.e. <3 weeks), subacute (i.e. 3-8 weeks) or chronic (i.e. >8 weeks). Coughs can occur in isolated episodes or in epochs. See Table 1.

Clinical analysis of coughs

Only quantitative data available is cough count. Coughs can be counted using automated audiovisual recordings. Automated cough counting does not distinguish between isolated and epoch coughs. More sophisticated analysis which measure pressure, airflows and abdominal muscle electromyograms can give a quantitative intensity of the cough. But this analysis is better suited for a research clinic instead of an investigative clinic.

Estimated effectiveness of symptom and risk screening to prevent the spread of COVID-19 By (K. M. Gostic, et al. 2020).[4]

This article uses a mathematical model about the spread of emerging pathogens from 2015 combined with the current knowledge about the epidemiological parameters of the COVID-19 spread to estimate the extent in which traveler screening will be useful. Because COVID-19 has a long incubation period many cases are fundamentally undetectable, which will lead to screening missing more than half of the infected people. This number might increase a bit when the epidemic is stable instead of growing, because the times since exposure will be more evenly distributed.

Real-time tracking of self-reported symptoms to predict potential COVID-19 (C. Menni, et al. 2020).[5]

Symptoms and indicators of COVID-19 include loss of taste and smell, anosmia, fatigue, persistent cough and loss of appetite.

Asymptomatic Transmission, the Achilles’ Heel of Current Strategies to Control Covid-19 (M. Gandhi, et al. 2020).[6]

Infection control relies heavily on early detection, but because COVID-19 has a long incubation time this does not work. This is why it is important to continuously test especially nurses on COVID-19, because it can be detected before the symptoms start to manifest.

Crowds by Example (A. Lerner, Y. Chrysanthou, D. Lischinski, 2007).[7]

Crowds can be modeled in several different ways, and in this study the people are tracked using video input, and modeled from that. Afterwards, the pedestrians were asked what influenced their path and to what extent. Using this information a model can be made. The influence factors are, to name a few, the topography of the terrain, the presence of obstacles, proximity to other people, the pedestrian’s personality and state of mind. Setting up some equations based on the experiment a model can be made that is able to simulate a crowd.

Diagnosing COVID-19: The disease and tools for detection (B. Udugama, et al. 2020).[8]

To detect COVID-19 in the hospital there are several tests that can be used. Molecular tests are useful because they can target and identify specific pathogens, although nucleic acid testing is the primary way of testing for COVID-19. CT scans can be used but have a lower specificity because the imaging features overlap with other viral pneumonia. Emerging diagnostic tests for COVID-19 are protein tests, more developed nucleic acid tests and detection at the point-of-care, such as lateral flow antigen detection and microfluidic devices.

Detecting the Coronavirus (COVID-19) (P. Pokhrel, et al. 2020). [9]

In December 2019 a new virus was discovered, the SARS-CoV-2. This virus causes the disease COVID-19 which has a medium reproduction rate(2.25%) and a medium mortality rate (5.7%). However contrary to the looks of only being a mild virus, when it remained untreated the sick people began to overwhelm the healthcare system which spread panic. SARS has a lot of similarities with COVID-19 and was eradicated in 2003 by syndromic surveillance, isolation of patients and not physical contact. If this will also work for COVID-19 will remain to be seen.

The characteristics of COVID-19 appear 3-7 days after infection and include fever, coughing and body weakness. People of old age or with underlaying illnesses have a higher mortality rate. People of ages are susceptible to SARS-CoV-2 which transmits via contact or bodily fluids.

One of the most important ways to limit the spread is by early detection so precautions can be taken. The current ways of detection COVID-19 are via a CT-scan, Nucleic Acid based methods and Immunoassays.

CT-scans contain specific characteristics of COVID-19 which helps to identify if the person has COVID-19, however these characteristics may overlap with other infections and give false positives. The test is more accurate if the test is executed during specific stages.

Nucleic Acid based method is a way of detection of RNA viruses in a clinical setting. Based on this method the CDC developed a real time RT-PCR diagnostic unit. Although this method is less sensitive than the CT imaging at certain stages, it specificity is much better making it a better detection method.

Immunoassay detects viral protein antigens or serum antibodies of people exposed to SARS-CoV-2, this method can detect the antibodies 3 days after infection it however also ha a lot of drawbacks.

The now emerging detection techniques are isothermal amplification for nucleic acid targets and lateral flow based detection of nucleic acids an proteins.

Comparison of Non-Contact Infrared Skin Thermometers (T. Fletcher, et al. 2018).[10]

Non-contact infrared skin thermometers are being used more as a means to asses body core temperature and signs of diabetic foot ulcerations In the paper 3 different thermometers were tested. All the manufacturers claimed less than 0.3 °C in the 22-40 °C range.

For infrared measuring devices there are changes in the measured temperature depending on the size of the target. This is also called the size-of-the source effect. Something else that influences the measurements is the difference in distance or the target from the measuring device. This is important since for these measuring devices there is no way to have the exact same distance each time and is thus included in testing these devices.

The results of this paper show that the tested measurement equipment did not come close to the before specified 0.3 °C and could reach up to 6 °C. The paper furthermore showed that the size-of-source effect and the distance matter a lot in the accuracy of the measurement device.

Comparison of Infrared Thermal Detection Systems for mass fever screening in a tropical healthcare setting (M. R. Tay, et al. 2015). [11]

Fever screening detection systems such as infrared thermal detection systems (ITDS) have been used before for rapid identification of potential cases of infected people. ITDS use the difference in the ambient temperature and the temperature of the subject.

Three different ITDS were used in Singapore to check if people had a fever. For these people an oral check was taken as a reference. In the paper sensitivity is described as people that have a fever are also detected as having a fever and specificity is described as people without a fever are also not seen as having a fever. Of the three tested ITDS they all had high specificity , 2 showed low to medium sensitivity while one showed high sensitivity. The ones that showed the lower sensitivity were older models while the newest model showed the higher sensitivity.

Crowd temp screening is a joke, says one expert (K. Field, 2020)[12]

Accuracy of the thermal camera depends on several factors (including human variability) and in ideal conditions the maximum accuracy is of ±2 deg C. (which to detect feverish patients is not enough).

The human body is a living and closed loop system it will fluctuate its temperature on various conditions (i.e. ambient temperature, energy expended, and alcohol consumption).

According to FDA guidelines the ideal part of the face to detect accurate temperature would be the inner canthus (tear duct). To measure the temperature of such a small area needs at least 3 x 3 pixels (5 x 5 for better results). Therefore to film such a small detail in a crowd environment a thermal camera should have a resolution of at least a million of pixels (around 12 mega pixels) which do not yet exist.

"Are you just deploying this gear for ‘feel good’ needs, or are you truly looking to measure and eliminate feverish people?"

"I could deploy a doctor that says he can tell your temperature is not normal by looking at your nose--and that might be just as accurate"

The expert's opinion: If you can’t do it right--don’t bother.

Remote monitoring of breathing dynamics using infrared thermography (C. B. Pereira, et al., 2015) [13]

Technique using thermal imaging in combination with a robust algorithm to detect breathing and to measure breathing rate (BR). The algorithm is a able to compensate for the movement of the subject.

The system shows accurate estimations of the breathing rate even under non ideal conditions (i.e. movement of the subject). For accurate measurements, the ambient temperature must be controlled. For further improvement of breath detection movement of the shoulders should be included in the algorithm.

Privacy Issues with Smart Technologies

Some research on privacy issues was done as a possible alternative idea. Nevertheless, privacy issues do tie quite strongly to the current subject. Since people are being recorded both on video and audio the question arises, what is done with the data? A more in depth research on ethical issues could be conducted. Some of the article discuss ethical use of surveillance technology, cyber security smart camera networks and in smart homes.


A Systematic Approach Towards User-Centric Privacy and Security for Smart Camera Networks (T. Winkler, et al. 2010).[14]

Fully digitized systems analyze video footage and sets of an alarm if there is suspicious activity. There a however still issues of privacy for this. Since the footage is stored, people can retrieve it and study the behavior of people. The current solutions for this are to blur out faces or to extract encrypt sensitive image regions.

Desirable properties of a secure an privacy-preserving camera system would be:

  • Detection of sensitive regions
  • Blanking
  • Obfuscation and scrambling
  • Abstraction
  • Encryption
  • Multiple privacy levels

For user acceptance it is important that the user gives consent to being filmed and can control it when they are being filmed by for instance placing signboard that the area is being filmed. Furthermore it is also important that the users can give feedback.

The paper sketches concept of a level approach for trustworthy smart camera’s. As a basis for the camera there will be hardware security around a microchip called the trusted platform module. To support the different privacy levels, motion detection is used. The lowest level of security is where only a background is visible while the person and their immediate surroundings are cut out by a black box. The next level would is done with edge detection, here only the person himself is visible and nothing of the surroundings. This is followed by the last level where the person and their immediate surroundings is visible. In other words only the black box that was cut out for the lowest level is visible.

A Smart Home is No Castle: Privacy Vulnerabilities of Encrypted IoT Traffic (N. Apthorpe, et al. 2017).[15]

Smart Home devices collect data not only when you are on the internet, but also about your daily life. There is a privacy concern if a passive network observer deduce behavior in the change in internet traffic. Some people say that due to encryption no sensitive information can be seen, however it can be argued that meta data and traffic patterns can reveal sensitive information. In this paper a strategy to recognize user behavior with traffic load of internet of things devices is given. Four Smart home devices are used for this. From all of these devices a network observer could infer behavioral patterns from observing the traffic load. Thus it would be necessary for devices to mask the true rate of devices. For the research in this paper a few assumptions were made. First of it is assumed there is only a passive network threat. Second packet contents are not used and finally it is assumed that the observer can obtain and study those devices. The way to analyze these traffic rates is to first separate traffic into sperate packet streams, then to find which stream belongs to which device. With this the traffic rates can be examined and the behavior of the consumer can be deduced.

All Eyes on You! Impact of Location, Camera Type, and Privacy-Security-Trade-off on the Acceptance of Surveillance Technologies (Offermann-Van Heek et al. 2019).[16]

Crime surveillance technologies(CST) have increased in the past years. Critics fear that the recording and storing if the data will invade the privacy of the people. The acceptance of the people for these CST are important. This paper discusses the acceptance of the people towards different types and locations of the CST, at which turning points acceptation becomes rejection, the trade of between safety and privacy. To research this questionnaires were taken.

The results show that people find the locations of the CST the most important followed by the crime reduction, handling of the recorded data and last the camera types. The paper further shows based on the before named subjects the how much people accept it the CST. The most rejected was surveillance in your own home. To research the trade of between security and privacy 3 scenarios were made, 1 with high security low privacy, 1 with average security and average privacy and 1 with low security and high privacy. The high security came out the best of these scenarios.

Autonomous robots against COVID-19

A prime example of a (USE) robotic technology in use to combat the COVID-19 pandemic. This article describes the successful employment of a robot using UV lamps to disinfect hospital rooms.

Autonomous Robots Are Helping Kill Coronavirus in Hospitals (E. Ackerman, 2020).[17]

UVD Robots is making robots that are mobile arrays of powerful UVC lights that kill microorganisms. UV lights on carts are used to disinfect areas for some time, but they are dangerous for human skin and when they are operated by humans it is prone to human error and it might skip a few places. This newly developed product is able to autonomously disinfect a room between 10 and 15 minutes, with the robot spending 1 or 2 minutes in five or six different positions to maximize the surface it disinfects.

General robotic technologies in the medical field

Since at the beginning of the project the topic was unclear some research was done on general technologies used now and applicable in the near future.


Can robots handle your healthcare? (N. Davies, 2016).[18]

The demand for healthcare robots will rise due to an ageing population and a shortage of carers. Japan is a leading country in the field of healthcare robots. They develop their robots in close coordination with elderly and patients.

Safety is an important aspect for healthcare robots. They must be absolutely fool proof. In order to safely operate around humans, robots need to feature things like quick reflexes, communication capabilities and interaction capabilities via video and audio. This translates into a wide range of sensors, cameras and actuators the robot needs to have. Next to a robot’s features, their looks are also important. Robots that try to impersonate actual humans, but still show imperfections, can make users uneasy.

An area in which robots can do a better job than humans is being consistent in the quality of the care that is provided. After a long difficult shift, humans can be prone to errors while robots are not affected by exhaustion or other emotions.

For simple routine healthcare tasks, robots can be a good solution.

How medical robots will change healthcare (P. B. Nichol, 2016).[19]

A possible major field in future healthcare is medical nanotechnology, and more specific nanorobots. These robots will work inside the patient at cellular level. The most important stakeholders in robotic healthcare are not the people that develop the technology, but the people that will use it.

There are three main ways in which robotics can be deployed in healthcare: Direct patient care (e.g. robots used in surgeries), Indirect patient care (e.g. robots delivering medicine), Home healthcare (e.g. robots that keep the elderly company).

Acceptance of Healthcare Robots for the Older Population: Review and Future Directions (E. Broadbent, et al. 2009).[20]

It is projected that the proportion of people older than the age of 60 will double between 2000 and 2050. This increases the need for healthcare. Alongside this there is also a shortage of people working in the healthcare industry. In western countries, most of the older people want to remain living independently in their own homes for as long as possible. To facilitate this, smart solutions need to be found, for example healthcare robots.

Of great importance is the acceptance of healthcare robots by the people in need of care. There are three requirements for acceptance of a robot to occur: motivation for using the robot, sufficient user-friendliness and a feeling of comfort with the robot.

Healthcare robots need to be able to adapt to individual differences since not all patients are equal.

Basic healthcare robots have been developed which can assist with simple tasks like: assist in walking, reminding of doctors appointments, carry objects, lift patients, providing companionship. Mitsubishi sold the first commercially available mobile robot in 2005. This robot is designed to help in the home.

The older the age, the less willing people are to use robots. Older people are more fearful of new technology. However, they are more willing to accept assistive devices if this helps them maintain their independence.

Studies have shown that people prefer robots that do not have a human-like appearance. For companionship robots an animal-like appearance is preferred. Other examples of desired characteristics of a robot for the elderly are slow moving, safe, reliable, small and easy to use. Older people also appreciate having some form of control over the robot because this reinforces their sense of independence.

Medical Robots: Current Systems and Research Directions (R. A. Beasley, 2012).[21]

An example of a great success in medical robotics is the surgical robot da Vinci. The biggest impact of medical robots has been improving surgeries that require great precision.

Medical robots can be employed during brain surgeries. By using medical images (e.g. CT-scan) a robotic arm can orient the tools in the correct direction, or the surgeon can specify a target which the robot guides the instrument towards with submillimetre accuracy. Medical robots are also used to assist in spine surgery.

Another application field of medical robots is orthopaedics (e.g. hip or knee replacement). An example of such a robot is Robodoc, which is used for milling automatically according to a surgical plan. Other devices, like the RIO, are designed such that the robot and the surgeon hold the tool simultaneously. The RIO ensures that the surgeon makes the correct movements.

There also exist devices which are controlled by the surgeon (technically not robots). The surgeon uses joysticks to manipulate the tools with great precision. An example of such machines are the Zeus and the da Vinci. These systems filter out hand tremors and enable the surgeon and patient to not be at the same location.

InnoMotion is a robot arm which can accurately guide a needle using CT or MRI imaging.

Robots exist that can help a surgeon guide a tube through a patient’s blood vessel. The surgeon can steer the tube and force feedback sensors tell the surgeon how much pressure is being applied.

Robotic arms are also used in radiosurgery, in which a specific area inside the patient is targeted with beams of ionizing radiation from multiple angles.

Robots are also used to perform CPR. A band is placed around the patient’s chest which is pulled tight by an actuator to compress the chest. The tightness of the band is adjusted based on the patient’s chest size.

Microprocessor-controlled prosthetics are prosthetics in which the patient is assisted in the movement or are controlled by the patient to perform movements which have been lost (e.g. exoskeletons).

Another area of medical robots consists of assistive and rehabilitation systems. These include things like a controllable arm holding a spoon or a grasper which can be attached to a wheelchair.

In the future, medical robots will become smaller and cheaper. More functionality will be added. Also, robots will be used more for medical training. Medical robots need to provide solutions to real problems, otherwise there is a change that they are displaced by other medical advancements.

Medical robots go soft (E. Strickland, 2017).[22]

New kinds of medical robots are being developed of which the parts that touch the patient are soft. This is to prevent damage to organs and blood vessels and makes sure the human body does not surround the object with scar tissue which can diminish its effectiveness.

An example of a soft medical robot is a sleeve that surrounds the hart. This sleeve contains rings which can be pneumatically inflated to detect and force a heartbeat in a certain tempo.

Another example is a device which can be implemented in the body to give of small dosages of a drug. This device is made of a soft gel with a mechanism inside which can be activated from outside the body.

A final example is a soft gripper-hand made of hydrogel. The hand can be actuated by forcing water into the hand. This hand can be placed on a robotic arm and used for grabbing organs inside the human body without damaging them.

Robots in Health and Social Care: A Complementary Technology to Home Care and Telehealthcare? (T. Dahl, et al. 2013).[23]

This article discusses several specific robotics applications.The robots that were considered were classified in 9 categories: Surgery robots, Robots supporting Human-Robot interaction tasks, Robots providing logistics in care home environments, Telepresence and companion robots, Humanoid robots for entertaining and educating children with special needs, Robots as motivational coaches, Home assistance robots for an ageing society, Human-Robot relationships in medical care and society, and Human- Robot relationships in medical and care situations.

Between these categories, there are a few ingredients for success that can be found. The general ingredients for success include: Adequate level of personalization, Appropriate safety levels, Proper object manipulation and navigation in unstructured environments, Patient/user safety, Reliability and robustness and Sustainability. In addition, robots that serve motivational or social purposes also need to be personable, intelligent and highly interactive.

However, there are also some concerns with using robots extensively. For example, humanoid robots need to have a set-up etiquette, like following the eyes of a talking person. What also needs to be kept in mind, especially using social robots with elderly people, is that the extensive use of robots could lead to a potential reduction of human contact, social isolation, an increasing feeling of objectification and a loss of privacy. Furthermore, cost effectiveness plays a great deal in the practical use of robots.

Multimedia Companion for Patients in Minimally Conscious State (MCS)

At the beginning of the project, one of the potential subjects that was considered is regarding people in a minimally conscious state. Novel imaging techniques have enabled communication with minimally conscious patients. The idea is to create a multimedia system for patients in MCS. This system would project films, music and videos of family members. This system can communicate with the patient only with binary (yes or no) questions. Communication is used to let the patient navigate the multimedia system (i.e. choosing what to watch or do). The yes or no answers are given by the patient's ability to modulate brain activity. The patient's response is decoded by sensing which areas of the brain intensify in activity.

System:"Do you want to watch the news? If YES imagine playing tennis. If NO imagine walking in the rooms of your house."

Patient: The patient imagines to play tennis.

The motor area of the patient's brain activates.

Activity is recorded by the system.

The system plays the latest bulletin.


- First technique using functional Magnetic Resonance Imaging (fMRI) and PET.

The Aware Mind in the Motionless Body (M. M. Monti, A. M. Owen, 2010)[24] & Detecting Awareness in the Vegetative State (A. Owen et al., 2006)[25]

Case Study: Martha

Martha, a young woman of not even 30 years old is victim of a car accident. She survives the accident and slips into coma; her eyes are closed, her body is motionless and unable to breath autonomously. After a week her eyes open, her body is able to breathe again autonomously and even makes small movements. For example, she yawns, she stretches her arms and slightly moves her body in her bed. It seems she is even able to sleep and wake up.

Vegetative State, Comatose state, and sleep

When a patient in a comatose state is able to sleep and wake up again, she/he is said to be in the Vegetative State (VS). A patient in a vegetative state might have his/her eyes open, can breathe autonomously, can move his/her body, can produce urine, and can vocalize sounds. The big question, are patients in vegetative state conscious? Consciousness is made of wakefulness and awareness. A healthy person is both awake and aware, when not asleep. A comatose patient is neither awake nor aware. While a patient in vegetative state is awake, but is not aware. Now around 40% of patients diagnosed in the vegetative state seem to be aware. Therefore, these misdiagnosed patients are said to be in a Minimally Conscious State (MCS). Often while diagnosing patients the “Lack of evidence of consciousness is, in this situation, equated to evidence of lack of consciousness” (Monti, Owen, 2008)(i.e. False Negative). To distinguish patients in MCS from VS one of three factors must be met:

• Awareness of the environment

• Sustained, reproducible, purposeful or voluntary response to visual or tactile stimuli

• Language comprehension and/or expression

Novel neuroimaging techniques are used to detect markers of consciousness, such as Positron Emission Tomography (PET) and functional Magnetic Resonance Imaging (fMRI).

Experiment 1: brain response to speech of patients in VS

Two patients in VS showed brain activities similar to healthy volunteers in response to speech and picture of faces. The two patients in VS listened to simple and complex (semantically ambiguous) sentences. The complex sentences activated, in the VS patients, the same brain area as in healthy volunteers. Furthermore, similar experiments were conducted with healthy volunteers heavily sedated. In the heavily sedated volunteers, no activation of the same area was recorded. This shows a higher level of awareness (some language comprehension) in the VS patients than the sedated volunteers. Nevertheless, simple brain responses cannot be taken as a factors of awareness nor consciousness. Much of sensory processing is automatic. Such as lines depicting a face or speech of a familiar language. Therefore, the type of stimuli and the type of brain activity recorded must be attentively chosen.

Experiment 2: voluntary modulation of brain activity in VS patient

A young woman victim of a car accident slips into coma, then wakes up again, but is diagnosed in the Vegetative State. The patient was given spoken instruction. The first instruction was to imagine playing tennis. The second, to imagine walking in her own apartment. When the patient was instructed to imagine playing tennis intense activity in the motor area of the brain was recorded. While when she was asked to imagine walking in her apartment activity in the parahippocampal gyrus (memory retrieval area), posterior parietal cortex (spatial reasoning area) and some motor areas. Healthy control volunteers, given the same instructions, reproduce the same brain activity of the VS patient. Unless the volunteers did not understand the instructions or decided to not comply with them. Therefore, in this experiment the idea of an automatic brain response is discredited.

- Second technique using Transcranial Magnetic Stimulation in combination with high density Electroencephalography (TMS/hd-EEG). This technique is much more practical and portable than fMRI or PET.

A perturbational approach for evaluating the brain’s capacity for consciousness (M. Massimini et al. 2009)[26]

It does not confirm if a person is conscious or not. The technique weighs the capacity of the brain for consciousness. The technique does not require any input from the user. In this article the technique has only been used to differentiate brain response, to TMS excitation, in three conscious states: wakefulness, long-wave sleep, and REM sleep. More research must be done with sedated patients [27], and patients with brain injuries [28] (i.e. Minimally Conscious State or Vegetative State).

1. Start from a theory describing how consciousness is created. Integrated Information Theory of Consciousness (IITC) suggests that consciousness is created by a physical system.

2. Measure the brain’s capacity to generate consciousness. Measurement is done by poking (exciting) the concerned physical systems, with TMS, and record the response, with hd-EEG.

Results: Brain responses to TMS during wakefulness are similar to those during REM sleep, showing effective connectivity between brain areas (i.e. the stimuli travel between various regions). While long wave sleep shows loss of cortical integration (i.e. the stimuli remains local).


  1. 1.0 1.1 1.2 1.3 [1] Imran, A., Posokhova, I., Qureshi, H. N., Masood, U., Riaz, S., Ali, K., John, C. N., Hussain, I., & Nabeel, M. (2020). AI4COVID-19: AI enabled preliminary diagnosis for COVID-19 from cough samples via an app. Informatics in Medicine Unlocked, 20, 100378.
  2. [2] Brown, C., Chauhan, J., Grammenos, A., Han, J., Hasthanasombat, A., Spathis, D., Xia, T., Cicuta, P., & Mascolo, C. (2020). Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data. 3474–3484.
  3. [3] Chung, K. F., Bolser, D., Davenport, P., Fontana, G., Morice, A., & Widdicombe, J. (2009). Semantics and types of cough. Pulmonary Pharmacology and Therapeutics, 22(2), 139–142.
  4. [4] Gostic, K. M., Gomez, A. C. R., Mummah, R. O., Kucharski, A. J., & Lloyd-Smith, J. O. (2020). Estimated effectiveness of symptom and risk screening to prevent the spread of COVID-19. ELife, 9.
  5. [5] Menni, C., Valdes, A. M., Freidin, M. B., Sudre, C. H., Nguyen, L. H., Drew, D. A., Ganesh, S., Varsavsky, T., Cardoso, M. J., El-Sayed Moustafa, J. S., Visconti, A., Hysi, P., Bowyer, R. C. E., Mangino, M., Falchi, M., Wolf, J., Ourselin, S., Chan, A. T., Steves, C. J., & Spector, T. D. (2020). Real-time tracking of self-reported symptoms to predict potential COVID-19. Nature Medicine, 26(7), 1037–1040.
  6. [6] Gandhi, M., Yokoe, D. S., & Havlir, D. V. (2020). Asymptomatic transmission, the achilles’ heel of current strategies to control Covid-19. In New England Journal of Medicine (Vol. 382, Issue 22, pp. 2158–2160). Massachussetts Medical Society.
  7. [7] Lerner, A., Chrysanthou, Y., & Lischinski, D. (2007). Crowds by example. Computer Graphics Forum, 26(3), 655–664.
  8. [8] Udugama, B., Kadhiresan, P., Kozlowski, H. N., Malekjahani, A., Osborne, M., Li, V. Y. C., Chen, H., Mubareka, S., Gubbay, J. B., & Chan, W. C. W. (2020). Diagnosing COVID-19: The Disease and Tools for Detection. In ACS nano (Vol. 14, Issue 4, pp. 3822–3835). NLM (Medline).
  9. [9] Pokhrel, P., Hu, C., & Mao, H. (2020). Detecting the Coronavirus (COVID-19). ACS Sensors, 5, 2283–2296.
  10. [10] Fletcher, T., Whittam, A., Simpson, R., & Machin, G. (2018). Comparison of non-contact infrared skin thermometers. Journal of Medical Engineering and Technology, 42(2), 65–71.
  11. [11] Tay, M. R., Low, Y. L., Zhao, X., Cook, A. R., & Lee, V. J. (2015). Comparison of Infrared Thermal Detection Systems for mass fever screening in a tropical healthcare setting. Public Health, 129(11), 1471–1478.
  12. [12] Crowd temp screening is a joke, one tech expert says | FierceElectronics. (n.d.). Retrieved September 4, 2020, from Webarticle
  13. [13] Pereira, C. B., Yu, X., Czaplik, M., Rossaint, R., Blazek, V., & Leonhardt, S. (2015). Remote monitoring of breathing dynamics using infrared thermography. Biomedical Optics Express, 6(11), 4378.
  14. [14] Winkler, T., & Rinner, B. (2010). A systematic approach towards user-centric privacy and security for smart camera networks. ICDSC - 4th ACM/IEEE International Conference on Distributed Smart Cameras, 133–141.
  15. [15] Apthorpe, N., Reisman, D., & Feamster, N. (2017). A Smart Home is No Castle: Privacy Vulnerabilities of Encrypted IoT Traffic.
  16. [16] Offermann-Van Heek, J., Arning, K., & Ziefle, M. (2019). All Eyes on You! Impact of Location, Camera Type, and Privacy-Security-Trade-off on the Acceptance of Surveillance Technologies. Communications in Computer and Information Science, 921, 131–149.
  17. [17] Ackerman, E. (n.d.). Autonomous Robots Are Helping Kill Coronavirus in Hospitals - IEEE Spectrum. Retrieved September 6, 2020.
  18. [18] Davies, N. (2016). Can robots handle your healthcare? Engineering and Technology, 11(9), 58–61.
  19. [19] Nichol, P. B. How medical robots will change healthcare | CIO. Retrieved September 5, 2020.
  20. [20] Broadbent, E., Stafford, R., & MacDonald, B. (2009). Acceptance of healthcare robots for the older population: Review and future directions. In International Journal of Social Robotics (Vol. 1, Issue 4, pp. 319–330). Springer.
  21. [21] Beasley, R. A. (2012). Medical Robots: Current Systems and Research Directions. Journal of Robotics, 2012, 1–14.
  22. [22] Strickland, E. (2017). Medical robots go soft [News]. IEEE Spectrum, 54(4), 11–12.
  23. [23] Dahl, T., & Boulos, M. (2013). Robots in Health and Social Care: A Complementary Technology to Home Care and Telehealthcare? Robotics, 3(1), 1–21.
  24. [24] Monti, M. M., & Owen, A. M. (2010). The aware mind in the motionless body. Psychologist, 23(6), 478–481.
  25. [25] Owen, A. M., Coleman, M. R., Boly, M., Davis, M. H., Laureys, S., & Pickard, J. D. (2006). Detecting Awareness in the Vegetative State. Science, 313(5792), 1402 LP – 1402.
  26. [26] Massimini, M., Boly, M., Casali, A., Rosanova, M., & Tononi, G. (2009). A perturbational approach for evaluating the brain’s capacity for consciousness. In Progress in Brain Research (Vol. 177, Issue C, pp. 201–214). Elsevier.
  27. [27] Ferrarelli, F., Massimini, M., Sarasso, S., Casali, A., Riedner, B. A., Angelini, G., Tononi, G., & Pearce, R. A. (2010). Breakdown in cortical effective connectivity during midazolam-induced loss of consciousness. Proceedings of the National Academy of Sciences of the United States of America, 107(6), 2681–2686.
  28. [28] Sarasso, S., Rosanova, M., Casali, A. G., Casarotto, S., Fecchio, M., Boly, M., Gosseries, O., Tononi, G., Laureys, S., & Massimini, M. (2014). Quantifying cortical EEG responses to TMS in (Un)consciousness. Clinical EEG and Neuroscience, 45(1), 40–49.