You will hear a lecture. After listening to the lecture, in 10 seconds, please speak into the microphone and retell what you have just heard from the lecture in your own words. You will have 40 seconds to give your response.
Computer scientist Shwetak Patel and his team are developing new sensing systems. The initial focus was really around energy and water monitoring. They built a new generation of smart sensors that monitor electronic interference on a home’s power line or water pressure changes in the plumbing. Most of this technology has already found industrial applications, and Patel and his team turned their attention to adapting the technology for personal health monitoring. ‘So how do we take this noise and make it into a signal interest was hard to us, hard to us in the core of what we did for many years and we’re taking that work and applying it to other domains.’ They’re looking to take advantage of all the functionality built in our smartphones. With the users’ permission, this app can use the microphone built into most smartphones to listen to background noises, such as coughing searching for patterns that suggest a trip to the doctor might be an order. ‘We’ve constructed these models that try and understand how sound works, how it, what its patterns are and we give it a whole bunch of examples of different kinds of audio, things like people talking, things like people laughing, sneezing and of course coughing.’ This app uses a phone’s camera to check hemoglobin levels in blood by analyzing the color of capillary fluid through the skin. ‘Generally, what happens is if you’re anemic, your bloods maybe a little less red and we take advantage of that by putting your finger over a camera of a phone, the camera of the phone can actually see the coloration of the blood.’ and this test uses the camera to tell parents worried about jaundice in newborn infants. ‘Now, jaundice is something that doctors who have seen tons of babies. He just can figure out on a very basic level of it. Is this baby, do they need to get treatment or are they in a good condition, while the first-time parent has no idea necessarily what jaundice might look like.’ The researchers say the built-in sensors found in smart phones are already commonplace, but their applications and their implications for our health and well-being may be more far-reaching than we ever imagined.
