An innovative technology, created by researchers at the University of St Andrews, can allow your smartphone to carry out a range of tasks just by recognising the surface it is sitting on.
SpeCam is a program which would enable existing phones to utilize their camera function to recognise different materials they have been exposed to. This would link up with a previously created database so the phone could “understand” what type of surface it has been placed on.
This offers a wide range of applications from allowing your phone to tell you where it is when you can’t find it, to programming it to take different surfaces as a trigger for action. For example if the phone rings and you place it face down on your laptop, it could send a message saying “sorry I am in a meeting” or if put inside your pocket it could suggest the caller try a different colleague.
The program would also allow the way the phone is held to perform tasks, such as changing the volume on the television, or playing certain music, such as soft jazz if placed on the sofa or dance music if on the coffee table.
As the required hardware already exists on modern smartphones, the SpeCam system could be enabled through a software update or application download.
The research will be presented at the prestigious 19th International Conference on Human-Computer Interaction with Mobile Devices and Services, ACM SIGCHI MobileHCI 2017, on Wednesday 6 September in Vienna, Austria. The paper ‘SpeCam: Sensing Surface Color and Material with the Front-Facing Camera of a Mobile Device’ has received an honourable mention award at MobileHCI, one of only five such papers in the entire program.
Lead researcher Professor Aaron Quigley, Chair of Human Computer Interaction at the University, said: “This is an example of what we call Discreet Computing or discreet interaction, where subtle and inconspicuous user actions can result in entirely new forms of interaction. By training and hence recognising materials all the surfaces around us become a canvas for our imagination.”
SpeCam cleverly uses the screen/display on a smartphone as a multi-spectral light source and the front facing camera to capture the reflection of the material it has been placed face-down upon.
The program allows the way the screen rapidly cycles through different colours to illuminate the object to detect the material and infer the location or placement of the device.
Hui Yeo, whose PhD research led to this research, added: “The goal is to explore novel forms of interaction for one-handed use which can leverage what people already do with devices, without adding new hardware to the device.”
Related posts
Interviews
Comment
Women Lead: The story of an entrepreneurial scientist
I first arrived in Scotland over 20 years ago. I had £75 in my wallet and a scholarship offer to do a PhD at the University of Edinburgh. Sometimes I…
Please mind the gap… or healthcare may fall
Imagine sharing a lengthy train journey with others. From beginning to end, imagine how often you might hear ‘mind the gap’ messages about embarking and disembarking safely. Picture how navigating…
Women Lead: My journey from Dragons’ Den to Silicon Valley
Following her appearance on Dragons’ Den, Sheila Hogan, serial entrepreneur, founder and chief executive of digital legacy vault, Biscuit Tin, shares her experience of her time in the Den and…
Look anywhere – the future is ‘aged tech’. But Scotland needs to be more adventurous
Scottish Care, as the representative body of independent social care providers of care home, care at home and housing support services, has been working over several years with colleagues in…
Women Lead: Engineer turned entrepreneur
We are always fascinated by other people’s stories. It’s how we connect, grow and learn from each other. Until very recently I always felt like I didn’t have a story to tell. Who…
‘Women – together we will change the dynamic in tech’
I was inspired to start a career in technology when personal computers were in their infancy and the internet decades away. My childhood dream of becoming a scientist was shaped by…
It’s time to change the future of tech apprenticeships – and we need your help
In his latest exclusive column for Futurescot, Ross Tuffee, chair of the Skills Development Scotland (SDS) Digital Economy Skills Group, calls on tech employers to get involved in shaping the…
What AI difference a year makes
Amazingly, it’s been one year since the publication of Scotland’s AI Strategy. And what a year it has been. Demanding but rewarding, with good progress made and great foundations laid…