Teaching artificial intelligence to connect senses like vision and touch
In Canadian author Margaret Atwood’s book “Blind Assassins,” she says that “touch comes before sight, before speech. It’s the first language and the last, and it always tells the truth.” While our sense of touch gives us a channel to feel the physical world, our eyes help us immediately understand the full picture of these tactile signals. Robots that have been programmed to see or feel can’t use these signals quite as interchangeably. To better bridge this sensory gap, researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have come up with a predictive artificial intelligence (AI) that can learn to see by touching, and learn to feel by seeing. The team’s system can create realistic tactile signals from visual inputs, and predict which object and what part is being touched directly from those tactile inputs. They used a KUKA robot arm with a special tactile sensor called GelSight, designed by another group at MIT. Using a simple web camera, the team recorded nearly 200 objects, such as tools, household products, fabrics, and more, being touched more than 12,000 times. Breaking those 12,000 video clips down into static frames, the team compiled “VisGel,” a dataset of more than 3 million visual/tactile-paired images. “By looking at the scene, our model can imagine the feeling of touching a flat surface or a sharp edge”, says Yunzhu Li, CSAIL PhD student and lead author on a new paper about the system. “By blindly touching around, our model can predict the interaction with the environment purely from tactile feelings. Bringing these two senses together could empower the robot and reduce the data we might need for tasks involving manipulating and grasping objects.” Recent work to equip robots with more human-like physical senses, such as MIT’s 2016 project using deep learning to visually indicate... If you wish to read this full breaking news headline, plus more articles from around Thailand and Asia like, Teaching artificial intelligence to connect senses like vision and touch, simply click on 'Read full story' below, but 1st please give us a 'LIKE' or 'SHARE' before you leave. Thank you
Published By: Thailand Business News - Tuesday, 25 June
- Older News
- Vote! Artificial Intelligence: The New Weapon To Fight Wildlife Poachers VOA NEWS (5 days ago) - The survival of wild animals such as elephants and tigers are at risk, and one of the main reasons is poaching. These animals are being hunted, even in protected wildlife...
Popular Asia Job Post Articles
- - Haziq Abdul Aziz detained for role in Malaysian sex video implicating minister Azmin Ali
- - Student killed by electrocution in Phuket public park under investigation
- - Pastor confirmed with Ebola as disease spreads in DR Congo
- - Local Afghan Journalist Killed by Unknown Assailants
- - Djokovic saves match points to claim fifth Wimbledon title
- - Tropical Storm Barry Downgraded to Tropical Depression
- - Floods force millions to flee homes in India, Nepal and Bangladesh
- - Investors make DSI complaint against 'forex fraudster'
- - Derailment halts southern train services
- - Koreans find crying babies most annoying on flights