Poor eyesight remains one of the main obstacles to letting robots loose among humans. But it is improving, in part by aping natural vision
ROBOTS are getting smarter and more agile all the time. They disarm bombs, fly combat missions, put together complicated machines, even play football. Why, then, one might ask, are they nowhere to be seen, beyond war zones, factories and technology fairs? One reason is that they themselves cannot see very well. And people are understandably wary of purblind contraptions bumping into them willy-nilly in the street or at home.
All that a camera-equipped computer sees is lots of picture elements, or pixels. A pixel is merely a number reflecting how much light has hit a particular part of a sensor. The challenge has been to devise algorithms that can interpret such numbers as scenes composed of different objects in space. This comes naturally to people and, barring certain optical illusions, takes no time at all as well as precious little conscious effort. Yet emulating this feat in computers has proved tough.
In natural vision, after an image is formed in the retina it is sent to an area at the back of the brain, called the visual cortex, for processing. The first nerve cells it passes through react only to simple stimuli, such as edges slanting at particular angles. They fire up other cells, further into the visual cortex, which react to simple combinations of edges, such as corners. Cells in each subsequent area discern ever more complex features, with those at the top of the hierarchy responding to general categories like animals and faces, and to entire scenes comprising assorted objects. All this takes less than a tenth of a second.
The outline of this process has been known for years and in the late 1980s Yann LeCun, now at New York University, pioneered an approach to computer vision that tries to mimic the hierarchical way the visual cortex is wired. He has been tweaking his convolutional neural networks ever since.
Seeing is believing
A ConvNet begins by swiping a number of software filters, each several pixels across, over the image, pixel by pixel. Like the brains primary visual cortex, these filters look for simple features such as edges. The upshot is a set of feature maps, one for each filter, showing which patches of the original image contain the sought-after element. A series of transformations is then performed on each map in order to enhance it and improve the contrast. Next, the maps are swiped again, but this time rather than stopping at each pixel, the filter takes a snapshot every few pixels. That produces a new set of maps of lower resolution. These highlight the salient features while reining in computing power. The whole process is then repeated, with several hundred filters probing for more elaborate shapes rather than just a few scouring for simple ones. The resulting array of feature maps is run through one final set of filters. These classify objects into general categories, such as pedestrians or cars.
Many state-of-the-art computer-vision systems work along similar lines. The uniqueness of ConvNets lies in where they get their filters. Traditionally, these were simply plugged in one by one, in a laborious manual process that required an expert human eye to tell the machine what features to look for, in future, at each level. That made systems which relied on them good at spotting narrow classes of objects but inept at discerning anything else.
Dr LeCuns artificial visual cortex, by contrast, lights on the appropriate filters automatically as it is taught to distinguish the different types of object. When an image is fed into the unprimed system and processed, the chances are it will not, at first, be assigned to the right category. But, shown the correct answer, the system can work its way back, modifying its own parameters so that the next time it sees a similar image it will respond appropriately. After enough trial runs, typically 10,000 or more, it makes a decent fist of recognising that class of objects in unlabelled images.
This still requires human input, though. The next stage is unsupervised learning, in which instruction is entirely absent. Instead, the system is shown lots of pictures without being told what they depict. It knows it is on to a promising filter when the output image resembles the input. In a computing sense, resemblance is gauged by the extent to which the input image can be recreated from the lower-resolution output. When it can, the filters the system had used to get there are retained.
In a tribute to natures nous, the lowest-level filters arrived at in this unaided process are edge-seeking ones, just as in the brain. The top-level filters are sensitive to all manner of complex shapes. Caltech-101, a database routinely used for vision research, consists of some 10,000 standardised images of 101 types of just such complex shapes, including faces, cars and watches. When a ConvNet with unsupervised pre-training is shown the images from this database it can learn to recognise the categories more than 70% of the time. This is just below what top-scoring hand-engineered systems are capable ofand those tend to be much slower.
This approach need not be confined to computer-vision. In theory, it ought to work for any hierarchical system: language processing, for example. In that case individual sounds would be low-level features akin to edges, whereas the meanings of conversations would correspond to elaborate scenes.
For now, though, ConvNet has proved its mettle in the visual domain. Google has been using it to blot out faces and licence plates in its Streetview application. It has also come to the attention of DARPA, the research arm of Americas Defence Department. This agency provided Dr LeCun and his team with a small roving robot which, equipped with their system, learned to detect large obstacles from afar and correct its path accordinglya problem that lesser machines often, as it were, trip over. The scooter-sized robot was also rather good at not running into the researchers. In a selfless act of scientific bravery, they strode confidently in front of it as it rode towards them at a brisk walking pace, only to see it stop in its tracks and reverse. Such machines may not quite yet be ready to walk the streets alongside people, but the day they can is surely not far off.
国际英语资讯:Leaders from over 160 countries express support for Chinas efforts to defeat COVID-19: dip
国内英语资讯:Chinese authorities stress protecting, caring for medical workers
国际英语资讯:Putin, Erdogan discuss Syrias Idlib over phone
体坛英语资讯:Hosts Switzerland pick up first curling win at Youth Olympics
国内英语资讯:Chinese government doing well in controlling virus spread: Namibian experts
国内英语资讯:Daily necessity supplies stable in Hubei, rest of China: official
娱乐英语资讯:Feature: Serbia stages concert in support of Wuhan, China
国际英语资讯:Canadian cruise ship passengers stranded in Japan begin quarantine in Canada
国际英语资讯:Turkey seeks support from Western allies over escalation in Syrias Idlib
国内英语资讯:Xi stresses orderly resumption of work, production
国际英语资讯:Tokyo 2020 postpones volunteer training amid virus outbreak
是什么让你自卑?
国内英语资讯:Chinese hospitals discharge 20,659 recovered patients of coronavirus infection
早餐吃饱、晚餐吃少有助减肥
国内英语资讯:Wuhan conducts nucleic acid tests for all backlog of patients
瑞幸咖啡好硬气,声称疫情对生意影响不大
美国公司推出新型人造猪肉,不是素的,是真肉
国内英语资讯:Premier Li stresses increased medical supplies for epidemic control
体坛英语资讯:German Vinzenz Geiger wins over Riiber again in Val di Fiemme at Nordic Combined World Cup
国内英语资讯:China rolls out measures to care for medical workers
国内英语资讯:WHO-led team in China to travel to Wuhan on Saturday
现在AI诊断乳腺癌比人厉害
体坛英语资讯:630,000 applying to be Beijing 2022 volunteers in first month
体坛英语资讯:Chinese mens singles shuttlers knocked out of Malaysia Masters quarterfinals
我们为别人家的猫做了一扇猫门
英国遭遇历史级大风暴,洪水肆虐
国际英语资讯:Man-made humanitarian nightmare for Syrian people must stop immediately: UN chief
体坛英语资讯:Russians dominate winter triathlon in NE China
国际英语资讯:South Sudan president to reappoint rebel leader Machar in unity govt
体坛英语资讯:Iran beat China to win Tokyo Olympic berth of mens volleyball
| 不限 |
| 英语教案 |
| 英语课件 |
| 英语试题 |
| 不限 |
| 不限 |
| 上册 |
| 下册 |
| 不限 |