Broken push-broom

Thanks to E for this link, where it looks like an artist bought an expensive push-broom camera and broke its motor. The camera then keeps taking pictures along the same column. Stringing these together gives an interesting image: a static pushbroom projection of a moving world.

A cardinality sensor

Recently I was talking to Takeo Kanade, and he mentioned an old paper of his with Vladimir Brajovic, where the image produced by the sensor is sorted according to radiance. If two pixels receive the same light energy, then they get the same rank. Now you might think this is uninteresting, since you could just take a regular image and sort it in software. But remember, I said sorted by radiance (which is continuous), not intensity measurement (which is usually 0 - 255). For a scene that is over-exposed, with a regular sensor, you'd get an image that is mostly 255s. With the cardinality sensor, you'd get an image with lots of information, since it would preserve the rank of each scene point (which depends on the number of other scene points that are darker or brighter). Essentially each pixel is in a race to be overexposed, and once the pixel reaches the value 255, it increases a counter variable by 1 and takes the counter variable's value (which is its rank). Ties get the same value, but increase the counter variable by the number of tied pixels.

Random articles

Here are some articles I have been reading recently:

The latest update in the CMOS vs. CCD war.

What kind of sensors go on a Mars robot?

Hoping to print tons of micro-sensors in your garage? We are getting there. 

Sensors

I had a discussion with AJ about sensors and then went to the Wikipedia page. The description includes a nice definition (a sensor is a device which receives and responds to a signal) but does not elegantly describe the types of sensors (just a laundry list of different devices).

I think there are only two classes of sensors:

1) Contact or Force sensors, which I call touch sensors.

2) Electromagnetic sensors, which I loosely call light sensors.

All sensors fall into these categories (see postscripts):

Touch sensors: Anything I hear from you is basically your voice-box pushing a bunch of air to hit my ear drum. This is just like when you sit in a jacuzzi and feel the water jets. You'd say the jets seem like they are pushing against you; that is exactly what sound is doing to our ears. Time-of-flight sonars work in a similar way. Chemical sensors and taste sensors (like your tongue) are sensing bits of the object scattered in the medium. These fragments actually push or scrape against receptors. Gravitational and magnetic sensors (like a compass), again, are due to a force being applied directly onto your sensor.

Electromagnetic sensors: These, like photodetectors or heat/temperature sensors, generate a signal because different types of radiation influence the sensor. In this sense (pun intended) light sensors are transducers: they just convert electromagnetic energy falling on them into an electric reading.

Postscript 1: So whats an image? An image is just a matrix of values that store the responses of one or more sensors. You can have an "image" of sonar sensors or of a group of chemical sensors. If the sensor is on-off in response, the image is binary. The powerful concepts of images and video have nothing particularly to do with light.

If you keep running with this idea, then you'll realize that the retina is not the only thing generating an image in your head. Your tongue is also an array of sensors and it produces an "image" of the food you are eating. Actually its creates a video, because it measures images of taste responses over time. You can't display this video, because your eyes wouldn't make sense of it. But what your optic nerve cannot understand your chorda tympani (your taste nerve) absolutely can.

Postscript 2: Where do gyroscopes fit in? Gyros don't measure anything - they stay the same despite what is happening around them. If you are philosophical, you might say they measure inertia. I put them in the category of touch sensors as a sort of "null set" of that class because they resist all forces and contact.

Postscript 3: Yes, what are magnets really? There is a current loop definition which says that magnets are electric currents that circle around in an object, creating a magnetic field. But in the end, even if the source of the force is electromagnetic, your sensor detects the field by being pulled by it. I'd call that a touch sensor.

Code resource

Here is a good resource for code for optimization problems in vision that show up a lot while making small sensors. Thanks to AJ for the link.

Graphene sensors

The Economist has a fascinating article about how researchers are using graphene, interspersed with tiny dots of lead sulphide, to absorb light and produce electrons that can be converted into a signal. The cool thing about these proposed photodetectors is that they might be flexible, allowing many applications. They possibly could also be made very small and might even allow the creation of a "light transistor". 

Stereoscopy on small devices

Thanks to EJ for sending me this article. Its a nice overview of the challenges faced when showing stereoscopic content meant for one screen on another, different display. The most interesting section, for me, was about 3D content on mobile phones. The author points out two interesting things: (1) Given the size of the screen, 3D movies and games for portable devices are *usually* easy on the eyes (the disparity-focus headache factor is low). However: (2) The "miniaturization" effect (where objects appear toy-like) is very strong. This means that (outside of "cute'" games) most scenes will appear (to paraphrase the author) as if strangely in a small box. I think the field is wide open for formats and representations that will allow good viewing of 3D content on small devices.