Sensory augmentation

Sensory augmentation is the use of devices or biological modification to deliver information a human body cannot normally detect — magnetic north, infrared, seismic activity, air quality — through a sensory channel that can carry it. It is distinguished from sensory substitution, which routes information from a lost sense through a surviving one, mainly by intent: the hardware and the neuroscience are largely the same, and most augmentation work descends directly from substitution research done for blind and deaf users.

§How it works

Every approach follows the same three steps: capture a signal with a sensor, compress it into a low-bandwidth code, and deliver that code through skin, hearing, or another intact channel. The brain is expected to do the rest.

The critical constraint is bandwidth. The optic nerve carries roughly a million axons; a tactile array on the back or a vibrating wristband delivers a few dozen distinguishable channels at best. Every substitution device therefore throws away nearly all of the information it captures, and the design problem is choosing which fraction to keep. This is why devices for navigation and obstacle avoidance work reasonably well and devices intended to convey scenes do not.

The second requirement is that the signal be coupled to action. Perceptual learning depends on the user changing the input by moving; a passive stream of vibration is experienced as vibration, while a stream that changes systematically when the head turns can come to be experienced as a property of the world. Researchers call this distal attribution, and it is the difference between feeling a buzz on the wrist and feeling that north is over there.

1. 1969
   Tactile vision substitution
   Paul Bach-y-Rita's group delivers a camera image as a pattern of vibration on the back and reports that blind users learn to identify objects and judge distance.
2. 1992
   The vOICe
   Peter Meijer describes a system converting images to soundscapes, later distributed as free software and still in use.
3. c. 2004
   The eyeborg
   Neil Harbisson, who has achromatopsia, begins wearing a head-mounted device that converts colour to pitch, later reporting perception of frequencies outside the visible range.
4. 2009
   A new colour channel in adult primates
   Gene therapy adding a long-wavelength opsin gives adult dichromatic monkeys trichromatic colour vision, showing an adult brain can exploit a channel it never developed with.
5. 2015
   Regulatory clearance
   A tongue-based tactile display for the blind receives United States marketing authorisation, making sensory substitution a cleared medical device category.
6. 2016–2017
   Consumer augmentation
   Magnetic-north implants and sound-to-vibration wristbands reach small commercial markets, moving augmentation outside the laboratory.

§Substitution, addition, and biological routes

Substitution devices convert one modality into another for people missing a sense. The tactile-vision systems of Bach-y-Rita's group established the template, using a matrix of vibrating points against the skin.¹ The vOICe converts images to soundscapes.² Tongue displays exploit the dense mechanoreceptor population of the tongue surface to deliver higher spatial resolution than skin allows. None of these restores anything resembling vision; they restore specific capabilities such as locating a doorway or reading large letters.

Addition devices give an intact person a channel they never had. The feelSpace belt, developed at Osnabrück, vibrates at whichever point on the waist faces magnetic north; after weeks of continuous use, participants reported changes in how they represented space, alongside measurable differences in navigation behaviour and in cortical responses.³ The North Sense, a small chest-mounted device introduced by a cyborg-culture company in the mid-2010s, does the same job with a single vibrating point. Subdermal neodymium magnets in the fingertip, widespread in the Biohacking and grinders community since the mid-2000s, transduce nearby alternating magnetic fields into vibration felt directly by mechanoreceptors — the only common augmentation with no electronics at all.

Neil Harbisson's antenna, which converts colour and eventually near-infrared and ultraviolet to bone-conducted pitch, is the most-publicised case, the one most closely tied to the cyborg-activist wing of Transhumanism, and the most instructive, because Harbisson reports the transition from conscious translation to automatic perception and to colour-associated dreaming. Such reports are single-subject and unblinded; they are evidence about what is possible to experience, not measurements of it.

Biological routes modify the receptor layer instead of bypassing it. Adding a long-wavelength opsin gene to the retinas of adult dichromatic monkeys, by the adeno-associated viral route standard in Somatic gene therapy, produced behavioural trichromacy, which established that a mature visual system can extract information from a new receptor class without developmental rewiring.⁴ Injectable upconversion nanoparticles bound to photoreceptors gave mice a near-infrared channel alongside normal vision.⁵ Both are demonstrated in animals only. The nearest human precedent is the use of Optogenetics to confer light sensitivity on surviving retinal cells in a patient with retinitis pigmentosa, which restored crude localisation rather than adding a channel. No comparable human augmentation experiment has been conducted, and neither result implies that a similar approach in humans would be safe or effective.

§Evidence on plasticity

The strongest neuroscientific result from this field is that the cortex is organised more by task than by input channel. In congenitally blind users of visual-to-auditory substitution, regions of the ventral visual stream normally associated with object shape respond to soundscapes conveying shape.⁶ Similar task-specific rather than modality-specific responses have been reported for reading, motion and spatial layout. This is why sensory substitution works at all, and why blind users typically outperform sighted users on the same devices.

Is it a new sense or a new skill

Deroy and Auvray argue that sensory substitution is better described as a learned perceptual skill, closer to reading than to seeing, and that it does not create a new modality with its own phenomenal character.⁷ Defenders point to distal attribution and to automaticity as evidence that something more than inference is occurring. The dispute cannot be settled by task performance, since both accounts predict the same behaviour, and it is the clearest case in enhancement research where the question is about experience rather than capability.

§Current state

As of 2026 the clinical end of the field is modest but real: tactile and auditory substitution devices have regulatory clearance in some jurisdictions, and sound-to-vibration wristbands are sold to deaf users and for tinnitus. As a category of Human enhancement they are unusually cheap and unusually low-risk. They occupy the space below cochlear implants and retinal prostheses, which intervene directly on the nerve or retina and deliver correspondingly more information at correspondingly greater surgical cost.

The augmentation end is a subculture with a small commercial fringe. Devices are cheap, low-risk relative to implanted electrodes, and unregulated. What has not appeared is evidence that any added sense confers a measurable practical advantage over consulting an instrument. The Osnabrück belt work is the closest thing to a controlled demonstration of changed spatial cognition, and it involved weeks of continuous wear.

§Limitations and risks

Bandwidth is the binding constraint, and it is not obviously improvable: the skin's spatial and temporal resolution is fixed, and adding vibrators past a certain density produces confusion rather than detail. Training burden is the second constraint. Devices that require weeks of daily use before becoming automatic have high abandonment rates, the same pattern seen in Myoelectric prosthetics.

Implanted augmentation carries the risks of any foreign body: infection at the insertion site, migration, and failure of the encapsulating coating. Fingertip magnets can fracture or lose their coating, causing local tissue damage, and complicate magnetic resonance imaging. Devices installed outside medical settings, which most are, have no adverse-event reporting, so the actual complication rate in this population is unknown. The legal position of such installations, and of the practitioners who perform them, is examined in Morphological freedom.

Attentional cost is under-studied. A continuous stream of tactile information competes for the same resources as everything else the skin reports, and whether an added channel is free once automatic, or permanently taxing, has not been measured over long periods.

§Outlook

Three developments would change the picture. Higher-resolution non-invasive displays — dense electrotactile arrays, or ultrasound-based stimulation — would relax the bandwidth constraint. Direct cortical stimulation, already used experimentally to deliver touch feedback in bidirectional neuroprostheses, would bypass the peripheral channel entirely, at the cost of surgery; the Brain–computer interface literature treats write-in as considerably harder than the read-out problem described in Neural decoding. And a biological route in humans, along the lines of the primate opsin experiment, would create a genuinely new receptor population rather than repurposing an existing one, which is the only approach that would settle the question of whether new qualia are possible.

None of these is close. The more likely near-term outcome is that augmentation stays where it is: a small set of cheap devices with strong subjective reports, thin objective evidence, and an unresolved argument about whether their users are perceiving or inferring.

§See also

• Cochlear implant
• Retinal implants and visual prostheses
• Neuroprosthetics
• Biohacking and grinders
• Human enhancement
• Brain–computer interface
• Optogenetics
• Morphological freedom

§References