Sensing the space
Sensing gives a spatial media system a live model of activity within the environment: entry, position, movement, direction, dwell, grouping, occupancy and change over time.
Refractiv defines which events matter to the experience and how they influence the media system. A response can develop gradually, remain atmospheric, follow an individual or group, or trigger a distinct state according to the character and purpose of the installation.
From raw input to stable behaviour
Detection identifies people, objects or actions within the sensing field. Tracking maintains continuity over time. Filtering, calibration and behavioural logic convert that information into signals such as zone entry, dwell thresholds, direction, grouping, occupancy changes or impact events.
The visual or lighting system receives stable behavioural events generated from the sensor data. This processing keeps the interaction legible and the response controlled under changing conditions.
Designed for the actual scene
Each sensing strategy is developed around the geometry, light, materials, circulation and operating conditions of the site. Sensor type, lens position, field of view, processing method, thresholds and fallback behaviour are established through testing.
Depending on the brief, the system may use computer vision, depth sensing, LiDAR, pressure, impact detection, biometric input or a hybrid approach. The selected method follows the spatial event the installation needs to understand.
Scope and outputs
| Area | Refractiv scope |
|---|---|
| Interaction model | Definition of the spatial events, thresholds and response logic required by the experience |
| Sensor strategy | Technology selection, position, field of view, coverage, zones and operating conditions |
| Software development | Detection, tracking, filtering, coordinate mapping, event generation and system communication |
| Calibration | Scene setup, thresholds, behavioural tuning and validation under operating conditions |
| Integration | Stable signals for real-time visuals, lighting, sound, game logic or show control |
| Documentation | Sensor layout, calibration settings, behaviour definitions and operational guidance |
Privacy and operation
Systems can be designed around anonymous spatial events, transient track identifiers, volatile memory and event-level outputs. The sensing architecture is matched to the privacy requirements and operating model of the site.
Operational design includes startup, recovery, diagnostics and the ability to recalibrate the system as physical or environmental conditions evolve.
Applications
Sensing and spatial response support museum and exhibition installations, public art, corporate environments, interactive games, hospitality, retail and any physical space where activity should influence media behaviour.
Selected project evidence
Nespresso New York: Discreet sensing and spatial tracking used to steer a generative fluid simulation.
Lexus A-Un, Milan Design Week: Real-time visual layer responding to biometric input supplied by the installation’s wider sensing framework.
BMO Goal Challenge, Canada: High-speed ball and player sensing translated into responsive game logic across large LED environments.
For sensing strategy, interaction prototyping or spatial-response development, contact Refractiv.
