--- title: Getting physical description: Introduction With the ingress in the market of products like Nintendo Wii, Apple iPhone and Microsoft Kinect, developers finally started realizing that there are several ways a person can control a computer besides keyboards, mice and touch screens. These days there are many alternatives, obviously based on hardware sensors, and the main […] url: https://canonical.com/blog/getting-physical?format=md --- 1. [Blog](https://canonical.com/blog) 2. Article --- [Canonical](https://canonical.com/blog/author/canonical "More about Canonical") 14 September 2010 # Getting physical [Design](https://canonical.com/blog/tag/design) [Future](https://canonical.com/blog/tag/future) [Ubuntu](https://canonical.com/blog/tag/ubuntu) [Ubuntu Desktop](https://canonical.com/blog/tag/ubuntu-desktop) --- Share the article ## Introduction With the ingress in the market of products like Nintendo Wii, Apple iPhone and Microsoft Kinect, developers finally started realizing that there are several ways a person can control a computer besides keyboards, mice and touch screens. These days there are many alternatives, obviously based on hardware sensors, and the main difference is the dependency on software computation. In facts solutions based on computer-vision (like Microsoft Kinect) rely on state of the art software to analyze pictures captured by one or more cameras. If you are interested on the technical side of it, I recommend to have a look to the following projects: [Arduino](http://www.arduino.cc/ "Arduino website"), [Processing](http://processing.org/ "Processing website") and [OpenFrameworks](http://www.openframeworks.cc/ "OpenFrameworks website"). ## Usage with Ubuntu During a small exploration we did internally few months ago, we thought about how Ubuntu could behave if it was more aware of its physical context. Not only detecting the tilt of the device (like iPhone apps) but also analysing the user’s presence. This wasn’t really a new concept for me, in 2006 I experimented with a [user proximity sensitive billboard idea](http://vimeo.com/14959890 "Proximity Sensitive Billboard video on Vimeo"). I reckon there is a value on adapting the content of the screen based on the distance with who is watching it. We came up with few scenarios which are far to be developed and specified, hopefully will just open some discussions or, even better, help to start some initiatives. ### Lean back fullscreen If the user moves further from the screen while a video is playing on the focused window, the video will go automatically to fullscreen. ### Fullscreen notifications If the user is not in front of the screen, the notifications could be shown at fullscreen so the user can still read them from a different location. ### Windows parallax Since this is the year of 3D screens, we couldn’t omit a parallax effect with the windows. A gesture of the user could also trigger the launcher appearance (see prototype below). ## Prototype With few hours available, I mock up something very quickly in Processing using a face recognition library (computer-vision). Despite it could be hard to detect the horizontal position of the user’s head without a camera, we are in no way defining the technology required. The proximity could be in-facts detected with infra-red or ultra-sound sensors. [Parallax and fullscreen interaction via webcam](http://vimeo.com/14959854) from [Canonical Design](http://vimeo.com/user4106412) on [Vimeo](http://vimeo.com). ## Sign up for our newsletter Get the latest Canonical news and updates in your inbox. Work email: \*I agree to receive information about Canonical's products and services. By submitting this form, I confirm that I have read and agree to [Canonical's Privacy Policy](https://canonical.com/legal/dataprivacy). Sign up ## Share on --- ## Related posts [### Arduino® VENTUNO™ Q is available for pre-order with Ubuntu pre-installed](https://canonical.com/blog/arduino-ventuno-q-is-available-for-pre-order-with-ubuntu-pre-installed) London, UK – August 25, 2026 – Following our initial collaboration announcement in March 2026, Canonical and Arduino (a subsidiary of Qualcomm Technologies, Inc.) are excited... [Canonical](https://canonical.com/blog/author/canonical) 25 August 2026 [### Canonical becomes Gold Sponsor of Trifecta Tech Foundation](https://canonical.com/blog/canonical-becomes-gold-sponsor-of-trifecta-tech-foundation) Canonical is pleased to announce it is now a Gold Sponsor of the Trifecta Tech Foundation, a non-profit that creates open source building blocks for critical infrastructure... [Canonical](https://canonical.com/blog/author/canonical) 30 June 2026 [### Challenges designers face in open source (and how to fix them)](https://canonical.com/blog/challenges-designers-face-in-open-source-and-how-to-fix-them) Open source powers up to 90% of modern software, yet many projects lack usability. Canonical’s Design team surveyed 115 cross-functional professionals to uncover the 4 core... [Kola Ojoodide](https://canonical.com/blog/author/kola-ojoodide) 26 June 2026 [### Ubuntu Summit 26.04: connected by open source](https://canonical.com/blog/ubuntu-summit-26-04-connected-by-open-source) What an incredible experience! Ubuntu Summit 26.04 has officially drawn to a close, but the energy from our global community is still buzzing – in the comments section, on... [ilvipero](https://canonical.com/blog/author/ilvipero) 22 June 2026