Natural User Interface Employs Sensor Integration

Sept. 8, 2011
Hillcrest Labs new Scoop Pointer is a wireless, six-axis motion control that employs the Freespace MotionEngine to provide a natural user pointing interface for HDTVs via a remote control.

Scoop Pointer wireless, six-axis motion control

Kylo Browswer works with the Scoop Pointer

Hillcrest Labs' Freespace-based Loop Pointer

MEMS sensors can be notoriosly hard to get consistent, long term results. It is one reason Hillcrest Labs' Freespace MotionEngine software makes a difference when coupled with an array of 3D MEMS sensors for Analog Devices. Multiple sensors are included in Hillcrest Labs' new Scoop Pointer (Fig. 1) that is available to end users as well as OEMs.

The Scoop and Hillcrest Labs' latest sensor modules utilizes MEMS inertial, gyroscope and magnetic compass devices. It provides cursor as well as non-cursor and linear acceleration information that can be used to implement a natural point and shoot user interface as well as providing the ability to detect motion gestures.

The Scoop supports wireless connectivity and could be combined with RF4CE devices since the Scoop provides standalone sensing versus alternative 3D sensing technology like Sixense's magnetic-based sensor system (see Sixense Sensor Provides Real 3D Positioning) that requires a base station or Microsoft's Kinect that is based on Primesense's 3D camera technology (see How Microsoft’s PrimeSense-based Kinect Really Works). These provide 3D position information as well as movement and orientation but that is not always necessary for many applications. Likewise, there is a placement issue that can be significant in many environments. The Scoop also works with devices like Roku's Roku 2 HD streaming media box (see Consumer Electronics Series: Roku Netflix Player) as well as LG Smart TVs. Roku is taking advantage of the interface to drive games.

The Scoop, and Hillcrest Labs' sensors, can be used to track a cursor on an HDTV screen and this is highlighted by its use with Hillcrest Labs' Mozillab-based Kylo web browser (Fig.2). Kylo can be used with a range of user interface devices like Scoop and it is available as an OEM products as well.

The Scoop is not Hillcrest Labs' first device. It was showing it's novel Loop Pointer (Fig. 3) at CES 2007 (watch HoME YouTube Demo and 'Remote' from CES 2007 on Engineering TV). This was based on an earlier version of the Freespace software.

Freespace MotionEngine is designed to work with data from the MEMS sensors. These adjust for temperature and time to provide stable and consistent output. Part of the process is also detailed examination of the MEMS specifications to understand what the specifications like average or min/max results really mean across time and a range of devices.

The result is the 9mm by 19mm by 2.5mm FSM-SENS-1 sensor module. This is designed to work with a microcontroller that would run some or all of the Freespace MotionEngine. An alternative is the slightly larger smart module, the FSM-SI-2. This adds an STMicroelectronics' STM32 32-bit Cortex-M3 microcontroller (see Playing Games With the STM32). It supports cursor movement as well as angular and velocity information but does not include the gesture library support.

The software overhead is not significant although a 32-bit micro helps with calculations. Also, the Freespace MotionEngine libraries are designed to be split so some of it might reside on a control device while the rest runs on a host device. Hillcrest Labs uses their own gesture libraries and API. The module interface uses SPI but it can be linked to a range of wireless devices. The reference kits include USB, Bluetooth, and 2.4GHz RF support. The FSM-SI-2 has micro USB connection. Hillcrest Labs is also supporting Texas Instruments' wireless solutions for remote controls.

The modules and software can be used for a range of applications from robot control to virtual reality. The Scoop Pointer uses a 3-axis gyro and 3-axis accelerometer. It also has 9 buttons and scroll wheel reflecting its intended use as an smart TV remote control and game controller. Scoop is bundled with Kylo for HTPC integrators.

About the Author

William G. Wong | Senior Content Director - Electronic Design and Microwaves & RF

I am Editor of Electronic Design focusing on embedded, software, and systems. As Senior Content Director, I also manage Microwaves & RF and I work with a great team of editors to provide engineers, programmers, developers and technical managers with interesting and useful articles and videos on a regular basis. Check out our free newsletters to see the latest content.

You can send press releases for new products for possible coverage on the website. I am also interested in receiving contributed articles for publishing on our website. Use our template and send to me along with a signed release form. 

Check out my blog, AltEmbedded on Electronic Design, as well as his latest articles on this site that are listed below. 

You can visit my social media via these links:

I earned a Bachelor of Electrical Engineering at the Georgia Institute of Technology and a Masters in Computer Science from Rutgers University. I still do a bit of programming using everything from C and C++ to Rust and Ada/SPARK. I do a bit of PHP programming for Drupal websites. I have posted a few Drupal modules.  

I still get a hand on software and electronic hardware. Some of this can be found on our Kit Close-Up video series. You can also see me on many of our TechXchange Talk videos. I am interested in a range of projects from robotics to artificial intelligence. 

Sponsored Recommendations

Comments

To join the conversation, and become an exclusive member of Electronic Design, create an account today!