text.skipToContent text.skipToNavigation

Free shipping within the continental US over $50. Conditions apply

  1.  
  2. Resources
  3. Featured Products
  4. NXP — EdgeReady Smart HMI Solution Based on the i.MX RT117H Crossover MCU

NXP — EdgeReady Smart HMI Solution Based on the i.MX RT117H Crossover MCU

NXP

 

NXP EdgeReady Smart HMI Solution

Based on the i.MX RT117H with ML Vision, Voice and Graphical UI

The NXP EdgeReady Smart Human Machine Interface (SMHMI) is an all-encompassing solution which leverages the i.MX RT117H crossover MCU. The solution allows developers to quickly and easily enable multi-modal, intelligent, hands-free capabilities including machine learning (ML), vision for face and gesture recognition, far-field voice control and 2D graphical user interface (GUI) in their products.

All these functions can be mixed and matched to simplify overall system design using just this single NXP high-performance crossover MCU.
 

Development Kit: SLN-TLHMI-IOT

This solution’s development kit, the SLN-TLHMI-IOT, includes fully-integrated turnkey software, hardware reference designs and NXP’s one-stop-shop support for quick out-of-the-box operation.

It comes with a variety of features to help minimize time to market, risk, and development effort. Face/gesture recognition and voice control are performed entirely offline thanks to the i.MX RT117H, eliminating the need for the cloud as well as the privacy and latency concerns that come with it.

In addition to production ready face/gesture recognition, AFE integrated far-field voice control and advanced GUI capabilities, its software framework gives designers the flexibility to customize vision, voice functions and combination of these features. The i.MX RT117H is used for HMI in a broad range of applications including but not limited to consumer, industry and more.
 

The NXP EdgeReady Smart HMI Solution’s supported devices:

Processors/Microcontrollers: i.MX RT Crossover MCUs

  • i.MX RT1170: First GHz Crossover MCU with Arm® Cortex®-M7 and Cortex-M4 Cores

Wireless Connectivity: Wi-Fi® + Bluetooth® + 802.15.4

  • IW416: 2.4/5 GHz Dual-Band 1x1 Wi-Fi® 4 (802.11n) + Bluetooth® 5.2 Solution

 

Features

Turnkey Solution

  • Enable Smart HMI applications with ML Vision, hands-free far-field Voice control, and advanced Graphical User Interface in addition to traditional touch controls using a single NXP crossover MCU to simply overall system design
  • Full source code (except ML/AI intellectual property) access to production-ready software with rich middleware and driver support, pre-integrated and platform-optimized voice and vision AI algorithms, and dual-core-capable framework architecture to accelerate the development process
  • Plug-and-play out-of-box experience featuring three demo use-cases: Coffee Machine, Elevator, Smart Home Panel
  • Cost and form-factor optimized hardware reference designs
  • NXP one-stop-shop support

Memory

  • 2 MB SRAM (i.MX RT117H internal)
  • 32 or 64 MB QSPI NOR Flash Module
  • 32 MB SDRAM Module

Machine Vision

  • 720P RBG and/or VGA IR image sensor
  • Supports user identification via face recognition
  • Supports gesture control via palm shape recognition
 

Voice Control

  • 2 onboard digital microphones. Additional microphones available via expansion board (not included)
  • Acoustic echo cancellation, noise reduction, beamforming and barge-in using VoiceSeeker
  • Wake word and local voice command using VIT
  • 3rd party offline voice control available as complementary option

Graphics Display User Interface

  • 5.5-inch 720p MIPI LCD display
  • Light and Versatile Graphics Library (LVGL) + VGLite 2D graphics accelerator support
  • Coffee Machine, Elevator and Smart Home Panel GUI demos available out of box

Wireless Connectivity

  • Dual band 1x1 Wi-Fi 4+BLE 5.2 combo supported with NXP IW416
  • Cloud based device management, user data management, OTA, etc.
  • Matter protocol support

Toolchain

  • NXP MCUXpresso IDE

 

i.MX RT117H Smart HMI Crossover MCU

The i.MX RT117H microcontroller is a member of the i.MX RT1170 family of crossover MCUs, targeting cost-sensitive embedded Smart HMI applications. The i.MX RT117H MCU features NXP’s advanced implementation of the Arm® Cortex®-M7 core, operating at up to 1 GHz, and a power-efficient Cortex®-M4 core, operating at up to 400 MHz. This dual-core architecture provides ample performance and real-time response for edge ML and HMI multitasking. The MCU’s software framework, turnkey vision/voice algorithms, graphics display UI capabilities, memory resources (including 2 MB on-chip SRAM) and rich set of on-chip peripherals give developers the utmost flexibility to define and customize their products for different HMI use cases.

 
Smart HMI Turnkey Solution Overview
Smart HMI Turnkey Solution Introduction