NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart HMI Solution

NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart Human Machine Interface (SMHMI) Solution is designed to reduce the complexity of adding local voice control, advanced graphic user interface, and face and gesture recognition to any application. The SLN-TLHMI-IOT is based on the i.MX RT117H Crossover Microcontroller, which is a 1GHz Arm® Cortex®-M7 + 440MHz Arm Cortex-M4 MCU with a runtime license for Smart HMI software. The SLN-TLHMI-IOT allows developers to easily enable multi-modal, intelligent, hands-free capabilities, including machine learning (ML), vision for face and gesture recognition, far-field voice control, and 2D graphical user interface (GUI) into applications. These functions can be mixed and matched to simplify overall system design using just this single high-performance crossover MCU.

The NXP Semiconductors SLN-TLHMI-IOT Solution comes with various features to help minimize time to market, risk, and development effort. These features include fully-integrated turnkey software, hardware reference designs, and NXP support for quick out-of-the-box operation. The i.MX RT117H MCU performs all face and gesture recognition and voice control entirely offline, eliminating the need for the cloud and the privacy and latency concerns that come with it.

In addition to production-ready face and gesture recognition, AFE-integrated far-field voice control, and advanced GUI capabilities, the software framework allows designers to customize vision, voice functions, and combinations of these features.

Supported by THE MCUXpresso Integrated Development Environment (IDE), the SLN-TLHMI-IOT combines best-in-class silicon, software, and IP from NXP and leading third-party partners.

Features

  • Turnkey solution
    • Enables Smart HMI applications with ML Vision, hands-free far-field Voice control, and advanced Graphical User Interface in addition to traditional touch controls using a single NXP crossover MCU to simply overall system design
    • Full source code (except ML/AI intellectual property) access to production-ready software with rich middleware and driver support, pre-integrated and platform-optimized voice and vision AI algorithms, and dual-core-capable framework architecture to accelerate the development process
    • Plug-and-play out-of-box experience featuring three demo use cases: Coffee Machine, Elevator, Smart Home Panel
    • Cost and form-factor-optimized hardware reference designs
    • NXP one-stop-shop support
  • MCU
    • NXP i.MX RT117H Crossover MCU
  • Memory
    • 2MB SRAM (i.MX RT117H internal)
    • 32MB or 64MB QSPI NOR Flash Module
    • 32MB SDRAM Module
  • Machine Vision
    • 720P RBG and/or VGA IR image sensor
    • Supports user identification via face recognition
    • Supports gesture control via palm shape recognition
  • Voice Control
    • 2 onboard digital microphones; Additional microphones available via expansion board (not included)
    • Acoustic echo cancellation, noise reduction, beamforming, and barge-in using VoiceSeeker
    • Wake word and local voice command using VIT
    • 3rd party offline voice control available as a complementary option
  • Graphics Display User Interface
    • 5.5″ 720p MIPI LCD display
    • Light and Versatile Graphics Library (LVGL) + VGLite 2D graphics accelerator support
    • Coffee Machine, Elevator, and Smart Home Panel GUI demos are available out of the box
  • Wireless Connectivity
    • Dual-band 1×1 Wi-Fi® 4+BLUETOOTH® Low Energy 5.2 supplied by NXP IW416 SoC
    • Cloud-based device management, user data management, OTA, etc.
    • Matter protocol support
  • Toolchain
    • NXP MCUXpresso IDE

Applications

  • Smart Appliances
    • White goods (refrigerators, ovens, laundry machines, air conditioners)
    • Countertop appliances (coffee machines, air purifiers, food processors)
  • Smart Home
    • Alarm and smart Home control panels
    • Thermostats
    • Universal remote controls
    • Home entertainment
  • Smart Building and Industrial IoT
    • Elevator controls
    • Industrial HMI
    • Healthcare equipment
    • Transportation systems
    • Access control and identification
  • Remote conference systems

Resources

  • Fact Sheet
  • Smart HMI Hardware Development User Guide
  • Smart HMI Software Development User Guide
  • Smart HMI User Guide
  • Smart HMI Getting Started Guide
  • Bill of Materials
  • Schematic Diagrams

Videos

Overview

NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart HMI Solution

Hardware Block Diagram

Block Diagram - NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart HMI Solution

Software Block Diagram

Block Diagram - NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart HMI Solution

NXP Semiconductors SLN-TLHMI-IOT EdgeReady Smart HMI Solution