Home > Research > HI Systems > Research Projects

< BONE-V4 >


  A heterogeneous many-core object recognition processor is proposed to realize robust and efficient object recognition on real-time video of cluttered scenes. Unlike previous approaches that simply aimed for high GOPS/W, we aim to achieve high Effective GOPS/W, or EGOPS/W, which only counts operations carried out on meaningful regions of an input image. This is achieved by the Unified Visual Attention Model (UVAM) which confines complex Scale Invariant Feature Transform (SIFT) feature extraction to meaningful object regions while rejecting meaningless background regions. The Intelligent Inference Engine (IIE), a mixed-mode neuro-fuzzy inference system, performs the top-down familiarity attention of the UVAM which guides attention toward pre-learned objects. Weight perturbation-based learning of the IIE ensures high attention precision through online adaptation. The SIFT recognition is accelerated by an optimized array of 4 20-way SIMD Vector Processing Elements, 32 MIMD Scalar Processing Elements, and 1 Feature Matching Processor. When processing 30 fps 640x480 video, the 50 mm2 object recognition processor implemented in a 0.13 µm process achieves 246 EGOPS/W, which is 46% higher than the previous work. The average power consumption is only 345mW.

Implementation results

Performance comparison



a. Dual-Layered Architecture
  - Separated attention and recognition layers

b. Feature Extraction Clusters (FEC)
  - Parallel and pipelined for high throughput

c. Intelligent Inference Engine (IIE)
  - High attention precision

d. Power Mode Control (PMC)
  - Low power operation

Related Papers

  - ISSCC 10 [pdf] [Demo Video]

  - A-SSCC 10 [pdf]

  - CICC 10 [pdf]

  - COOL Chips 10 [pdf]

  - JSSC 11 [pdf]

  - PR 10 [pdf]

#1233, School of Electrical Engineering, KAIST, 291 Daehak-ro (373-1 Guseong-dong), Yuseong-gu,
Daejeon 34141, Republic of Korea / Tel. +82-42-350-8068 / Fax. +82-42-350-3410 / Mail: sslmaster@kaist.ac.kr
Copyright (C) 2017, SEMICONDUCTOR SYSTEM LAB., All Rights Reserved.