VOTA: A 2.45TFLOPS/W Heterogeneous Multi-Core Visual Object Tracking Accelerator Based on Correlation Filters

Junkang Zhu, Wei Tang, Ching En Lee, Haolei Ye, Eric McCreath, Zhengya Zhang

    Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

    1 Citation (Scopus)

    Abstract

    VOTA is a domain-specific accelerator for correlation filter (CF)-based visual object tracking (VOT). It encompasses a Winograd convolution core, a FFT core and a vector core in a high-bandwidth starring topology. VOTA's frame-based instructions and execution enable a 537GFLOPS performance and reduce the code size. An instruction-chaining mechanism permits inter-core pipelining to improve the utilization to 84.2%. A 10.2mm2 28nm FP16 VOTA prototype incorporating a RISC-V host CPU is measured to achieve 2.45TFLOPS/W at 0.72V. Running OPCF, a CF-based VOT enhanced by adaptive boosting and particle filters, the chip achieves 1157FPS on 640×480 input frames at 0.9V and 175MHz, consuming 296mW.

    Original languageEnglish
    Title of host publication2021 Symposium on VLSI Circuits, VLSI Circuits 2021
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9784863487796
    DOIs
    Publication statusPublished - 13 Jun 2021
    Event35th Symposium on VLSI Circuits, VLSI Circuits 2021 - Virutal, Online
    Duration: 13 Jun 202119 Jun 2021

    Publication series

    NameIEEE Symposium on VLSI Circuits, Digest of Technical Papers
    Volume2021-June

    Conference

    Conference35th Symposium on VLSI Circuits, VLSI Circuits 2021
    CityVirutal, Online
    Period13/06/2119/06/21

    Fingerprint

    Dive into the research topics of 'VOTA: A 2.45TFLOPS/W Heterogeneous Multi-Core Visual Object Tracking Accelerator Based on Correlation Filters'. Together they form a unique fingerprint.

    Cite this