VSA project Team 3 repository

Milestone 1: Simple VSA and Jetson Nano Orientation

Part A: Simple VSA (05.19.22 ~ 05.25.22)

• Run activity recognition model

  • Pytorch (ONNX): ResNet34
  • Pytorch (pre-trained): TSN (colab link)

• Run face recognition model

  • Pytorch: MTCNN (face-recogntion)

Part B: Jestson Nano Orientation (05.26.22 ~ 06.02.22)

• Setup Jetson Nano
  • Connecting Jetson Nano to WIFI.
  • Attaching Raspberry Pi Camera to Jetson Nano.
  • NVIDIA DLI course: https://courses.nvidia.com/courses/course-v1:DLI+S-RX-02+V2/about
  • Running DL task on the Jetson Nano usin DeepStream.

Milestone 2: Experiment with Transfer Learning

Transfer Learning (06.03.22 ~ 06.10.22)

• Enviroment Setup

  • Baseline: https://github.com/kenshohara/3D-ResNets-PyTorch
  • Dataset: UCF-101

• Transfer Learning

  • Model: 3D ResNets for Action Recognition
  • Transfer Learning with UCF-101

TAO (Train, Adapt, and Optimize) (06.11.22 ~ 06.17.22)

• Environment Setup

  • Setup: https://docs.nvidia.com/tao/tao-toolkit/text/tao_toolkit_quick_start_guide.html
  • Dataset: HMDB51
  • Data Preprocessing: https://github.com/NVIDIA-AI-IOT/tao_toolkit_recipes

• Transfer Learning

  • Model: 2D ResNet for Action Recognition
  • Transfer Learning with TAO for action recognition (link)