778077 - REEF BOT-101A: Robotic Sensing with Jetson Orin & Depth Camera
Course Description
This short course is the first completely asynchronous course in the REEF BOT series, and covers essential skills for autonomous systems development. Starting with the Jetson Orin Nano setup, it progresses through sensor fundamentals, focusing on cameras and LIDARs. Participants will learn Qt and OpenCV basics, develop camera applications, and explore various image processing techniques. The curriculum delves into advanced topics like feature detection, camera pose estimation, and background modeling. Finally, it culminates in practical object detection and tracking using state-of-the-art You Only Look Once (YOLO) V5 technology, providing a solid foundation for computer vision and robotics applications. The course equipment will be accessible remotely through a web link/remote desktop. Arrangements may be available for students to schedule on-site/hands-on access to the course equipmentCourse Outline
This short course is the first completely asynchronous course in the REEF BOT series, and covers essential skills for autonomous systems development. Starting with the Jetson Orin Nano setup, it progresses through sensor fundamentals, focusing on cameras and LIDARs. Participants will learn Qt and OpenCV basics, develop camera applications, and explore various image processing techniques. The curriculum delves into advanced topics like feature detection, camera pose estimation, and background modeling. Finally, it culminates in practical object detection and tracking using state-of-the-art You Only Look Once (YOLO) V5 technology, providing a solid foundation for computer vision and robotics applications. The course equipment will be accessible remotely through a web link/remote desktop. Arrangements may be available for students to schedule on-site/hands-on access to the course equipmentLearner Outcomes
• Configure the Hardware and Jetson Orin Nano Development Kit
o Load Software and SDKs
o Learn Qt Basics
o Create Camera Capture and Display Applications
o Understand OpenCV Data Structures and File IO
• Implement Performance Enhancements
o Implement Multi-Threading
o Understand UDA Basics
o Perform Transforms
o Implement Feature Types: SIFT, SURF, ORB
o Implement Feature Matching
• Implement Advanced Techniques
o Homography
o Image Alignment
o Camera Pose Estimation
o Background Modeling
o Image Segmentation
o Scale Space
• Understand Convolutional Neural Network Basics
o YOLO V5 Introduction
o Perception with YOLO V5
o Object Detection
o Object Tracking
Prerequisites
- Proficiency in C++ Language
- Matrix Mathematics