Most real-time video processing systems/techniques only address relationships of objects within the same frame, disregarding time information. Optical flow accounts for this temporal relationship between frames.

Advances in Optical Flow have changed the game in Object Tracking and Human Activity Recognition in videos.

Here’s a blog post explaining the fundamentals and giving you all the code you need to implement it: https://blog.nanonets.com/optical-flow/