BehaveAI: A biologically inspired video analysis framework that encodes motion as color for object and behavior classification

Summary

BehaveAI is a biologically inspired video analysis framework that converts motion information (direction, speed, acceleration) into color gradients, enabling rapid detection and classification of objects and behavior from video. It addresses the computational challenge of quantifying complex motion in video processing by using a novel color-from-motion encoding strategy that makes motion patterns visually interpretable for both human annotators and automated systems. The tool can track animals or objects, classify their behavior, and handle complex natural scenes.