Hybrid architecture for understanding motion sequences