This is my own implementation based on R-C3D's caffe3d: https://github.com/sunnyxiaohu/R-C3D/tree/master/caffe3d