How is the target motion of an object given?

Thanks for the open source work. 
I want to know how the target motion of the object is given, is it output by the network model or is it to shoot the target point cloud first and then let the robot operate?