First let the sprite touch your hand, and then it should start to follow your hand. This is only my tryout, I am going to make table tennis or catching things from the air with your hand, if we could hit at least 100 likes and 100 stars.
I got the idea from youtube. Thanks to @awesome-llama