Just hold down mouse and it will go to you! So glad I finally figured it out!
Thank you @Hiprogramer9 for checking out basically all my projects, go check him out!