Think I got an AI vs AI mode to work, I replaced it with the 2-player mode since it was easier for me to use existing assets and code then making new ones.
There is this weird bug where the collider for the left paddle (where P1 would be) being completely detached from the paddle. I wasn't able to find the code that runs that and fix it. Other than that It works most of the time.