The "UP" arrow key will make you swim up, "DOWN" arrow key makes you dive down and the "LEFT" and "RIGHT" arrow keys will make you go either way.
Thanks Derpy12 for your help!
