The "UP" arrow key will make you swim up, "DOWN" arrow key makes you dive down and the "LEFT" and "RIGHT" arrow keys will make you go either way.