Do you have to connect the router to the computer?

If it is WIFI then you will need to connect it with the cable first to set up the passwords and access keys for wireless. Then, if you have a wireless card on your computer, you won't need the cable after setting it up.