If you only have 3 servers to choose from, when on the server page hit clear, then update. It should take a few seconds, and then a list of 30 or 40 servers will populate your server list.
To join a 1v1 match, the person usually will give you a server to go to. Normally its an IP address, and then a password. So to go to that server you type in the console:
"connect <Ip address given to you>:<password given to you>
optionally you can do connect <ip address> and then when it says bad password, type password <then the password>
-Cusoman