Intermittent internet connection

I have Sky router to which I'm connecting via a wireless Belkin adapter. To summarize; I can almost always connect to the router. Despite this however, some of the time I don't actually have one, and it simply shows a caution sign and indicate I have no internet connection. Others it will add the number '2' to my internet connection name and indicate I have internet connection, but when I try...