You can use Int32.TryParse function and a minor tweak to get the desire result. See below.
Dim Years As Integer
Dim Valid As Boolean = False
Console.WriteLine("Enter a number between -1 and 5")
Do Until Valid = True
If (Int32.TryParse(Console.ReadLine(), Years)) Then
Select Case Years
Case -1 To 5
Valid = True
Console.WriteLine("Good job!!!")
Case Else
Console.WriteLine("The number is outside the range")
End Select
Else
Console.WriteLine("Enter a valid number")
End If
Loop
Console.ReadLine()
Here the link to test it out
VB Console Integer Range[
^]