Suppose a 6 digit number $N$ is formed by rearranging the digits of the number 123456. If $N$ is divisible by 5, then the set of all possible remainders when $N$ is divided by 45 is