Integer factorization is in NP but not proved to be in NP-Hard or P. So, it can go either way in future. We have 3 choices for $L$ depending on this, but all the 3 choices are CFLs. So, we need not worry anything and just say $L$ is a CFL though we do not know exactly which CFL it is.