See, it has never been said that an infinite language can't be regular.
For a language to be regular, it should satisfy kleens's theorem, which is two way.
That is, a language is regular iff it can be obtained from finite language by applying three operations- union, concatenation and Kleene star.
Also a language is regular iff regular expression, regular grammar, finite automata exist for it.