"In that given interval" it is continuous as well as differentiable. You should read the definitions of continuity and differentiabilty and check whether it satisfies those properties in that interval.
Also, above function is not constant, it depends on theta, there must be definitely "some theta" where it is not equal to zero. If it would have been constant, then it's derivative i.e. F'(theta) will always be zero.