This is pretty interesting Question :)
Q] What will be upper bound for following function?
The upper bond of the folowing function will be $O(n^{4})$ I need not explain because you have already seen the reference (https://gateoverflow.in/92780/algorithms-time-complexity) We take modulus of the function and calculate the complexity .
Q] I want to understand how the function looks like if it has recurrance of this form?What is meaning of subtraction here if i talk in terms of programming
Recurrence of the form $T(n)=n^{2} - n^{4} $ has got no meaning in real programming . Perhaps these -ve terms in recurrence relations are introduced just to make confusions . In any standard algorithm or Questions all terms in the recurrence relation denoting a code will always contains positive terms only. There is NO MEANING if subtraction is used in recurrence in terms of programming point of view