$T(n)=10T(n/3)+17n^{1.2}$
Using the Master Theorem:
$a=10$, $b=3$, and $f(n)=17n^{1.2}$
Calculate:
$n^{\log_b a}=n^{\log_3 10}$
Since $\log_3 10\approx 2.096$, $n^{1.2}$ grows slower than $n^{\log_3 10}$.
Therefore, this is Master Theorem Case $1$.
$T(n)=\Theta(n^{\log_3 10})$
Answer: B. $O(n^{\log_3 10})$