• edited by
803 views
1 1 vote

For a classification problem, Principal Component Analysis (PCA) has been used to reduce the dimensionality of a feature space from $100$ to $10$.

Which of the following options is true about the angle $\theta$ between the first and the tenth principal components?

  1. $\theta=0^{\circ}$
  2. $\theta=90^{\circ}$
  3. $90^{\circ}<\theta \leq 180^{\circ}$
  4. $0<\theta<90^{\circ}$

2 Answers

2 2 votes

You can see at the corner of your room that there is   : 

  • 1 left edge of the floor.

  • 1 right edge of the floor.

  • And A vertical line going up the wall.

All have 90 degree angle between them. 
 
Every single Principal Component (PC1, PC2, PC10, PC99) acts exactly like  edges in the corner.
That's why answer is 90 Degree. 
Option B = Correct 
1 1 vote
In PCA:

1) The first principal component captures the direction of maximum variance.

2) All principal components are mutually orthogonal (i.e., pairwise perpendicular).

Since principal components are orthogonal eigenvectors of the covariance matrix,

\[
v_i^T v_j = 0 \quad \text{for } i \ne j
\]

Hence, the angle between any two distinct principal components:

\[
\cos \theta = 0
\]

Therefore,

\[
\theta = 90^\circ
\]

Correct option:
\[
{(B)}
\]
• moved by
Answer:
Position:
Show:

Related questions

0 0 votes
0 0 answers
203
203 views
GO Classes asked Mar 31, 2025
203 views
Consider a centered design matrix $X \in \mathbb{R}^{n \times d}$, where $n$ is the number of examples and $d$ is the dimension of the data. The principal components of $...