Applying PCA in Python

In this lesson, we’ll apply Principal Component Analysis (PCA) to reduce the dimensionality of a dataset. This helps simplify the dataset while retaining key information.

Dataset Overview

We will use the Iris dataset, which contains measurements of flower species:

• Features: Sepal length, sepal width, petal length, and petal width.
• Target: Species (Setosa, Versicolor, Virginica).

Step 1: Importing Libraries and Dataset

We’ll start by importing the necessary libraries and loading the dataset:

import pandas as pd
from sklearn.datasets import load_iris

# Load Iris dataset
data = load_iris()
X = pd.DataFrame(data.data, columns=data.feature_names)
y = data.target
print(X.head())

Step 2: Standardizing the Data

PCA is sensitive to the scale of data, so we standardize it using StandardScaler:

from sklearn.preprocessing import StandardScaler

# Standardize the data
scaler = StandardScaler()
X_scaled = scaler.fit_transform(X)

Step 3: Applying PCA

We apply PCA to reduce the dataset to 2 principal components:

from sklearn.decomposition import PCA

# Apply PCA
pca = PCA(n_components=2)
X_pca = pca.fit_transform(X_scaled)
print(f"Explained Variance Ratio: {pca.explained_variance_ratio_}")

Step 4: Visualizing PCA Results

We can visualize the transformed dataset in 2D space to observe how the species are grouped:

import matplotlib.pyplot as plt

# Scatter plot of PCA results
plt.scatter(X_pca[:, 0], X_pca[:, 1], c=y, cmap='viridis')
plt.xlabel('Principal Component 1')
plt.ylabel('Principal Component 2')
plt.title('PCA Results')
plt.colorbar(label='Species')
plt.show()

Step 5: Interpreting PCA Results

The PCA plot shows how the data is distributed in the reduced dimensions. Points of the same species tend to group together, indicating effective clustering.

Advantages of PCA

PCA offers several benefits:

• Reduces data dimensionality, making it easier to visualize.
• Removes noise and redundant features.
• Improves computational efficiency for large datasets.

Challenges of PCA

Some limitations of PCA include:

• Loss of interpretability for transformed features.
• Sensitivity to scaling of features.
• May not capture complex, non-linear relationships in the data.

Summary and Next Steps

In this lesson, we:

• Applied PCA to the Iris dataset for dimensionality reduction.
• Visualized the results and observed species clustering in 2D space.
• Discussed the advantages and challenges of PCA.

Next, we will explore advanced deep learning concepts, starting with artificial neural networks.