Phase 05 ยท Correlation Analysis

๐Ÿ“Š

Analytics

I ran 4 analytics notebooks against the Gold master risk profile โ€” computing Pearson correlations, time-series trends, factor group analyses, and quintile breakdowns to identify which environmental and lifestyle factors show the strongest associations with U.S. cancer rates.

4Notebooks
r=0.885Top Correlation
41States Declining
17Factors Analyzed
Bronze Silver Gold Analytics Machine Learning

What the Analytics Phase Does

The analytics phase investigates potential associations between U.S. cancer rates and environmental, lifestyle, and food environment factors using the Gold master risk profile as the single source of truth. I compute Pearson correlations between all 17 factors and cancer outcomes, analyze 24-year incidence trends by state, and perform quintile breakdowns to test dose-response patterns.

All analysis is done at the state level (n=51). This means correlations capture macro-level patterns across states โ€” individual-level or county-level analysis would likely reveal stronger environmental signals. The findings are presented with this caveat: statistical association does not imply causation, and lifestyle factors may mediate or confound environmental exposures.

The most important finding from the analytics phase: lifestyle factors (COPD, smoking, obesity) dominate at r=0.68 group average vs environmental factors at r=0.11 group average. However, PM2.5 exposure days emerged as a non-linear predictor surfaced only through the ML models โ€” not visible in Pearson correlation.

Analytics Notebooks

01
Cancer Trends Analysis
01_cancer_trends_analysis.py

Analyzes 24-year cancer incidence and mortality trends (1999โ€“2022) by state. Computes mortality-to-incidence ratios, identifies persistent high-burden states, and compares early vs late period averages to classify states as Increasing, Stable, or Decreasing.

Key finding: 41 of 51 states show declining cancer incidence. Tennessee (+40 rate points) and Arkansas (+24.8) are trending upward โ€” the only states worsening significantly.
02
Air Quality Correlation
02_air_quality_correlation.py

Computes Pearson correlations between 5 AQI metrics and cancer outcomes, joins annual AQI data with cancer data for a 2000โ€“2022 time-series comparison, and runs a quintile analysis grouping states by AQI level.

Key finding: While overall AQI improved slightly, PM2.5 exposure days nearly doubled from 83 to 151 annually โ€” a hidden trend masked by aggregate AQI scores.
03
Water Violations Analysis
03_water_violations_analysis.py

Analyzes health-based water violation trends from 1990โ€“2024, correlates violation counts with cancer rates, and runs a quintile breakdown to test whether higher violation burden states have higher cancer mortality.

Key finding: Weak correlation (r<0.15) at state level โ€” enforcement improved dramatically (70% โ†’ 99%) but violation count alone doesn't predict cancer rates at this aggregation level.
04
Multi-Factor Correlation Matrix
04_multi_factor_correlation.py

The central analytical notebook โ€” computes a full Pearson correlation matrix between all 17 environmental, lifestyle, and food environment factors and cancer outcomes. Ranks factors by correlation strength and computes group-level averages.

Key finding: COPD (r=0.885) and smoking (r=0.846) are the strongest predictors. Lifestyle group avg |r|=0.682 vs environmental group avg |r|=0.109 โ€” a 6ร— difference in signal strength.