Paromita Das
← ALL PROJECTS
Machine learning

Personalization Engine for Content Optimization

A machine learning pipeline on Microsoft's MIND news dataset that groups readers by behavior and predicts what each one will actually click — lifting click-prediction AUC from 0.57 to 0.69.

Personalization Engine modeling overview
Role
Sole builder — data engineering through evaluation
Stack
Python, Pandas, scikit-learn, Matplotlib, Jupyter
Methods
K-Means clustering, logistic regression, feature engineering, ROC-AUC evaluation
Data
Microsoft Research MIND — 160K articles, 15M+ impressions, 1M+ users
01 — The problem

Everyone gets the same homepage.

Most content platforms recommend the same articles to every reader regardless of interest or browsing history. Engagement suffers, click-through drops, and the platform learns nothing about who it is serving.

The question I wanted to answer: how much lift comes from behavior alone, before any deep learning or real-time infrastructure?

02 — Approach

Behavior in, click probability out.

01
Multi-source feature engineering

User behavior logs, article metadata, and historical click activity merged into reader-level behavioral features.

02
K-Means audience segmentation

Clustering groups readers with similar browsing patterns, giving the model a behavioral prior to work from.

03
Logistic regression click model

A deliberately interpretable classifier estimating the probability a given reader clicks a given article.

04
ROC-AUC evaluation

Performance measured against a naive baseline — AUC 0.57 to 0.69, a 21% improvement.

0.57 → 0.69
Click-prediction AUC
+21%
Improvement over baseline
160K
News articles
15M+
Impression logs
03 — Why it matters

Relevance compounds into revenue.

Higher engagement

Better click prediction means more relevant recommendations and deeper sessions.

Revenue upside

More page views and impressions feed advertising yield and subscription conversion.

Editorial insight

Segments tell content teams who they are actually reaching, not just how many.

Interpretable by design

Logistic regression keeps the drivers legible to non-technical stakeholders.

04 — What I'd carry forward

Simple models, honest baselines. The lift is the story.

I chose interpretable methods on purpose. A 21% AUC improvement that an editorial director can follow is worth more than a marginally better black box nobody will act on. Data source: Microsoft Research MIND, a public benchmark for news recommendation.

View the code Next project →
Let's connect

Have a problem your data hasn't answered yet?

Email me