A Cascaded Generative Approach for e-Commerce Recommendations

Authors: Moein Hasani, Hamidreza Shahidi, Trace Levinson et al.

arXiv · PDF

Summary

The authors redesigned a large e-commerce storefront using a cascaded generative approach: first, an LLM generates themes for each page section ("placement"), then generates constrained keywords per placement to retrieve products. They use teacher-student fine-tuning to make this scalable under production latency and cost constraints, with fine-tuned models approaching closed-weight LLM performance. AI-driven content evaluation and quality filtering enable safe automated deployment. The generative output is fused with traditional ranking models. Online experiments show +2.7% lift in cart adds per page view over the baseline.

Main takeaways:

• Traditional e-commerce storefronts are rigid: static themes, independent retrieval, pointwise rankers—limits personalization and semantic cohesion.
• Cascaded generative approach: LLM generates placement themes, then generates keywords per placement to power product retrieval.
• Teacher-student fine-tuning makes this scalable and fast enough for production; fine-tuned models nearly match closed-weight LLM performance.
• AI-driven evaluation and quality filtering enable safe automated deployment of dynamic content at scale.
• Generative output fused with traditional rankers to preserve existing infrastructure; online A/B test shows +2.7% cart-add lift.

Relevance

Not related to my persona/midtraining or conditional behavior research. This is an applied e-commerce recommendation system using LLMs for content generation—no connection to behavioral installation, persona switching, or the mechanisms I'm studying.

Threat model

Potential threat/caveat for clean result "Fine-tuning one persona on a two-marker chunk and another on the start marker plants the end marker at every donor answer's end, not chained to the start (LOW confidence)": this item discusses evaluation.

Abstract

arXiv:2605.11118v1 Announce Type: new Abstract: Personalized storefronts in large e-commerce marketplaces are often assembled from many independent components: static themes per page section ("placement"), retrieval systems to fetch eligible products per placement, and pointwise rankers to order content. While effective in optimizing for aggregate preferences, this paradigm is rigid and can limit personalization and semantic cohesion across the page. This makes it poorly suited to support dynamic objectives and merchandising requirements over time. To address this, we introduce a cascaded merchandising framework that decomposes storefront construction into two generative tasks: (i) placement-level theme generation and (ii) constrained keyword generation per placement to power product retrieval. Teacher-student fine-tuning is leveraged to improve scalability of this framework under production latency and cost constraints. Fine-tuned model ablations are shown to approach closed-weight LLM performance. We further contribute frameworks for AI-driven content evaluation and quality filtering, enabling safe and automated deployment of dynamic content at scale. Generative output is fused with traditional ranking models to preserve hybrid infrastructure. In online experiments, this framework yields an estimated +2.7% lift in cart adds per page view over a strong baseline.