Algorithms for generalized Clusterwise linear regression

Young Woong Park*, Yan Jiang, Diego Klabjan, Loren Williams

*Corresponding author for this work

Research output: Contribution to journalArticle

8 Scopus citations

Abstract

Clusterwise linear regression (CLR), a clustering problem intertwined with regression, finds clusters of entities such that the overall sum of squared errors from regressions performed over these clusters is minimized, where each cluster may have different variances. We generalize the CLR problem by allowing each entity to have more than one observation and refer to this as generalized CLR. We propose an exact mathematical programming-based approach relying on column generation, a column generation-based heuristic algorithm that clusters predefined groups of entities, a metaheuristic genetic algorithm with adapted Lloyd's algorithm for K-means clustering, a two-stage approach, and a modified algorithm of Späth [Späth (1979) Algorithm 39 clusterwise linear regression. Comput. 22(4):367-373] for solving generalized CLR. We examine the performance of our algorithms on a stock-keeping unit (SKU)-clustering problem employed in forecasting halo and cannibalization effects in promotions using real-world retail data from a large supermarket chain. In the SKU clustering problem, the retailer needs to cluster SKUs based on their seasonal effects in response to promotions. The seasonal effects result from regressions with predictors being promotion mechanisms and seasonal dummies performed over clusters generated. We compare the performance of all proposed algorithms for the SKU problem with real-world and synthetic data.

Original languageEnglish (US)
Pages (from-to)301-317
Number of pages17
JournalINFORMS Journal on Computing
Volume29
Issue number2
DOIs
StatePublished - Mar 1 2017

Keywords

  • Clustering
  • Data mining
  • Optimization
  • Regression

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Computer Science Applications
  • Management Science and Operations Research

Fingerprint Dive into the research topics of 'Algorithms for generalized Clusterwise linear regression'. Together they form a unique fingerprint.

Cite this