Abstract—This paper presents a novel method for background estimation in a video sequence from the function estimation point of view. The proposed algorithm, called Kernel-based Background Learning (KBL), is designed based on kernel machine joint with learning schemes. In order to estimate background using KBL algorithm, we first interpret foreground samples as outliers relative to the background ones and so propose an Outlier Separator (OS). Then, the obtained results of OS algorithm are employed in the KBL method in order to train and estimate background in each pixel. Experimental results show the high accuracy and effectiveness of the proposed method in background estimation and foreground detection for the scenes including moving backgrounds, camera shakes, and non-empty backgrounds.

Keywords