In this paper, we propose a salient object detection algorithm that considers both background and foreground cues. It integrates both coarse salient region extraction and a top-down background weight map measure via boundary label propagation into a unified optimization framework to acquire a refined salient map. The coarse saliency map is additionally fused by three prior components: a local contrast map with greater alignment to physiological law, a global focus prior map, and a global color prior map. During the formation of the background weight map, we first construct an affinity matrix and select nodes existing on the border as labels to represent the background. Then we perform a propagation to generate the regional background weight map. Our proposed model was verified on four benchmark datasets, and the experimental results demonstrate that our method has excellent performance.