Bacterial DNA/CpG DNA is recognized as a key molecule during the pathogenesis of sepsis. Therefore, preventing CpG DNA from binding to its receptor is considered as the most promising strategy. In the present experiments, Radix et Rhizoma Rhei had the highest CpG DNA-binding ability among the seventy-eight traditional Chinese herbs. After the isolation of silica gel chromatography and high performance liquid chromatography (HPLC) and evaluation with affinity biosensor, the active fraction was confirmed and named Fraction D. It was found that in vitro, Fraction D bound to both CpG DNA and lipid A with high affinity, and strongly inhibited LPS- and CpG DNA-induced TNF-alpha release from RAW264.7 cells in a dose-dependent manner. Furthermore, Fraction D reduced the expression of TLR9 mRNA up-regulated by CpG DNA. In vivo, Fraction D protected mice challenged with lethal heat-killed E. coli. Using HPLC method, two monomers with high affinity for CpG DNA were isolated and identified as rhein and emodin. Rhein could significantly reduce CpG DNA- and LPS-induced TNF-alpha release, but emodin only reduced CpG DNA-induced TNF-alpha release. Rhein in combination with emodin could play synergistic inhibitory effect on both CpG DNA and LPS-induced TNF-alpha release, which contributed to the bioactivity of Fraction D. In conclusion, we successfully established the platform to screen anti-CpG DNA components of traditional Chinese herbs using affinity biosensor technology, got active Fraction D from Radix et Rhizoma Rhei and determined rhein and emodin as the main bioactive ingredients in Fraction D.