The COVID-19 pandemic remains a global threat, and host immunity remains the main mechanism of protection against the disease. The spike protein on the surface of SARS-CoV-2 is a major antigen and its engagement with human ACE2 receptor plays an essential role in viral entry into host cells. Consequently, antibodies targeting the ACE2-interacting surface (ACE2IS) located in the receptor-binding domain (RBD) of the spike protein can neutralize the virus. However, the understanding of immune responses to SARS-CoV-2 is still limited, and it is unclear how the virus protects this surface from recognition by antibodies. Here, we designed an RBD mutant that disrupts the ACE2IS and used it to characterize the prevalence of antibodies directed to the ACE2IS from convalescent sera of 94 COVID19-positive patients. We found that only a small fraction of RBD-binding antibodies targeted the ACE2IS. To assess the immunogenicity of different parts of the spike protein, we performed in vitro antibody selection for the spike and the RBD proteins using both unbiased and biased selection strategies. Intriguingly, unbiased selection yielded antibodies that predominantly targeted regions outside the ACE2IS, whereas ACE2IS-binding antibodies were readily identified from biased selection designed to enrich such antibodies. Furthermore, antibodies from an unbiased selection using the RBD preferentially bound to the surfaces that are inaccessible in the context of whole spike protein. These results suggest that the ACE2IS has evolved less immunogenic than the other regions of the spike protein, which has important implications in the development of vaccines against SARS-CoV-2.