Physical virology seeks to define the principles of physics underlying viral infections, traditionally focusing on the fundamental processes governing virus assembly, maturation, and disassembly. A detailed understanding of virus structure and assembly has facilitated the development and analysis of virus-based materials for medical applications. In this Physical Virology review article, we discuss the recent developments in nanomedicine that help us to understand how physical properties affect the in vivo fate and clinical impact of (virus-based) nanoparticles. We summarize and discuss the design rules that need to be considered for the successful development and translation of virus-based nanomaterials from bench to bedside.