Optical nonreciprocity is an essential property for a wide range of applications, such as building nonreciprocal optical devices that include isolators and circulators. The realization of optical nonreciprocity relies on breaking the symmetry associated with Lorentz reciprocity, which typically requires stringent conditions such as introducing a strong magnetic field or a high-finesse cavity with nonreciprocal coupling geometry. Here we discover that the collision effect of thermal atoms, which is undesirable for most studies, can induce broadband optical nonreciprocity. By exploiting the thermal atomic collision, we experimentally observe magnet-free and cavity-free optical nonreciprocity, which possesses a high isolation ratio, ultrabroad bandwidth, and low insertion loss simultaneously. The maximum isolation ratio is close to 40 dB, while the insertion loss is less than 1 dB. The bandwidth for an isolation ratio exceeding 20 dB is over 1.2 GHz, which is 2 orders of magnitude broader than typical resonance-enhanced optical isolators. Our work paves the way for the realization of high-performance optical nonreciprocal devices and provides opportunities for applications in integrated optics and quantum networks.