Proper regulation of organelle dynamics is critical for cellular function, but the mechanisms coordinating multiple organelles remain poorly understood. Here we show that actin polymerization mediated by the endoplasmic reticulum (ER)-anchored formin INF2 acts as a master regulator of organelle morphology and movement. Using high-resolution imaging, we demonstrate that INF2-polymerized actin filaments assemble at ER contact sites on mitochondria, endosomes, and lysosomes just prior to their fission. Genetic manipulation of INF2 activity alters the size, shape and motility of all three organelles. Our findings reveal a conserved mechanism by which the ER uses actin polymerization to control diverse organelles, with implications for understanding organelle dysfunction in neurodegenerative and other diseases. This work establishes INF2-mediated actin assembly as a central coordinator of organelle dynamics and inter-organelle communication.