Detachment of cancer cells is the first step in tumor metastasis and malignancy. However, studies on the balance of initial tumor anchoring and detachment are limited. Herein, we revealed that the regulation of cytoskeleton proteins potentiates tumor detachment. The blockage of TGF-β1 using neutralizing antibodies induced cancer cell detachment in the Boyden chamber and 3D in-gel spheroid models. Moreover, treatment with latrunculin B, an actin polymerization inhibitor, enhanced cell dissociation by abolishing actin fibers, indicating that TGF-β1 mediates the formation of actin stress fibers, and is likely responsible for the dynamics of anchoring and detachment. Indeed, latrunculin B disrupted the formation of external TGF-β1-induced actin fibers and translocation of intracellular vinculin, a focal adhesion protein, resulting in the suppression of cell adhesion. Moreover, the silencing of vimentin substantially reduced cell adhesion and enhanced cell detachment, revealing that cell adhesion and focal adhesion protein translocation stimulated by TGF-β1 require vimentin. Using the 3D in-gel spheroid model, we found that latrunculin B suppressed the cell adhesion promoted by external TGF-β1, increasing the number of cells that penetrated the Matrigel and detached from the tumor spheres. Thus, cytoskeleton remodeling maintained the balance of cell anchoring and detachment, and the TGF-β1/vimentin/focal adhesion protein assembly axis was involved in the control dynamics of initial tumor detachment.