Gastrointestinal cancer is highly associated with inflammatory processes inducing the release of cytokines from cancer or immune cells, including interferons, interleukins, chemokines, colony-stimulating factors, and growth factors, which promote or suppress tumor progression. Inflammatory cytokines within the tumor microenvironment promote immune cell infiltration. Infiltrating immune, and tumor-surrounding stromal cells support tumor growth, angiogenesis, metastasis, and immunosuppression through communication with inflammatory cytokines and cell adhesion molecules. Notably, infiltrating immune and tumor cells present immunosuppressive molecules, such as programmed death-ligand 1 (PD-L1) and CD80/CD86. Suppression of cytotoxic T cells promotes tumor avoidance of immune surveillance and greater malignancy. Moreover, glycosylation and sialylation of proteins hyperexpressed on the cancer cell surface have been shown to enhance immune escape and metastasis. Cytokine treatments and immune checkpoint inhibitors are widely used in clinical practice. However, the tumor microenvironment is a rapidly changing milieu involving several factors. In this review, we have provided a summary of the interactions of inflammation and cell adhesion molecules between cancer and other cell types, to improve understanding of the tumor microenvironment.