A series of conjugated polymers (CPs) emitting red, green, and blue (RGB) fluorescence were synthesized via the Suzuki coupling polymerization. Polymer dots (Pdots) were fabricated by the reprecipitation method from corresponding CPs, in which the Pdot surface was functionalized to have an allyl moiety. The CP backbones were based on the phenylene group, causing the Pdots to show identical ultraviolet-visible absorption at 350 nm, indicating that the same excitation wavelength could be used. The Pdots were covalently embedded in poly(N-isopropylacrylamide) (PNIPAM) hydrogel for further use as a thermoresponsive moiety in the polymer hydrogel. The polymer hydrogel with RGB emission colors could provide thermally reversible fluorescence changes. The size of the hydrogel varied with temperature change because of the PNIPAM’s shrinking and swelling. The swollen and contracted conformations of the Pdot-embedded PNIPAM enabled on-and-off fluorescence, respectively. Fluorescence modulation with 20 to 80% of the hydrogel was possible via thermoreversibility. The fluorescent hydrogel could be a new fluorescence-tuning hybrid material that changes with temperature.