The heavy metal pollution of soils, resulting from long-term fertilizing activity, is becoming serious in many countries, endangering ecological safety and human health. This study employed inductively coupled plasma-mass spectrometry (ICP-MS) to investigate concentrations of eight heavy metal elements (Cd, Hg, As, Pb, Cr, Cu, Ni, and Zn) in five apple orchard soil profiles after five different cultivation durations, one modern intercropping farmland soil profile, and one natural soil profile from Baishui County, Southeast Chinese Loess Plateau. The potential risk associated with the presence of heavy metals in the soils was assessed by the single-factor pollution index (Pi), Nemerow comprehensive index (NCI), and potential ecological risk index (RI). Results showed that the average concentrations of Cr, Ni, As, Pb, and Hg in the farmland soil were higher than those in the apple orchard soils. The average concentrations of Ni, Cu, As, and Hg in the apple orchard soils reached the highest after 25 years of cultivation. The results imply that concentrations of heavy metals will increase with increasing cultivation time. The farmland soil had the highest NCIs, while the NCIs of the apple orchard soils also increased with cultivation time. Compared with the quality standards of pollution-free orchards and green food production areas, all Pis and NCIs were less than 1 and 0.7, respectively, indicating that the soils were in healthy condition. The RI results also suggest that the soils have a low ecological risk (RI < 150). Although the potential ecological risk is currently low, predicting and reducing heavy metal input should be considered.