Great progress has been made in the dynamic mechanical properties of concrete which is usually assumed to be homogenous. In fact, concrete is a typical heterogeneous material, and the meso-scale structure with aggregates has a significant effect on its macroscopic mechanical properties of concrete. In this paper, concrete is regarded as a two-phase composite material, that is, a combination of aggregate inclusion and mortar matrix. To create the finite element (FE) models, the Monte Carlo method is used to place the aggregates as random inclusions into the mortar matrix of the cylindrical specimens. To validate the numerical simulations of such an inclusion-matrix model at high strain rates, the comparisons with experimental results using the split Hopkinson pressure bar are made and good agreement is achieved in terms of dynamic increasing factor. By performing more extensive FE predictions, the influences of aggregate size and content on the macroscopic dynamic properties (i.e., peak dynamic strength) of concrete materials subjected to high strain rates are further investigated based on the back-propagation (BP) artificial neural network method. It is found that the particle size of aggregate has little effect on the dynamic mechanical properties of concrete but the peak dynamic strength of concrete increases obviously with the content increase of aggregate. After detailed comparisons with FE simulations, machine learning predictions based on the BP algorithm show good applicability for predicting dynamic mechanical strength of concrete with different aggregate sizes and contents. Instead of FE analysis with complicated meso-scale aggregate pre-processing, time-consuming simulation and laborious post-processing, machine learning predictions reproduce the stress–strain curves of concrete materials under high strain rates and thus the constitutive behavior can be efficiently predicted.