<p>Forecasting cloud accurately is still a challenge in numerical weather prediction (NWP) models. Detailed qualitative evaluation of such forecasts is needed in order to improve the forecasts. Cloud cover is often used for the evaluation but it is not a good metric due to inconsistency in methods for assessing the cloud cover. Global horizontal irradiance (GHI), also referred to as &#8220;global radiation&#8221;, provides an objective and quantitative measure for evaluating cloud forecasts during daytime.</p><p>Non-dimensional indices for solar energy resource assessment have been developed in recent years and decades that are very useful. One such index<br>is the clear sky index (CSI), which is the GHI divided by the theoretical GHI during clear sky conditions (e.g. [1,2]). We use the theoretical GHI clear sky model of [3,4], which includes coefficients that account for variable integrated atmospheric water vapour, aerosols and ozone. We have used binned CSI data computed using HARMONIE-AROME NWP forecast data and observations to identify model deficiencies in cloud and to evaluate new model physics options and settings. Sample results include the identification of consistent negative GHI biases under the thickest clouds and positive biases under Stratocumulus clouds. Such results help to pin-point deficiencies in the HARMONIE-AROME NWP model.</p><p><br>[1] Perez, R.; Ineichen, P.; Seals, R.; Zelenka, A. Making full use of the clearness index for parameterizing hourly insolation conditions. Sol. Energy 1990, 45, 111&#8211;114.</p><p>[2] Skartveit, A.; Olseth, J.A.; Tuft, M.E. An hourly diffuse fraction model with correction for variability and surface albedo. Sol. Energy 1998, 63, 173&#8211;183.</p><p>[3] Savij&#228;rvi, H. Fast radiation parameterization schemes for mesoscale and short-range forecast models. J. Appl. Meteorol. 1990, 437&#8211;447.</p><p>[4] Gleeson, E.; Nielsen, K.P.; Toll, V.; Rontu, L.; Whelan, E. Shortwave Radiation Experiments in HARMONIE. Tests of the cloud inhomogeneity factor and a new cloud liquid optical property scheme compared to observations. ALADIN-HIRLAM Newsl. 2015, 5, 92&#8211;106.</p>