Two obvious classes of quasi-injective modules are those of semisimples and injectives. In this paper, we study rings with no quasi-injective modules other than semisimples and injectives. We prove that such rings fall into three classes of rings, namely, (i) QI-rings, (ii) rings with no middle class, or (iii) rings that decompose into a direct product of a semisimple Artinian ring and a strongly prime ring. Thus, we restrict our attention to only strongly prime rings and consider hereditary Noetherian prime rings to shed some light on this mysterious case. In particular, we prove that among these rings, QIS-rings which are not of type (i) or (ii) above are precisely those hereditary Noetherian prime rings which are idealizer rings from non-simple QI-overrings.