The article affixes a resolutely structuralist view to Alain Badiou’s proposals on the infinite, around the theory of sets. Structuralism is not what is often criticized, to administer mathematical theories, imitating rather more or less philosophical problems. It is rather an attitude in mathematical thinking proper, consisting in solving mathematical problems by structuring data, despite the questions as to foundation. It is the mathematical theory of categories that supports this attitude, thus focusing on the functioning of mathematical work. From this perspective, the thought of infinity will be grasped as that of mathematical work itself, which consists in the deployment of dualities, where it begins the question of the discrete and the continuous, Zeno’s paradoxes. It is, in our opinion, in the interval of each duality ― “between two ends”, as our title states ― that infinity is at work. This is confronted with the idea that mathematics produces theories of infinity, infinitesimal calculus or set theory, which is also true. But these theories only give us a grasp of the question of infinity if we put ourselves into them, if we practice them; then it is indeed mathematical activity itself that represents infinity, which presents it to thought. We show that tools such as algebraic universes, sketches, and diagrams, allow, on the one hand, to dispense with the “calculations” together with cardinals and ordinals, and on the other hand, to describe at leisure the structures and their manipulations thereof, the indefinite work of pasting or glueing data, work that constitutes an object the actual infinity of which the theory of structures is a calculation. Through these technical details it is therefore proposed that Badiou envisages ontology by returning to the phenomenology of his “logic of worlds”, by shifting the question of Being towards the worlds where truths are produced, and hence where the subsequent question of infinity arises.