Background: Recurrent stress urinary incontinence (SUI) following male sling can be managed surgically with artificial urinary sphincter (AUS) insertion. Prior small, single-center retrospective studies have not demonstrated an association between having failed a sling procedure and worse AUS outcomes. The aim of this study was to compare outcomes of primary AUS placement in men who had or had not undergone a previous sling procedure. Methods: A retrospective review of all AUS devices implanted at a single academic center during 2000–2018 was performed. After excluding secondary AUS placements, revision and explant procedures, 135 patients were included in this study, of which 19 (14.1%) patients had undergone prior sling procedures. Results: There was no significant difference in demographic characteristics between patients undergoing AUS placement with or without a prior sling procedure. Average follow up time was 28.0 months. Prior sling was associated with shorter overall device survival, with an increased likelihood of requiring revision or replacement of the device (OR 4.2 (1.3–13.2), p = 0.015) as well as reoperation for any reason (OR 3.5 (1.2–9.9), p = 0.019). While not statistically significant, patients with a prior sling were more likely to note persistent incontinence at most recent follow up (68.8% vs. 42.7%, p = 0.10). Conclusions: Having undergone a prior sling procedure is associated with shorter device survival and need for revision or replacement surgery. When considering patients for sling procedures, patients should be counseled regarding the potential for worse AUS outcomes should they require additional anti-incontinence procedures following a failed sling.