Chastity and virginity played various roles in the pluralistic religious landscape of the Roman Empire in late antiquity. As Christian authors increasingly came to promote chastity and virginity as a mark of ascetic and distinctive Christian virtues and ideals, the "chaste pagans" and the sacred virgins of contemporary religious groups came to play different rhetorical functions, not only in the texts addressed to sacred Christian virgins, but also in other contexts. Among the most renowned of these contemporary chaste pagans were the Roman Vestal virgins. There were however also other institutions and individuals that had reached fame for their chastity and renunciation of sex. This article examines different representations of Vestal virgins and chaste pagans in Christian texts up until early fifth century, and looks at how they, as "proximate others" to the Christian authors, came to serve various rhetorical functions in the negotiations and delineations in the definition of Christian asceticism and "true," i.e., orthodox Christianity.