But Peter was.

For clarity, married men may join the priesthood in the Eastern Rites but priests may not marry. And Eastern Rite bishops must be celibate (they are not chosen from among married priests).