"You didn't really have a choice when you was like that," he points out, chagrined. "But if you say it you're gonna sound like a fool and an asshole, so I'll stand by."
Other options:
no subject
"You didn't really have a choice when you was like that," he points out, chagrined. "But if you say it you're gonna sound like a fool and an asshole, so I'll stand by."