Yes, in theory, but in reality they charge the ER virtually every time. Kinda like how they have discretion as to who gets the win if the starter doesn't make it 5 innings, but almost always the next guy in gets it, even if he only gets one or two outs.