What Does it mean to be “On the Record?”

What is the difference between being “on the record,” “off the record”, “on background” and “not for attribution”?