Reciprocal Linking vs. Mutual Linking

Some of the advice floating around regarding linking for your site can be pretty confusing, especially when it comes to reciprocal linking. Is it something you have to do? Can your site succeed without reciprocal links? Will you be penalized for reciprocal linking? There are so many conflicting theories. Let's try to clear the subject up a little....