That, of course, is up to you. It all depends on what kind of finish you want to put on it. If you are happy with the finish it has now, then leave it. If you want a high gloss mirror finish then you may want to buff it. I usually level the surface before buffing. This can be done with either high grit sandpaper (wet sanding works better here), or steel wool.
Some people use a multi-step buffing system that can level a certain amount of imperfection in the surface. Usually there are three steps of buffing, a somewhat aggressive abrasive, a fine polishing abrasive and a wax. They must be used with separate buffing wheels. Nothing puts a mirror finish on a piece like a properly buffed lacquer finish.