On the other hand, if you start with sandpaper that's too fine, it'll take forever to sand out defects. In most cases, 80-grit paper is a good starting point for sanding planed or shaped wood.
Just apply pressure as if pressing down on imaginary keys with each finger quickly and repeatedly for two minutes every day.