Second this, BookStack is great.

The term to search for is "captive thumbscrew". The captive part being the unthreaded portion which allows the screw to rotate freely in the panel hole. These will tend to be longer than normal thumbscrews you account for the unthreaded part.