You can either keep it or delete it. We do often say such things as "The store is closed on Mondays". We also say "The store is closed Mondays." Since both statements are ordinary, both versions of your question sound OK.
Another common version splits the preposition from its referent: What days is the library closed on?
 I changed the verb in this version after seeing Panjandrum's and Szkot's remarks.