This is not in the meaning of 'between', but usually the only good reason for saying 'between 3 and 6' is to imply that it's not true before 3 or after 6. If the times were different, the only natural thing is to say the correct times. 'We serve tea between 3 and 6. In fact we serve it all day' sounds like a joke.