'Celestial' is an adjective, old-fashioned but still in use. You might still see it used to refer to things relating to stars as well as the earthly sky. 'Welkin' is an old, completely dead word for 'sky'. I've never really understood 'firmament'; it's what translates the Hebrew word in Genesis for the sky as a solid sphere with the stars on it . . . or something like that.