That seems correct to me. It lightly emphasizes the particular day that it happened.
If you are primarily describing the cold and how it happened, with little concern for the exact day, you might say, "One day when I was...." This removes the emphasis on the particular day.
If you wanted to emphasize the day even more, you might say," On the day I was...." or "On Saturday when I was...."