No. Sentence (1) is fine, and "that" refers to whatever has just taken place. This is a very common sentence.
If sentence (2) has "the" added, then it would be correct, but "that" refers to the time that has just been spent doing something. This is a lot less common, and it implies that the time is more important than whatever was done in that time.