I think we'd have noticed the destruction of Jerusalem in the archaeological record. (Rather conveniently, the location of Jerusalem shifted slightly over the centuries, so the oldest part is mostly not covered today by the Old City, or the Temple Mount.)