Tuesday's edition of "The Late Show With Stephen Colbert" closed with a performance by a Grammy winner. H.E.R., that critically…