Can you look up classic wow characters on the armory?

Yes, the official armory on the wow site covers classic characters now, you just have to pick the classic version and realm in the character search instead of retail, otherwise it says the character doesn't exist. It's mostly gear and the basics though. If you want to see how someone actually plays, warcraftlogs is better, as long as they've raided with someone who logs.