You will likely be confused from the second you walk in the door until you've ridden the elevator and stepped off in the actual karaoke bar's lobby, but yes, that's where you're heading: a multi-level collection of private karaoke rooms (no public space; be forewarned) with a selection of beer that's a wee bit overpriced (but you can also bring your own). It's K-Town at its best.
5 Bar
38 West 32nd Street