For decades, the restaurant was a place where the Memphis powerful met and mingled over a meal. Now, its set to be torn down.