While President George W. Bush does his best to stay out of D.C., he will come to town for one man: former Senate Majority Leader Bill Frist (R-Tenn.).

Bush flew in from Texas on Wednesday to honor Frist at the unveiling of his portrait in the Old Senate Chamber.

“It takes a really good friend to get me to come back to Washington,” Bush told the laughing crowd. He joked that he was thrilled to be on hand to watch Frist “hang.”

Senate Majority Leader Harry Reid (D-Nev.) and Minority Leader Mitch McConnell (R-Ky.) honored Frist with speeches about his time in the Senate. Reid called Frist “a man with infinite courage,” while McConnell complimented him for his work in medicine and government.

Sens. Lamar Alexander (R-Tenn.) and John Thune (R-S.D.) were among the many lawmakers who showed up for the unveiling. In fact, a handful of ex-Senators, including Elizabeth Dole (R-N.C.) and Norm Coleman (R-Minn.), also made an appearance.

Frist  praised his family and friends in Congress. “Once you leave the Senate, those relationships never end,” he said.