The exchange between Trump and Powell occurred on Thursday in the headquarters of the Fed, which is under renovation.