SAN FRANCISCO (KCBS) – San Francisco Mayor Ed Lee is downplaying speculation that he could be nominated for Secretary of Housing and Urban Development if Hillary Clinton is elected president.

READ MORE: Fremont Police Release Body Cam Footage In Fatal Shooting Of Suspect On Highway 84

Sources in the Clinton camp suggest Lee is on their short list for the HUD job.

Mayor Lee told KCBS he is flattered, but he is focused right now on the job he has.

READ MORE: Man Arrested Following Pursuit, Multiple Hit-&-Run Crashes In San Bruno

“I’m really am not even thinking about it,” Lee said at an event on Friday. “The only cabinet I’m thinking about are the carpenters and what they do for me and with us to rebuild public housing, building more affordable housing. That’s what I’m focused on.”

The mayor jokes that given his height, he’s always on a short list.

MORE NEWS: COVID Job Market: Signs Of Recovery As California Adds Jobs For 2nd Month

Big city mayors are often tapped for the nation’s top housing position. Right now, the department is led by former San Antonio Mayor Julian Castro.