At least for now, however, the longtime radio personality says his plate's already full.
Stern addressed the late-night TV talk show host's retirement announcement while arriving in New York on Friday to judge auditions for NBC's "America's Got Talent."
The 60-year-old stressed Letterman's impact on late-night TV, saying he's sad to see Letterman go.
Stern says he's had a great time during his appearances on the "Late Show with David Letterman."
One person who thinks Stern would be great for the job is fellow "America's Got Talent" judge Heidi Klum. She says he'd be perfect.
Letterman announced Thursday he plans to retire next year.
"America's Got Talent" returns in May.