This appears to be a Gnome issue; I'm getting the exact same thing (or not getting as the case may be) in Arch Linux. No way to remove a launcher from the panel in fallback mode.
Just found it. Alt+right-click the launcher, and the menu will be there to remove it.