Use some WD-40 and a little elbow grease and it should come right off. Spray the WD-40 right onto the glue residue, then wipe off with a soft cloth. This will destroy the cloth in the process by having the glue residue build up on it, but the glue will be off your vehicle. When you have cleaned the entire area, ensure you wash the vehicle, as what's left of the WD-40 will attract dust. A good coat of wax afterward will help as well.
Please note: When I specify WD-40, I mean use it and not something else. WD-40 was originally designed to clean the skin on aircraft. It will work as I'm describing. I cannot vouch for any other type of spray lubricant.