In situations like this, always work least aggressive to more/most aggressive. I don't think removing all this is going to be difficult, but it will take a little time and elbow grease.
First, get yourself a bug sponge on Amazon or an auto parts store. O'Reilly and Autozone have the better selection of these types of products. Walmart may have a few if you find yourself there.
Second, order Dark Fury, a Superior Products high alkeline cleaner from O'Reilly. It comes in a smaller portion -- either 16 or 32 oz, I can't remember. Anyway, when you get it dilute it 7:1 (7 oz. water to 1 oz. product) and start working these areas after a heavy rinse and soap down with a NON "pH neutral" car soap (don't use Dawn). Rinse liberally and keep at it. You should see some results at this stage.
Third, if it doesn't come off there, get a Magic Eraser and, on everything but the paint, LIGHTLY (along with a lubricant like a rinseless wash or instant detailer) scrub the area. You SHOULD see good results here.
Fourth, for the paint, first try some wheel cleaner (acidic would actually be good here if you have some). KEEP IT OFF the windshield and other glass. If for whatever reason that doesn't work, some aggressive clay may be needed, along with the above lubricant. If it doesn't come off with that, you'll need to use the Magic Eraser lightly, but you will also need to follow up those areas with a compound and polish as the ME will leave marring.
If you have a heat gun (NOT a torch), you could use that to GENTLY raise the heat in the areas you're working in. Even those hard plastics can take a bit of heat before they start showing any damage, but use that tool very carefully. Use the heat gun with the cleaning products only -- not the stronger chemicals.
On the windows, you can probably just use a 1:1 dilution of water and acetone. Use this conservatively and keep it off other components.