I did as per duckboy answer, I took out the windshield washer tank of the car and took it inside to let it unfreeze. This was a really easy job (look for your own car how to do it) but in my case (a vw jetta city 2009) it was 2x 10mm bolt, an electric connector to the pump and the windshield washer hose comming out of the pump. It took me about 5min to have the tank in my hand out of the car.
If you are going this route I suggest you have some plan ready to avoid making a mess inside with the windshield washer fluid (maybe put it in the bath, a sink, or a larger bucket) because in my case this step wasn't done so I had to improvise at work. I took several plastic bag but there still was fluid comming out of the bags.
I will reinstall the tank in my lunch time later today and I will see if I need to do anything else to unfreeze the hoses (I don't think because there was a rather larger spot of windshield washer under where I was parked so the lines might have just emptied themselves while it was still hot under to hood).
If you are tempted to let the car idle to built up heat to melt the fluid (as per DucatiKiller suggestion in the comments to the question) be aware that after 9+ hours inside, the fluid wasn't all liquid so this might not be a good solution.