For peace of mind I suggest that you get a small Oil radiator and keep it on all night (just use and extension cable; passes through window!).
If you cant use an extension cable, then buy a good Inverter 500 to 1000 watts. and use a 12 volt 300 watt heater, all you need is another 12 volt battery which can be recharged during the day.