There are thousands of gas bottles sitting outside houses all around NZ, some sheltered, some not, but if you want gas heating/cooking/hot water, you need a cylinder unless you are in parts of the North Island where there is piped gas. Temperatures range from -10*C or lower, to the high 30s.
A ventilated shelter would be a good idea anywhere.
Ian S C