Schedule airplane mode based on your settings, e.g. by date/time. Root access is required to write secure system settings!