Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1 | #!/usr/bin/env python |
| 2 | # |
| 3 | # Copyright (C) 2008 The Android Open Source Project |
| 4 | # |
| 5 | # Licensed under the Apache License, Version 2.0 (the "License"); |
| 6 | # you may not use this file except in compliance with the License. |
| 7 | # You may obtain a copy of the License at |
| 8 | # |
| 9 | # http://www.apache.org/licenses/LICENSE-2.0 |
| 10 | # |
| 11 | # Unless required by applicable law or agreed to in writing, software |
| 12 | # distributed under the License is distributed on an "AS IS" BASIS, |
| 13 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. |
| 14 | # See the License for the specific language governing permissions and |
| 15 | # limitations under the License. |
| 16 | |
| 17 | """ |
| 18 | Given a target-files zipfile, produces an OTA package that installs |
| 19 | that build. An incremental OTA is produced if -i is given, otherwise |
| 20 | a full OTA is produced. |
| 21 | |
| 22 | Usage: ota_from_target_files [flags] input_target_files output_ota_package |
| 23 | |
Doug Zongker | afb32ea | 2011-09-22 10:28:04 -0700 | [diff] [blame] | 24 | -k (--package_key) <key> Key to use to sign the package (default is |
| 25 | the value of default_system_dev_certificate from the input |
| 26 | target-files's META/misc_info.txt, or |
| 27 | "build/target/product/security/testkey" if that value is not |
| 28 | specified). |
| 29 | |
| 30 | For incremental OTAs, the default value is based on the source |
| 31 | target-file, not the target build. |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 32 | |
| 33 | -i (--incremental_from) <file> |
| 34 | Generate an incremental OTA using the given target-files zip as |
| 35 | the starting build. |
| 36 | |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 37 | --full_radio |
| 38 | When generating an incremental OTA, always include a full copy of |
| 39 | radio image. This option is only meaningful when -i is specified, |
| 40 | because a full radio is always included in a full OTA if applicable. |
| 41 | |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 42 | --full_bootloader |
| 43 | Similar to --full_radio. When generating an incremental OTA, always |
| 44 | include a full copy of bootloader image. |
| 45 | |
Tao Bao | edb35b8 | 2017-10-30 16:07:13 -0700 | [diff] [blame] | 46 | --verify |
| 47 | Remount and verify the checksums of the files written to the system and |
| 48 | vendor (if used) partitions. Non-A/B incremental OTAs only. |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 49 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 50 | -o (--oem_settings) <main_file[,additional_files...]> |
| 51 | Comma seperated list of files used to specify the expected OEM-specific |
| 52 | properties on the OEM partition of the intended device. |
| 53 | Multiple expected values can be used by providing multiple files. |
| 54 | |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 55 | --oem_no_mount |
| 56 | For devices with OEM-specific properties but without an OEM partition, |
| 57 | do not mount the OEM partition in the updater-script. This should be |
| 58 | very rarely used, since it's expected to have a dedicated OEM partition |
| 59 | for OEM-specific properties. Only meaningful when -o is specified. |
| 60 | |
Tao Bao | 337633f | 2017-12-06 15:20:19 -0800 | [diff] [blame] | 61 | --wipe_user_data |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 62 | Generate an OTA package that will wipe the user data partition |
| 63 | when installed. |
| 64 | |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 65 | --downgrade |
| 66 | Intentionally generate an incremental OTA that updates from a newer |
| 67 | build to an older one (based on timestamp comparison). "post-timestamp" |
| 68 | will be replaced by "ota-downgrade=yes" in the metadata file. A data |
| 69 | wipe will always be enforced, so "ota-wipe=yes" will also be included in |
Tao Bao | 4996cf0 | 2016-03-08 17:53:39 -0800 | [diff] [blame] | 70 | the metadata file. The update-binary in the source build will be used in |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 71 | the OTA package, unless --binary flag is specified. Please also check the |
| 72 | doc for --override_timestamp below. |
| 73 | |
| 74 | --override_timestamp |
| 75 | Intentionally generate an incremental OTA that updates from a newer |
| 76 | build to an older one (based on timestamp comparison), by overriding the |
| 77 | timestamp in package metadata. This differs from --downgrade flag: we |
| 78 | know for sure this is NOT an actual downgrade case, but two builds are |
| 79 | cut in a reverse order. A legit use case is that we cut a new build C |
| 80 | (after having A and B), but want to enfore an update path of A -> C -> B. |
| 81 | Specifying --downgrade may not help since that would enforce a data wipe |
| 82 | for C -> B update. The value of "post-timestamp" will be set to the newer |
| 83 | timestamp plus one, so that the package can be pushed and applied. |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 84 | |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 85 | -e (--extra_script) <file> |
| 86 | Insert the contents of file at the end of the update script. |
| 87 | |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 88 | -2 (--two_step) |
| 89 | Generate a 'two-step' OTA package, where recovery is updated |
| 90 | first, so that any changes made to the system partition are done |
| 91 | using the new recovery (new kernel, etc.). |
| 92 | |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 93 | --block |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 94 | Generate a block-based OTA for non-A/B device. We have deprecated the |
| 95 | support for file-based OTA since O. Block-based OTA will be used by |
| 96 | default for all non-A/B devices. Keeping this flag here to not break |
| 97 | existing callers. |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 98 | |
Doug Zongker | 2556848 | 2014-03-03 10:21:27 -0800 | [diff] [blame] | 99 | -b (--binary) <file> |
| 100 | Use the given binary as the update-binary in the output package, |
| 101 | instead of the binary in the build's target_files. Use for |
| 102 | development only. |
| 103 | |
Martin Blumenstingl | 374e114 | 2014-05-31 20:42:55 +0200 | [diff] [blame] | 104 | -t (--worker_threads) <int> |
| 105 | Specifies the number of worker-threads that will be used when |
| 106 | generating patches for incremental updates (defaults to 3). |
| 107 | |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 108 | --stash_threshold <float> |
| 109 | Specifies the threshold that will be used to compute the maximum |
| 110 | allowed stash size (defaults to 0.8). |
Tao Bao | 9bc6bb2 | 2015-11-09 16:58:28 -0800 | [diff] [blame] | 111 | |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 112 | --log_diff <file> |
| 113 | Generate a log file that shows the differences in the source and target |
| 114 | builds for an incremental package. This option is only meaningful when |
| 115 | -i is specified. |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 116 | |
| 117 | --payload_signer <signer> |
| 118 | Specify the signer when signing the payload and metadata for A/B OTAs. |
| 119 | By default (i.e. without this flag), it calls 'openssl pkeyutl' to sign |
| 120 | with the package private key. If the private key cannot be accessed |
| 121 | directly, a payload signer that knows how to do that should be specified. |
| 122 | The signer will be supplied with "-inkey <path_to_key>", |
| 123 | "-in <input_file>" and "-out <output_file>" parameters. |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 124 | |
| 125 | --payload_signer_args <args> |
| 126 | Specify the arguments needed for payload signer. |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 127 | """ |
| 128 | |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 129 | from __future__ import print_function |
| 130 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 131 | import sys |
| 132 | |
Doug Zongker | cf6d5a9 | 2014-02-18 10:57:07 -0800 | [diff] [blame] | 133 | if sys.hexversion < 0x02070000: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 134 | print("Python 2.7 or newer is required.", file=sys.stderr) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 135 | sys.exit(1) |
| 136 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 137 | import multiprocessing |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 138 | import os.path |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 139 | import subprocess |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 140 | import shlex |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 141 | import tempfile |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 142 | import zipfile |
| 143 | |
| 144 | import common |
Doug Zongker | c494d7c | 2009-06-18 08:43:44 -0700 | [diff] [blame] | 145 | import edify_generator |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 146 | import sparse_img |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 147 | |
| 148 | OPTIONS = common.OPTIONS |
Doug Zongker | afb32ea | 2011-09-22 10:28:04 -0700 | [diff] [blame] | 149 | OPTIONS.package_key = None |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 150 | OPTIONS.incremental_source = None |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 151 | OPTIONS.verify = False |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 152 | OPTIONS.patch_threshold = 0.95 |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 153 | OPTIONS.wipe_user_data = False |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 154 | OPTIONS.downgrade = False |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 155 | OPTIONS.timestamp = False |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 156 | OPTIONS.extra_script = None |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 157 | OPTIONS.worker_threads = multiprocessing.cpu_count() // 2 |
| 158 | if OPTIONS.worker_threads == 0: |
| 159 | OPTIONS.worker_threads = 1 |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 160 | OPTIONS.two_step = False |
Takeshi Kanemoto | e153b34 | 2013-11-14 17:20:50 +0900 | [diff] [blame] | 161 | OPTIONS.no_signing = False |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 162 | OPTIONS.block_based = True |
Doug Zongker | 2556848 | 2014-03-03 10:21:27 -0800 | [diff] [blame] | 163 | OPTIONS.updater_binary = None |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 164 | OPTIONS.oem_source = None |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 165 | OPTIONS.oem_no_mount = False |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 166 | OPTIONS.fallback_to_full = True |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 167 | OPTIONS.full_radio = False |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 168 | OPTIONS.full_bootloader = False |
Tao Bao | d47d8e1 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 169 | # Stash size cannot exceed cache_size * threshold. |
| 170 | OPTIONS.cache_size = None |
| 171 | OPTIONS.stash_threshold = 0.8 |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 172 | OPTIONS.log_diff = None |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 173 | OPTIONS.payload_signer = None |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 174 | OPTIONS.payload_signer_args = [] |
Tao Bao | 5f8ff93 | 2017-03-21 22:35:00 -0700 | [diff] [blame] | 175 | OPTIONS.extracted_input = None |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 176 | OPTIONS.key_passwords = [] |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 177 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 178 | METADATA_NAME = 'META-INF/com/android/metadata' |
Tao Bao | 6b0b2f9 | 2017-03-05 11:38:11 -0800 | [diff] [blame] | 179 | UNZIP_PATTERN = ['IMAGES/*', 'META/*'] |
| 180 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 181 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 182 | def SignOutput(temp_zip_name, output_zip_name): |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 183 | pw = OPTIONS.key_passwords[OPTIONS.package_key] |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 184 | |
Doug Zongker | 951495f | 2009-08-14 12:44:19 -0700 | [diff] [blame] | 185 | common.SignFile(temp_zip_name, output_zip_name, OPTIONS.package_key, pw, |
| 186 | whole_file=True) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 187 | |
| 188 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 189 | def AppendAssertions(script, info_dict, oem_dicts=None): |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 190 | oem_props = info_dict.get("oem_fingerprint_properties") |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 191 | if not oem_props: |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 192 | device = GetBuildProp("ro.product.device", info_dict) |
| 193 | script.AssertDevice(device) |
| 194 | else: |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 195 | if not oem_dicts: |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 196 | raise common.ExternalError( |
| 197 | "No OEM file provided to answer expected assertions") |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 198 | for prop in oem_props.split(): |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 199 | values = [] |
| 200 | for oem_dict in oem_dicts: |
| 201 | if oem_dict.get(prop): |
| 202 | values.append(oem_dict[prop]) |
| 203 | if not values: |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 204 | raise common.ExternalError( |
| 205 | "The OEM file is missing the property %s" % prop) |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 206 | script.AssertOemProperty(prop, values) |
| 207 | |
| 208 | |
Tao Bao | ebce697 | 2017-03-06 10:22:20 -0800 | [diff] [blame] | 209 | def _LoadOemDicts(script, recovery_mount_options=None): |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 210 | """Returns the list of loaded OEM properties dict.""" |
| 211 | oem_dicts = None |
| 212 | if OPTIONS.oem_source is None: |
| 213 | raise common.ExternalError("OEM source required for this build") |
Tao Bao | ebce697 | 2017-03-06 10:22:20 -0800 | [diff] [blame] | 214 | if not OPTIONS.oem_no_mount and script: |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 215 | script.Mount("/oem", recovery_mount_options) |
| 216 | oem_dicts = [] |
| 217 | for oem_file in OPTIONS.oem_source: |
| 218 | oem_dicts.append(common.LoadDictionaryFromLines( |
| 219 | open(oem_file).readlines())) |
| 220 | return oem_dicts |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 221 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 222 | |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 223 | def _WriteRecoveryImageToBoot(script, output_zip): |
| 224 | """Find and write recovery image to /boot in two-step OTA. |
| 225 | |
| 226 | In two-step OTAs, we write recovery image to /boot as the first step so that |
| 227 | we can reboot to there and install a new recovery image to /recovery. |
| 228 | A special "recovery-two-step.img" will be preferred, which encodes the correct |
| 229 | path of "/boot". Otherwise the device may show "device is corrupt" message |
| 230 | when booting into /boot. |
| 231 | |
| 232 | Fall back to using the regular recovery.img if the two-step recovery image |
| 233 | doesn't exist. Note that rebuilding the special image at this point may be |
| 234 | infeasible, because we don't have the desired boot signer and keys when |
| 235 | calling ota_from_target_files.py. |
| 236 | """ |
| 237 | |
| 238 | recovery_two_step_img_name = "recovery-two-step.img" |
| 239 | recovery_two_step_img_path = os.path.join( |
| 240 | OPTIONS.input_tmp, "IMAGES", recovery_two_step_img_name) |
| 241 | if os.path.exists(recovery_two_step_img_path): |
| 242 | recovery_two_step_img = common.GetBootableImage( |
| 243 | recovery_two_step_img_name, recovery_two_step_img_name, |
| 244 | OPTIONS.input_tmp, "RECOVERY") |
| 245 | common.ZipWriteStr( |
| 246 | output_zip, recovery_two_step_img_name, recovery_two_step_img.data) |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 247 | print("two-step package: using %s in stage 1/3" % ( |
| 248 | recovery_two_step_img_name,)) |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 249 | script.WriteRawImage("/boot", recovery_two_step_img_name) |
| 250 | else: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 251 | print("two-step package: using recovery.img in stage 1/3") |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 252 | # The "recovery.img" entry has been written into package earlier. |
| 253 | script.WriteRawImage("/boot", "recovery.img") |
| 254 | |
| 255 | |
Doug Zongker | c925382 | 2014-02-04 12:17:58 -0800 | [diff] [blame] | 256 | def HasRecoveryPatch(target_files_zip): |
Tao Bao | f2cffbd | 2015-07-22 12:33:18 -0700 | [diff] [blame] | 257 | namelist = [name for name in target_files_zip.namelist()] |
| 258 | return ("SYSTEM/recovery-from-boot.p" in namelist or |
| 259 | "SYSTEM/etc/recovery.img" in namelist) |
Doug Zongker | 73ef825 | 2009-07-23 15:12:53 -0700 | [diff] [blame] | 260 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 261 | |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 262 | def HasVendorPartition(target_files_zip): |
| 263 | try: |
| 264 | target_files_zip.getinfo("VENDOR/") |
| 265 | return True |
| 266 | except KeyError: |
| 267 | return False |
| 268 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 269 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 270 | def HasTrebleEnabled(target_files_zip, info_dict): |
| 271 | return (HasVendorPartition(target_files_zip) and |
| 272 | GetBuildProp("ro.treble.enabled", info_dict) == "true") |
| 273 | |
| 274 | |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 275 | def GetOemProperty(name, oem_props, oem_dict, info_dict): |
| 276 | if oem_props is not None and name in oem_props: |
| 277 | return oem_dict[name] |
| 278 | return GetBuildProp(name, info_dict) |
| 279 | |
| 280 | |
| 281 | def CalculateFingerprint(oem_props, oem_dict, info_dict): |
| 282 | if oem_props is None: |
| 283 | return GetBuildProp("ro.build.fingerprint", info_dict) |
| 284 | return "%s/%s/%s:%s" % ( |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 285 | GetOemProperty("ro.product.brand", oem_props, oem_dict, info_dict), |
| 286 | GetOemProperty("ro.product.name", oem_props, oem_dict, info_dict), |
| 287 | GetOemProperty("ro.product.device", oem_props, oem_dict, info_dict), |
| 288 | GetBuildProp("ro.build.thumbprint", info_dict)) |
Doug Zongker | 73ef825 | 2009-07-23 15:12:53 -0700 | [diff] [blame] | 289 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 290 | |
Tao Bao | 7e0f160 | 2017-03-06 15:50:08 -0800 | [diff] [blame] | 291 | def GetImage(which, tmpdir): |
| 292 | """Returns an image object suitable for passing to BlockImageDiff. |
| 293 | |
| 294 | 'which' partition must be "system" or "vendor". A prebuilt image and file |
| 295 | map must already exist in tmpdir. |
| 296 | """ |
Doug Zongker | 3c84f56 | 2014-07-31 11:06:30 -0700 | [diff] [blame] | 297 | |
| 298 | assert which in ("system", "vendor") |
| 299 | |
| 300 | path = os.path.join(tmpdir, "IMAGES", which + ".img") |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 301 | mappath = os.path.join(tmpdir, "IMAGES", which + ".map") |
Doug Zongker | 3c84f56 | 2014-07-31 11:06:30 -0700 | [diff] [blame] | 302 | |
Tao Bao | 7e0f160 | 2017-03-06 15:50:08 -0800 | [diff] [blame] | 303 | # The image and map files must have been created prior to calling |
| 304 | # ota_from_target_files.py (since LMP). |
| 305 | assert os.path.exists(path) and os.path.exists(mappath) |
Doug Zongker | 3c84f56 | 2014-07-31 11:06:30 -0700 | [diff] [blame] | 306 | |
Tao Bao | ff77781 | 2015-05-12 11:42:31 -0700 | [diff] [blame] | 307 | # Bug: http://b/20939131 |
| 308 | # In ext4 filesystems, block 0 might be changed even being mounted |
| 309 | # R/O. We add it to clobbered_blocks so that it will be written to the |
| 310 | # target unconditionally. Note that they are still part of care_map. |
| 311 | clobbered_blocks = "0" |
| 312 | |
| 313 | return sparse_img.SparseImage(path, mappath, clobbered_blocks) |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 314 | |
| 315 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 316 | def AddCompatibilityArchiveIfTrebleEnabled(target_zip, output_zip, |
| 317 | target_info_dict, |
| 318 | source_info_dict=None): |
| 319 | """Adds compatibility info into the output zip if it's Treble-enabled target. |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 320 | |
| 321 | Metadata used for on-device compatibility verification is retrieved from |
| 322 | target_zip then added to compatibility.zip which is added to the output_zip |
| 323 | archive. |
| 324 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 325 | Compatibility archive should only be included for devices that have enabled |
| 326 | Treble support. |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 327 | |
| 328 | Args: |
| 329 | target_zip: Zip file containing the source files to be included for OTA. |
| 330 | output_zip: Zip file that will be sent for OTA. |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 331 | target_info_dict: The dict that holds the target build info. |
| 332 | source_info_dict: The dict that holds the source build info, if generating |
| 333 | an incremental OTA; None otherwise. |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 334 | """ |
| 335 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 336 | def AddCompatibilityArchive(system_updated, vendor_updated): |
| 337 | """Adds compatibility info based on system/vendor update status. |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 338 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 339 | Args: |
| 340 | system_updated: If True, the system image will be updated and therefore |
| 341 | its metadata should be included. |
| 342 | vendor_updated: If True, the vendor image will be updated and therefore |
| 343 | its metadata should be included. |
| 344 | """ |
| 345 | # Determine what metadata we need. Files are names relative to META/. |
| 346 | compatibility_files = [] |
| 347 | vendor_metadata = ("vendor_manifest.xml", "vendor_matrix.xml") |
| 348 | system_metadata = ("system_manifest.xml", "system_matrix.xml") |
| 349 | if vendor_updated: |
| 350 | compatibility_files += vendor_metadata |
| 351 | if system_updated: |
| 352 | compatibility_files += system_metadata |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 353 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 354 | # Create new archive. |
| 355 | compatibility_archive = tempfile.NamedTemporaryFile() |
| 356 | compatibility_archive_zip = zipfile.ZipFile(compatibility_archive, "w", |
| 357 | compression=zipfile.ZIP_DEFLATED) |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 358 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 359 | # Add metadata. |
| 360 | for file_name in compatibility_files: |
| 361 | target_file_name = "META/" + file_name |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 362 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 363 | if target_file_name in target_zip.namelist(): |
| 364 | data = target_zip.read(target_file_name) |
| 365 | common.ZipWriteStr(compatibility_archive_zip, file_name, data) |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 366 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 367 | # Ensure files are written before we copy into output_zip. |
| 368 | compatibility_archive_zip.close() |
| 369 | |
| 370 | # Only add the archive if we have any compatibility info. |
| 371 | if compatibility_archive_zip.namelist(): |
| 372 | common.ZipWrite(output_zip, compatibility_archive.name, |
| 373 | arcname="compatibility.zip", |
| 374 | compress_type=zipfile.ZIP_STORED) |
| 375 | |
| 376 | # Will only proceed if the target has enabled the Treble support (as well as |
| 377 | # having a /vendor partition). |
| 378 | if not HasTrebleEnabled(target_zip, target_info_dict): |
| 379 | return |
| 380 | |
| 381 | # We don't support OEM thumbprint in Treble world (which calculates |
| 382 | # fingerprints in a different way as shown in CalculateFingerprint()). |
| 383 | assert not target_info_dict.get("oem_fingerprint_properties") |
| 384 | |
| 385 | # Full OTA carries the info for system/vendor both. |
| 386 | if source_info_dict is None: |
| 387 | AddCompatibilityArchive(True, True) |
| 388 | return |
| 389 | |
| 390 | assert not source_info_dict.get("oem_fingerprint_properties") |
| 391 | |
| 392 | source_fp = GetBuildProp("ro.build.fingerprint", source_info_dict) |
| 393 | target_fp = GetBuildProp("ro.build.fingerprint", target_info_dict) |
| 394 | system_updated = source_fp != target_fp |
| 395 | |
| 396 | source_fp_vendor = GetVendorBuildProp("ro.vendor.build.fingerprint", |
| 397 | source_info_dict) |
| 398 | target_fp_vendor = GetVendorBuildProp("ro.vendor.build.fingerprint", |
| 399 | target_info_dict) |
| 400 | vendor_updated = source_fp_vendor != target_fp_vendor |
| 401 | |
| 402 | AddCompatibilityArchive(system_updated, vendor_updated) |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 403 | |
| 404 | |
Doug Zongker | c77a9ad | 2010-09-16 11:28:43 -0700 | [diff] [blame] | 405 | def WriteFullOTAPackage(input_zip, output_zip): |
Doug Zongker | 9ce2ebf | 2010-04-21 14:08:44 -0700 | [diff] [blame] | 406 | # TODO: how to determine this? We don't know what version it will |
Tao Bao | 34b47bf | 2015-06-22 19:17:41 -0700 | [diff] [blame] | 407 | # be installed on top of. For now, we expect the API just won't |
| 408 | # change very often. Similarly for fstab, it might have changed |
| 409 | # in the target build. |
Doug Zongker | c77a9ad | 2010-09-16 11:28:43 -0700 | [diff] [blame] | 410 | script = edify_generator.EdifyGenerator(3, OPTIONS.info_dict) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 411 | |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 412 | oem_props = OPTIONS.info_dict.get("oem_fingerprint_properties") |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 413 | oem_dicts = None |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 414 | if oem_props: |
Tao Bao | 2f5358d | 2017-12-20 22:48:19 -0800 | [diff] [blame] | 415 | recovery_mount_options = OPTIONS.info_dict.get("recovery_mount_options") |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 416 | oem_dicts = _LoadOemDicts(script, recovery_mount_options) |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 417 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 418 | target_fp = CalculateFingerprint(oem_props, oem_dicts and oem_dicts[0], |
| 419 | OPTIONS.info_dict) |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 420 | metadata = { |
Tao Bao | 39f3eaf | 2017-03-09 15:01:11 -0800 | [diff] [blame] | 421 | "post-build": target_fp, |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 422 | "pre-device": GetOemProperty("ro.product.device", oem_props, |
| 423 | oem_dicts and oem_dicts[0], |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 424 | OPTIONS.info_dict), |
| 425 | "post-timestamp": GetBuildProp("ro.build.date.utc", OPTIONS.info_dict), |
| 426 | } |
Doug Zongker | 2ea2106 | 2010-04-28 16:05:21 -0700 | [diff] [blame] | 427 | |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 428 | device_specific = common.DeviceSpecificParams( |
| 429 | input_zip=input_zip, |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 430 | input_version=OPTIONS.info_dict["recovery_api_version"], |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 431 | output_zip=output_zip, |
| 432 | script=script, |
Doug Zongker | 2ea2106 | 2010-04-28 16:05:21 -0700 | [diff] [blame] | 433 | input_tmp=OPTIONS.input_tmp, |
Doug Zongker | 96a57e7 | 2010-09-26 14:57:41 -0700 | [diff] [blame] | 434 | metadata=metadata, |
| 435 | info_dict=OPTIONS.info_dict) |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 436 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 437 | assert HasRecoveryPatch(input_zip) |
Doug Zongker | c925382 | 2014-02-04 12:17:58 -0800 | [diff] [blame] | 438 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 439 | metadata["ota-type"] = "BLOCK" |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 440 | |
Elliott Hughes | d8a52f9 | 2016-06-20 14:35:47 -0700 | [diff] [blame] | 441 | ts = GetBuildProp("ro.build.date.utc", OPTIONS.info_dict) |
| 442 | ts_text = GetBuildProp("ro.build.date", OPTIONS.info_dict) |
| 443 | script.AssertOlderBuild(ts, ts_text) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 444 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 445 | AppendAssertions(script, OPTIONS.info_dict, oem_dicts) |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 446 | device_specific.FullOTA_Assertions() |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 447 | |
| 448 | # Two-step package strategy (in chronological order, which is *not* |
| 449 | # the order in which the generated script has things): |
| 450 | # |
| 451 | # if stage is not "2/3" or "3/3": |
| 452 | # write recovery image to boot partition |
| 453 | # set stage to "2/3" |
| 454 | # reboot to boot partition and restart recovery |
| 455 | # else if stage is "2/3": |
| 456 | # write recovery image to recovery partition |
| 457 | # set stage to "3/3" |
| 458 | # reboot to recovery partition and restart recovery |
| 459 | # else: |
| 460 | # (stage must be "3/3") |
| 461 | # set stage to "" |
| 462 | # do normal full package installation: |
| 463 | # wipe and install system, boot image, etc. |
| 464 | # set up system to update recovery partition on first boot |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 465 | # complete script normally |
| 466 | # (allow recovery to mark itself finished and reboot) |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 467 | |
| 468 | recovery_img = common.GetBootableImage("recovery.img", "recovery.img", |
| 469 | OPTIONS.input_tmp, "RECOVERY") |
| 470 | if OPTIONS.two_step: |
| 471 | if not OPTIONS.info_dict.get("multistage_support", None): |
| 472 | assert False, "two-step packages not supported by this build" |
| 473 | fs = OPTIONS.info_dict["fstab"]["/misc"] |
| 474 | assert fs.fs_type.upper() == "EMMC", \ |
| 475 | "two-step packages only supported on devices with EMMC /misc partitions" |
| 476 | bcb_dev = {"bcb_dev": fs.device} |
| 477 | common.ZipWriteStr(output_zip, "recovery.img", recovery_img.data) |
| 478 | script.AppendExtra(""" |
Michael Runge | fb8886d | 2014-10-23 13:51:04 -0700 | [diff] [blame] | 479 | if get_stage("%(bcb_dev)s") == "2/3" then |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 480 | """ % bcb_dev) |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 481 | |
| 482 | # Stage 2/3: Write recovery image to /recovery (currently running /boot). |
| 483 | script.Comment("Stage 2/3") |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 484 | script.WriteRawImage("/recovery", "recovery.img") |
| 485 | script.AppendExtra(""" |
| 486 | set_stage("%(bcb_dev)s", "3/3"); |
| 487 | reboot_now("%(bcb_dev)s", "recovery"); |
Michael Runge | fb8886d | 2014-10-23 13:51:04 -0700 | [diff] [blame] | 488 | else if get_stage("%(bcb_dev)s") == "3/3" then |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 489 | """ % bcb_dev) |
| 490 | |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 491 | # Stage 3/3: Make changes. |
| 492 | script.Comment("Stage 3/3") |
| 493 | |
Tao Bao | 6c55a8a | 2015-04-08 15:30:27 -0700 | [diff] [blame] | 494 | # Dump fingerprints |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 495 | script.Print("Target: %s" % target_fp) |
Tao Bao | 6c55a8a | 2015-04-08 15:30:27 -0700 | [diff] [blame] | 496 | |
Doug Zongker | e5ff590 | 2012-01-17 10:55:37 -0800 | [diff] [blame] | 497 | device_specific.FullOTA_InstallBegin() |
Doug Zongker | 171f1cd | 2009-06-15 22:36:37 -0700 | [diff] [blame] | 498 | |
Doug Zongker | 01ce19c | 2014-02-04 13:48:15 -0800 | [diff] [blame] | 499 | system_progress = 0.75 |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 500 | |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 501 | if OPTIONS.wipe_user_data: |
Doug Zongker | 01ce19c | 2014-02-04 13:48:15 -0800 | [diff] [blame] | 502 | system_progress -= 0.1 |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 503 | if HasVendorPartition(input_zip): |
| 504 | system_progress -= 0.1 |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 505 | |
Doug Zongker | 4b9596f | 2014-06-09 14:15:45 -0700 | [diff] [blame] | 506 | script.ShowProgress(system_progress, 0) |
Jesse Zhao | 75bcea0 | 2015-01-06 10:59:53 -0800 | [diff] [blame] | 507 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 508 | # Full OTA is done as an "incremental" against an empty source image. This |
| 509 | # has the effect of writing new data from the package to the entire |
| 510 | # partition, but lets us reuse the updater code that writes incrementals to |
| 511 | # do it. |
| 512 | system_tgt = GetImage("system", OPTIONS.input_tmp) |
| 513 | system_tgt.ResetFileMap() |
| 514 | system_diff = common.BlockDifference("system", system_tgt, src=None) |
| 515 | system_diff.WriteScript(script, output_zip) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 516 | |
Tao Bao | 7a5bf8a | 2015-07-21 18:01:20 -0700 | [diff] [blame] | 517 | boot_img = common.GetBootableImage( |
| 518 | "boot.img", "boot.img", OPTIONS.input_tmp, "BOOT") |
Doug Zongker | c925382 | 2014-02-04 12:17:58 -0800 | [diff] [blame] | 519 | |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 520 | if HasVendorPartition(input_zip): |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 521 | script.ShowProgress(0.1, 0) |
| 522 | |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 523 | vendor_tgt = GetImage("vendor", OPTIONS.input_tmp) |
| 524 | vendor_tgt.ResetFileMap() |
| 525 | vendor_diff = common.BlockDifference("vendor", vendor_tgt) |
| 526 | vendor_diff.WriteScript(script, output_zip) |
Doug Zongker | 73ef825 | 2009-07-23 15:12:53 -0700 | [diff] [blame] | 527 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 528 | AddCompatibilityArchiveIfTrebleEnabled(input_zip, output_zip, |
| 529 | OPTIONS.info_dict) |
| 530 | |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 531 | common.CheckSize(boot_img.data, "boot.img", OPTIONS.info_dict) |
Doug Zongker | 73ef825 | 2009-07-23 15:12:53 -0700 | [diff] [blame] | 532 | common.ZipWriteStr(output_zip, "boot.img", boot_img.data) |
Doug Zongker | c494d7c | 2009-06-18 08:43:44 -0700 | [diff] [blame] | 533 | |
Doug Zongker | 01ce19c | 2014-02-04 13:48:15 -0800 | [diff] [blame] | 534 | script.ShowProgress(0.05, 5) |
Doug Zongker | 9ce0fb6 | 2010-09-20 18:04:41 -0700 | [diff] [blame] | 535 | script.WriteRawImage("/boot", "boot.img") |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 536 | |
Doug Zongker | 01ce19c | 2014-02-04 13:48:15 -0800 | [diff] [blame] | 537 | script.ShowProgress(0.2, 10) |
Doug Zongker | 05d3dea | 2009-06-22 11:32:31 -0700 | [diff] [blame] | 538 | device_specific.FullOTA_InstallEnd() |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 539 | |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 540 | if OPTIONS.extra_script is not None: |
Doug Zongker | c494d7c | 2009-06-18 08:43:44 -0700 | [diff] [blame] | 541 | script.AppendExtra(OPTIONS.extra_script) |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 542 | |
Doug Zongker | 1483360 | 2010-02-02 13:12:04 -0800 | [diff] [blame] | 543 | script.UnmountAll() |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 544 | |
Doug Zongker | 922206e | 2014-03-04 13:16:24 -0800 | [diff] [blame] | 545 | if OPTIONS.wipe_user_data: |
| 546 | script.ShowProgress(0.1, 10) |
| 547 | script.FormatPartition("/data") |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 548 | |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 549 | if OPTIONS.two_step: |
| 550 | script.AppendExtra(""" |
| 551 | set_stage("%(bcb_dev)s", ""); |
| 552 | """ % bcb_dev) |
| 553 | script.AppendExtra("else\n") |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 554 | |
| 555 | # Stage 1/3: Nothing to verify for full OTA. Write recovery image to /boot. |
| 556 | script.Comment("Stage 1/3") |
| 557 | _WriteRecoveryImageToBoot(script, output_zip) |
| 558 | |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 559 | script.AppendExtra(""" |
| 560 | set_stage("%(bcb_dev)s", "2/3"); |
| 561 | reboot_now("%(bcb_dev)s", ""); |
| 562 | endif; |
| 563 | endif; |
| 564 | """ % bcb_dev) |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 565 | |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 566 | script.SetProgress(1) |
| 567 | script.AddToZip(input_zip, output_zip, input_path=OPTIONS.updater_binary) |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 568 | metadata["ota-required-cache"] = str(script.required_cache) |
Doug Zongker | 2ea2106 | 2010-04-28 16:05:21 -0700 | [diff] [blame] | 569 | WriteMetadata(metadata, output_zip) |
| 570 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 571 | |
Doug Zongker | 2ea2106 | 2010-04-28 16:05:21 -0700 | [diff] [blame] | 572 | def WriteMetadata(metadata, output_zip): |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 573 | value = "".join(["%s=%s\n" % kv for kv in sorted(metadata.iteritems())]) |
| 574 | common.ZipWriteStr(output_zip, METADATA_NAME, value, |
| 575 | compress_type=zipfile.ZIP_STORED) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 576 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 577 | |
Doug Zongker | 1eb74dd | 2012-08-16 16:19:00 -0700 | [diff] [blame] | 578 | def GetBuildProp(prop, info_dict): |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 579 | """Returns the inquired build property from a given info_dict.""" |
Doug Zongker | 1eb74dd | 2012-08-16 16:19:00 -0700 | [diff] [blame] | 580 | try: |
| 581 | return info_dict.get("build.prop", {})[prop] |
| 582 | except KeyError: |
Ying Wang | c73e461 | 2014-04-15 15:27:43 -0700 | [diff] [blame] | 583 | raise common.ExternalError("couldn't find %s in build.prop" % (prop,)) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 584 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 585 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 586 | def GetVendorBuildProp(prop, info_dict): |
| 587 | """Returns the inquired vendor build property from a given info_dict.""" |
| 588 | try: |
| 589 | return info_dict.get("vendor.build.prop", {})[prop] |
| 590 | except KeyError: |
| 591 | raise common.ExternalError( |
| 592 | "couldn't find %s in vendor.build.prop" % (prop,)) |
| 593 | |
| 594 | |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 595 | def HandleDowngradeMetadata(metadata): |
| 596 | # Only incremental OTAs are allowed to reach here. |
| 597 | assert OPTIONS.incremental_source is not None |
| 598 | |
| 599 | post_timestamp = GetBuildProp("ro.build.date.utc", OPTIONS.target_info_dict) |
| 600 | pre_timestamp = GetBuildProp("ro.build.date.utc", OPTIONS.source_info_dict) |
| 601 | is_downgrade = long(post_timestamp) < long(pre_timestamp) |
| 602 | |
| 603 | if OPTIONS.downgrade: |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 604 | if not is_downgrade: |
| 605 | raise RuntimeError("--downgrade specified but no downgrade detected: " |
| 606 | "pre: %s, post: %s" % (pre_timestamp, post_timestamp)) |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 607 | metadata["ota-downgrade"] = "yes" |
| 608 | elif OPTIONS.timestamp: |
| 609 | if not is_downgrade: |
| 610 | raise RuntimeError("--timestamp specified but no timestamp hack needed: " |
| 611 | "pre: %s, post: %s" % (pre_timestamp, post_timestamp)) |
| 612 | metadata["post-timestamp"] = str(long(pre_timestamp) + 1) |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 613 | else: |
| 614 | if is_downgrade: |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 615 | raise RuntimeError("Downgrade detected based on timestamp check: " |
| 616 | "pre: %s, post: %s. Need to specify --timestamp OR " |
| 617 | "--downgrade to allow building the incremental." % ( |
| 618 | pre_timestamp, post_timestamp)) |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 619 | metadata["post-timestamp"] = post_timestamp |
| 620 | |
| 621 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 622 | def WriteBlockIncrementalOTAPackage(target_zip, source_zip, output_zip): |
| 623 | source_version = OPTIONS.source_info_dict["recovery_api_version"] |
| 624 | target_version = OPTIONS.target_info_dict["recovery_api_version"] |
| 625 | |
| 626 | if source_version == 0: |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 627 | print("WARNING: generating edify script for a source that " |
| 628 | "can't install it.") |
Tao Bao | 34b47bf | 2015-06-22 19:17:41 -0700 | [diff] [blame] | 629 | script = edify_generator.EdifyGenerator( |
| 630 | source_version, OPTIONS.target_info_dict, |
| 631 | fstab=OPTIONS.source_info_dict["fstab"]) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 632 | |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 633 | source_oem_props = OPTIONS.source_info_dict.get("oem_fingerprint_properties") |
| 634 | target_oem_props = OPTIONS.target_info_dict.get("oem_fingerprint_properties") |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 635 | oem_dicts = None |
Tao Bao | 2f5358d | 2017-12-20 22:48:19 -0800 | [diff] [blame] | 636 | if source_oem_props or target_oem_props: |
| 637 | recovery_mount_options = OPTIONS.source_info_dict.get( |
| 638 | "recovery_mount_options") |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 639 | oem_dicts = _LoadOemDicts(script, recovery_mount_options) |
Tao Bao | 3806c23 | 2015-07-05 21:08:33 -0700 | [diff] [blame] | 640 | |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 641 | metadata = { |
Tao Bao | 3e30d97 | 2016-03-15 13:20:19 -0700 | [diff] [blame] | 642 | "pre-device": GetOemProperty("ro.product.device", source_oem_props, |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 643 | oem_dicts and oem_dicts[0], |
| 644 | OPTIONS.source_info_dict), |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 645 | "ota-type": "BLOCK", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 646 | } |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 647 | |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 648 | HandleDowngradeMetadata(metadata) |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 649 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 650 | device_specific = common.DeviceSpecificParams( |
| 651 | source_zip=source_zip, |
| 652 | source_version=source_version, |
| 653 | target_zip=target_zip, |
| 654 | target_version=target_version, |
| 655 | output_zip=output_zip, |
| 656 | script=script, |
| 657 | metadata=metadata, |
Tao Bao | 6f0b219 | 2015-10-13 16:37:12 -0700 | [diff] [blame] | 658 | info_dict=OPTIONS.source_info_dict) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 659 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 660 | source_fp = CalculateFingerprint(source_oem_props, oem_dicts and oem_dicts[0], |
Tao Bao | 3806c23 | 2015-07-05 21:08:33 -0700 | [diff] [blame] | 661 | OPTIONS.source_info_dict) |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 662 | target_fp = CalculateFingerprint(target_oem_props, oem_dicts and oem_dicts[0], |
Tao Bao | 3806c23 | 2015-07-05 21:08:33 -0700 | [diff] [blame] | 663 | OPTIONS.target_info_dict) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 664 | metadata["pre-build"] = source_fp |
| 665 | metadata["post-build"] = target_fp |
Tianjie Xu | d06f07e | 2016-06-09 14:18:45 -0700 | [diff] [blame] | 666 | metadata["pre-build-incremental"] = GetBuildProp( |
| 667 | "ro.build.version.incremental", OPTIONS.source_info_dict) |
| 668 | metadata["post-build-incremental"] = GetBuildProp( |
| 669 | "ro.build.version.incremental", OPTIONS.target_info_dict) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 670 | |
| 671 | source_boot = common.GetBootableImage( |
| 672 | "/tmp/boot.img", "boot.img", OPTIONS.source_tmp, "BOOT", |
| 673 | OPTIONS.source_info_dict) |
| 674 | target_boot = common.GetBootableImage( |
| 675 | "/tmp/boot.img", "boot.img", OPTIONS.target_tmp, "BOOT") |
| 676 | updating_boot = (not OPTIONS.two_step and |
| 677 | (source_boot.data != target_boot.data)) |
| 678 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 679 | target_recovery = common.GetBootableImage( |
| 680 | "/tmp/recovery.img", "recovery.img", OPTIONS.target_tmp, "RECOVERY") |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 681 | |
Tao Bao | 7e0f160 | 2017-03-06 15:50:08 -0800 | [diff] [blame] | 682 | system_src = GetImage("system", OPTIONS.source_tmp) |
| 683 | system_tgt = GetImage("system", OPTIONS.target_tmp) |
Tao Bao | dd2a589 | 2015-03-12 12:32:37 -0700 | [diff] [blame] | 684 | |
Tao Bao | 0582cb6 | 2017-12-21 11:47:01 -0800 | [diff] [blame^] | 685 | blockimgdiff_version = max( |
| 686 | int(i) for i in |
| 687 | OPTIONS.info_dict.get("blockimgdiff_versions", "1").split(",")) |
| 688 | assert blockimgdiff_version >= 3 |
Tao Bao | dd2a589 | 2015-03-12 12:32:37 -0700 | [diff] [blame] | 689 | |
Tao Bao | f8acad1 | 2016-07-07 09:09:58 -0700 | [diff] [blame] | 690 | # Check the first block of the source system partition for remount R/W only |
| 691 | # if the filesystem is ext4. |
| 692 | system_src_partition = OPTIONS.source_info_dict["fstab"]["/system"] |
| 693 | check_first_block = system_src_partition.fs_type == "ext4" |
Tao Bao | 293fd13 | 2016-06-11 12:19:23 -0700 | [diff] [blame] | 694 | # Disable using imgdiff for squashfs. 'imgdiff -z' expects input files to be |
| 695 | # in zip formats. However with squashfs, a) all files are compressed in LZ4; |
| 696 | # b) the blocks listed in block map may not contain all the bytes for a given |
| 697 | # file (because they're rounded to be 4K-aligned). |
Tao Bao | f8acad1 | 2016-07-07 09:09:58 -0700 | [diff] [blame] | 698 | system_tgt_partition = OPTIONS.target_info_dict["fstab"]["/system"] |
| 699 | disable_imgdiff = (system_src_partition.fs_type == "squashfs" or |
| 700 | system_tgt_partition.fs_type == "squashfs") |
Doug Zongker | b34fcce | 2014-09-11 09:34:56 -0700 | [diff] [blame] | 701 | system_diff = common.BlockDifference("system", system_tgt, system_src, |
Tianjie Xu | fc3422a | 2015-12-15 11:53:59 -0800 | [diff] [blame] | 702 | check_first_block, |
Tao Bao | 293fd13 | 2016-06-11 12:19:23 -0700 | [diff] [blame] | 703 | version=blockimgdiff_version, |
| 704 | disable_imgdiff=disable_imgdiff) |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 705 | |
Doug Zongker | c8b4e84 | 2014-06-16 15:16:31 -0700 | [diff] [blame] | 706 | if HasVendorPartition(target_zip): |
| 707 | if not HasVendorPartition(source_zip): |
| 708 | raise RuntimeError("can't generate incremental that adds /vendor") |
Tao Bao | 7e0f160 | 2017-03-06 15:50:08 -0800 | [diff] [blame] | 709 | vendor_src = GetImage("vendor", OPTIONS.source_tmp) |
| 710 | vendor_tgt = GetImage("vendor", OPTIONS.target_tmp) |
Tianjie Xu | fc3422a | 2015-12-15 11:53:59 -0800 | [diff] [blame] | 711 | |
| 712 | # Check first block of vendor partition for remount R/W only if |
| 713 | # disk type is ext4 |
| 714 | vendor_partition = OPTIONS.source_info_dict["fstab"]["/vendor"] |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 715 | check_first_block = vendor_partition.fs_type == "ext4" |
Tao Bao | 293fd13 | 2016-06-11 12:19:23 -0700 | [diff] [blame] | 716 | disable_imgdiff = vendor_partition.fs_type == "squashfs" |
Doug Zongker | b34fcce | 2014-09-11 09:34:56 -0700 | [diff] [blame] | 717 | vendor_diff = common.BlockDifference("vendor", vendor_tgt, vendor_src, |
Tianjie Xu | fc3422a | 2015-12-15 11:53:59 -0800 | [diff] [blame] | 718 | check_first_block, |
Tao Bao | 293fd13 | 2016-06-11 12:19:23 -0700 | [diff] [blame] | 719 | version=blockimgdiff_version, |
| 720 | disable_imgdiff=disable_imgdiff) |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 721 | else: |
| 722 | vendor_diff = None |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 723 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 724 | AddCompatibilityArchiveIfTrebleEnabled( |
| 725 | target_zip, output_zip, OPTIONS.target_info_dict, |
| 726 | OPTIONS.source_info_dict) |
| 727 | |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 728 | AppendAssertions(script, OPTIONS.target_info_dict, oem_dicts) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 729 | device_specific.IncrementalOTA_Assertions() |
| 730 | |
| 731 | # Two-step incremental package strategy (in chronological order, |
| 732 | # which is *not* the order in which the generated script has |
| 733 | # things): |
| 734 | # |
| 735 | # if stage is not "2/3" or "3/3": |
| 736 | # do verification on current system |
| 737 | # write recovery image to boot partition |
| 738 | # set stage to "2/3" |
| 739 | # reboot to boot partition and restart recovery |
| 740 | # else if stage is "2/3": |
| 741 | # write recovery image to recovery partition |
| 742 | # set stage to "3/3" |
| 743 | # reboot to recovery partition and restart recovery |
| 744 | # else: |
| 745 | # (stage must be "3/3") |
| 746 | # perform update: |
| 747 | # patch system files, etc. |
| 748 | # force full install of new boot image |
| 749 | # set up system to update recovery partition on first boot |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 750 | # complete script normally |
| 751 | # (allow recovery to mark itself finished and reboot) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 752 | |
| 753 | if OPTIONS.two_step: |
Tao Bao | dd24da9 | 2015-07-29 14:09:23 -0700 | [diff] [blame] | 754 | if not OPTIONS.source_info_dict.get("multistage_support", None): |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 755 | assert False, "two-step packages not supported by this build" |
Tao Bao | dd24da9 | 2015-07-29 14:09:23 -0700 | [diff] [blame] | 756 | fs = OPTIONS.source_info_dict["fstab"]["/misc"] |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 757 | assert fs.fs_type.upper() == "EMMC", \ |
| 758 | "two-step packages only supported on devices with EMMC /misc partitions" |
| 759 | bcb_dev = {"bcb_dev": fs.device} |
| 760 | common.ZipWriteStr(output_zip, "recovery.img", target_recovery.data) |
| 761 | script.AppendExtra(""" |
Michael Runge | fb8886d | 2014-10-23 13:51:04 -0700 | [diff] [blame] | 762 | if get_stage("%(bcb_dev)s") == "2/3" then |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 763 | """ % bcb_dev) |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 764 | |
| 765 | # Stage 2/3: Write recovery image to /recovery (currently running /boot). |
| 766 | script.Comment("Stage 2/3") |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 767 | script.AppendExtra("sleep(20);\n") |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 768 | script.WriteRawImage("/recovery", "recovery.img") |
| 769 | script.AppendExtra(""" |
| 770 | set_stage("%(bcb_dev)s", "3/3"); |
| 771 | reboot_now("%(bcb_dev)s", "recovery"); |
Michael Runge | fb8886d | 2014-10-23 13:51:04 -0700 | [diff] [blame] | 772 | else if get_stage("%(bcb_dev)s") != "3/3" then |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 773 | """ % bcb_dev) |
| 774 | |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 775 | # Stage 1/3: (a) Verify the current system. |
| 776 | script.Comment("Stage 1/3") |
| 777 | |
Tao Bao | 6c55a8a | 2015-04-08 15:30:27 -0700 | [diff] [blame] | 778 | # Dump fingerprints |
Tao Bao | f902385 | 2016-12-14 11:53:38 -0800 | [diff] [blame] | 779 | script.Print("Source: %s" % (source_fp,)) |
| 780 | script.Print("Target: %s" % (target_fp,)) |
Tao Bao | 6c55a8a | 2015-04-08 15:30:27 -0700 | [diff] [blame] | 781 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 782 | script.Print("Verifying current system...") |
| 783 | |
| 784 | device_specific.IncrementalOTA_VerifyBegin() |
| 785 | |
Tao Bao | 0582cb6 | 2017-12-21 11:47:01 -0800 | [diff] [blame^] | 786 | if source_oem_props is None and target_oem_props is None: |
| 787 | script.AssertSomeFingerprint(source_fp, target_fp) |
| 788 | elif source_oem_props is not None and target_oem_props is not None: |
| 789 | script.AssertSomeThumbprint( |
| 790 | GetBuildProp("ro.build.thumbprint", OPTIONS.target_info_dict), |
| 791 | GetBuildProp("ro.build.thumbprint", OPTIONS.source_info_dict)) |
| 792 | elif source_oem_props is None and target_oem_props is not None: |
| 793 | script.AssertFingerprintOrThumbprint( |
| 794 | source_fp, |
| 795 | GetBuildProp("ro.build.thumbprint", OPTIONS.target_info_dict)) |
| 796 | else: |
| 797 | script.AssertFingerprintOrThumbprint( |
| 798 | target_fp, |
| 799 | GetBuildProp("ro.build.thumbprint", OPTIONS.source_info_dict)) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 800 | |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 801 | # Check the required cache size (i.e. stashed blocks). |
| 802 | size = [] |
| 803 | if system_diff: |
| 804 | size.append(system_diff.required_cache) |
| 805 | if vendor_diff: |
| 806 | size.append(vendor_diff.required_cache) |
| 807 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 808 | if updating_boot: |
Tao Bao | dd24da9 | 2015-07-29 14:09:23 -0700 | [diff] [blame] | 809 | boot_type, boot_device = common.GetTypeAndDevice( |
| 810 | "/boot", OPTIONS.source_info_dict) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 811 | d = common.Difference(target_boot, source_boot) |
| 812 | _, _, d = d.ComputePatch() |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 813 | if d is None: |
| 814 | include_full_boot = True |
| 815 | common.ZipWriteStr(output_zip, "boot.img", target_boot.data) |
| 816 | else: |
| 817 | include_full_boot = False |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 818 | |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 819 | print("boot target: %d source: %d diff: %d" % ( |
| 820 | target_boot.size, source_boot.size, len(d))) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 821 | |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 822 | common.ZipWriteStr(output_zip, "patch/boot.img.p", d) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 823 | |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 824 | script.PatchCheck("%s:%s:%d:%s:%d:%s" % |
| 825 | (boot_type, boot_device, |
| 826 | source_boot.size, source_boot.sha1, |
| 827 | target_boot.size, target_boot.sha1)) |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 828 | size.append(target_boot.size) |
| 829 | |
| 830 | if size: |
| 831 | script.CacheFreeSpaceCheck(max(size)) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 832 | |
| 833 | device_specific.IncrementalOTA_VerifyEnd() |
| 834 | |
| 835 | if OPTIONS.two_step: |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 836 | # Stage 1/3: (b) Write recovery image to /boot. |
| 837 | _WriteRecoveryImageToBoot(script, output_zip) |
| 838 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 839 | script.AppendExtra(""" |
| 840 | set_stage("%(bcb_dev)s", "2/3"); |
| 841 | reboot_now("%(bcb_dev)s", ""); |
| 842 | else |
| 843 | """ % bcb_dev) |
| 844 | |
Tao Bao | d42e97e | 2016-11-30 12:11:57 -0800 | [diff] [blame] | 845 | # Stage 3/3: Make changes. |
| 846 | script.Comment("Stage 3/3") |
| 847 | |
Jesse Zhao | 75bcea0 | 2015-01-06 10:59:53 -0800 | [diff] [blame] | 848 | # Verify the existing partitions. |
Tao Bao | d522bdc | 2016-04-12 15:53:16 -0700 | [diff] [blame] | 849 | system_diff.WriteVerifyScript(script, touched_blocks_only=True) |
Jesse Zhao | 75bcea0 | 2015-01-06 10:59:53 -0800 | [diff] [blame] | 850 | if vendor_diff: |
Tao Bao | d522bdc | 2016-04-12 15:53:16 -0700 | [diff] [blame] | 851 | vendor_diff.WriteVerifyScript(script, touched_blocks_only=True) |
Jesse Zhao | 75bcea0 | 2015-01-06 10:59:53 -0800 | [diff] [blame] | 852 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 853 | script.Comment("---- start making changes here ----") |
| 854 | |
| 855 | device_specific.IncrementalOTA_InstallBegin() |
| 856 | |
Doug Zongker | ab7ca1d | 2014-08-26 10:40:28 -0700 | [diff] [blame] | 857 | system_diff.WriteScript(script, output_zip, |
| 858 | progress=0.8 if vendor_diff else 0.9) |
Tao Bao | 68658c0 | 2015-06-01 13:40:49 -0700 | [diff] [blame] | 859 | |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 860 | if vendor_diff: |
Doug Zongker | ab7ca1d | 2014-08-26 10:40:28 -0700 | [diff] [blame] | 861 | vendor_diff.WriteScript(script, output_zip, progress=0.1) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 862 | |
| 863 | if OPTIONS.two_step: |
| 864 | common.ZipWriteStr(output_zip, "boot.img", target_boot.data) |
| 865 | script.WriteRawImage("/boot", "boot.img") |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 866 | print("writing full boot image (forced by two-step mode)") |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 867 | |
| 868 | if not OPTIONS.two_step: |
| 869 | if updating_boot: |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 870 | if include_full_boot: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 871 | print("boot image changed; including full.") |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 872 | script.Print("Installing boot image...") |
| 873 | script.WriteRawImage("/boot", "boot.img") |
| 874 | else: |
| 875 | # Produce the boot image by applying a patch to the current |
| 876 | # contents of the boot partition, and write it back to the |
| 877 | # partition. |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 878 | print("boot image changed; including patch.") |
Doug Zongker | f834008 | 2014-08-05 10:39:37 -0700 | [diff] [blame] | 879 | script.Print("Patching boot image...") |
| 880 | script.ShowProgress(0.1, 10) |
| 881 | script.ApplyPatch("%s:%s:%d:%s:%d:%s" |
| 882 | % (boot_type, boot_device, |
| 883 | source_boot.size, source_boot.sha1, |
| 884 | target_boot.size, target_boot.sha1), |
| 885 | "-", |
| 886 | target_boot.size, target_boot.sha1, |
| 887 | source_boot.sha1, "patch/boot.img.p") |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 888 | else: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 889 | print("boot image unchanged; skipping.") |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 890 | |
| 891 | # Do device-specific installation (eg, write radio image). |
| 892 | device_specific.IncrementalOTA_InstallEnd() |
| 893 | |
| 894 | if OPTIONS.extra_script is not None: |
| 895 | script.AppendExtra(OPTIONS.extra_script) |
| 896 | |
Doug Zongker | 922206e | 2014-03-04 13:16:24 -0800 | [diff] [blame] | 897 | if OPTIONS.wipe_user_data: |
| 898 | script.Print("Erasing user data...") |
| 899 | script.FormatPartition("/data") |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 900 | metadata["ota-wipe"] = "yes" |
Doug Zongker | 922206e | 2014-03-04 13:16:24 -0800 | [diff] [blame] | 901 | |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 902 | if OPTIONS.two_step: |
| 903 | script.AppendExtra(""" |
| 904 | set_stage("%(bcb_dev)s", ""); |
| 905 | endif; |
| 906 | endif; |
| 907 | """ % bcb_dev) |
| 908 | |
| 909 | script.SetProgress(1) |
Tao Bao | 4996cf0 | 2016-03-08 17:53:39 -0800 | [diff] [blame] | 910 | # For downgrade OTAs, we prefer to use the update-binary in the source |
| 911 | # build that is actually newer than the one in the target build. |
| 912 | if OPTIONS.downgrade: |
| 913 | script.AddToZip(source_zip, output_zip, input_path=OPTIONS.updater_binary) |
| 914 | else: |
| 915 | script.AddToZip(target_zip, output_zip, input_path=OPTIONS.updater_binary) |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 916 | metadata["ota-required-cache"] = str(script.required_cache) |
Geremy Condra | 36bd365 | 2014-02-06 19:45:10 -0800 | [diff] [blame] | 917 | WriteMetadata(metadata, output_zip) |
| 918 | |
Doug Zongker | 32b527d | 2014-03-04 10:03:02 -0800 | [diff] [blame] | 919 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 920 | def WriteABOTAPackageWithBrilloScript(target_file, output_file, |
| 921 | source_file=None): |
| 922 | """Generate an Android OTA package that has A/B update payload.""" |
| 923 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 924 | def ComputeStreamingMetadata(zip_file, reserve_space=False, |
| 925 | expected_length=None): |
| 926 | """Compute the streaming metadata for a given zip. |
| 927 | |
| 928 | When 'reserve_space' is True, we reserve extra space for the offset and |
| 929 | length of the metadata entry itself, although we don't know the final |
| 930 | values until the package gets signed. This function will be called again |
| 931 | after signing. We then write the actual values and pad the string to the |
| 932 | length we set earlier. Note that we can't use the actual length of the |
| 933 | metadata entry in the second run. Otherwise the offsets for other entries |
| 934 | will be changing again. |
| 935 | """ |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 936 | |
| 937 | def ComputeEntryOffsetSize(name): |
| 938 | """Compute the zip entry offset and size.""" |
| 939 | info = zip_file.getinfo(name) |
| 940 | offset = info.header_offset + len(info.FileHeader()) |
| 941 | size = info.file_size |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 942 | return '%s:%d:%d' % (os.path.basename(name), offset, size) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 943 | |
| 944 | # payload.bin and payload_properties.txt must exist. |
| 945 | offsets = [ComputeEntryOffsetSize('payload.bin'), |
| 946 | ComputeEntryOffsetSize('payload_properties.txt')] |
| 947 | |
| 948 | # care_map.txt is available only if dm-verity is enabled. |
| 949 | if 'care_map.txt' in zip_file.namelist(): |
| 950 | offsets.append(ComputeEntryOffsetSize('care_map.txt')) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 951 | |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 952 | if 'compatibility.zip' in zip_file.namelist(): |
| 953 | offsets.append(ComputeEntryOffsetSize('compatibility.zip')) |
| 954 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 955 | # 'META-INF/com/android/metadata' is required. We don't know its actual |
| 956 | # offset and length (as well as the values for other entries). So we |
| 957 | # reserve 10-byte as a placeholder, which is to cover the space for metadata |
| 958 | # entry ('xx:xxx', since it's ZIP_STORED which should appear at the |
| 959 | # beginning of the zip), as well as the possible value changes in other |
| 960 | # entries. |
| 961 | if reserve_space: |
| 962 | offsets.append('metadata:' + ' ' * 10) |
| 963 | else: |
| 964 | offsets.append(ComputeEntryOffsetSize(METADATA_NAME)) |
| 965 | |
| 966 | value = ','.join(offsets) |
| 967 | if expected_length is not None: |
| 968 | assert len(value) <= expected_length, \ |
| 969 | 'Insufficient reserved space: reserved=%d, actual=%d' % ( |
| 970 | expected_length, len(value)) |
| 971 | value += ' ' * (expected_length - len(value)) |
| 972 | return value |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 973 | |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 974 | # The place where the output from the subprocess should go. |
| 975 | log_file = sys.stdout if OPTIONS.verbose else subprocess.PIPE |
| 976 | |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 977 | # A/B updater expects a signing key in RSA format. Gets the key ready for |
| 978 | # later use in step 3, unless a payload_signer has been specified. |
| 979 | if OPTIONS.payload_signer is None: |
| 980 | cmd = ["openssl", "pkcs8", |
| 981 | "-in", OPTIONS.package_key + OPTIONS.private_key_suffix, |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 982 | "-inform", "DER"] |
| 983 | pw = OPTIONS.key_passwords[OPTIONS.package_key] |
| 984 | cmd.extend(["-passin", "pass:" + pw] if pw else ["-nocrypt"]) |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 985 | rsa_key = common.MakeTempFile(prefix="key-", suffix=".key") |
| 986 | cmd.extend(["-out", rsa_key]) |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 987 | p1 = common.Run(cmd, verbose=False, stdout=log_file, stderr=subprocess.STDOUT) |
Tao Bao | 6047c24 | 2016-06-21 13:35:26 -0700 | [diff] [blame] | 988 | p1.communicate() |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 989 | assert p1.returncode == 0, "openssl pkcs8 failed" |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 990 | |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 991 | # Stage the output zip package for package signing. |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 992 | temp_zip_file = tempfile.NamedTemporaryFile() |
| 993 | output_zip = zipfile.ZipFile(temp_zip_file, "w", |
| 994 | compression=zipfile.ZIP_DEFLATED) |
| 995 | |
| 996 | # Metadata to comply with Android OTA package format. |
| 997 | oem_props = OPTIONS.info_dict.get("oem_fingerprint_properties", None) |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 998 | oem_dicts = None |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 999 | if oem_props: |
Tao Bao | ebce697 | 2017-03-06 10:22:20 -0800 | [diff] [blame] | 1000 | oem_dicts = _LoadOemDicts(None) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1001 | |
| 1002 | metadata = { |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 1003 | "post-build": CalculateFingerprint(oem_props, oem_dicts and oem_dicts[0], |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1004 | OPTIONS.info_dict), |
Tianjie Xu | d06f07e | 2016-06-09 14:18:45 -0700 | [diff] [blame] | 1005 | "post-build-incremental" : GetBuildProp("ro.build.version.incremental", |
| 1006 | OPTIONS.info_dict), |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 1007 | "pre-device": GetOemProperty("ro.product.device", oem_props, |
| 1008 | oem_dicts and oem_dicts[0], |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1009 | OPTIONS.info_dict), |
Tao Bao | d8d14be | 2016-02-04 14:26:02 -0800 | [diff] [blame] | 1010 | "ota-required-cache": "0", |
| 1011 | "ota-type": "AB", |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1012 | } |
| 1013 | |
| 1014 | if source_file is not None: |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 1015 | metadata["pre-build"] = CalculateFingerprint(oem_props, |
| 1016 | oem_dicts and oem_dicts[0], |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1017 | OPTIONS.source_info_dict) |
Tianjie Xu | d06f07e | 2016-06-09 14:18:45 -0700 | [diff] [blame] | 1018 | metadata["pre-build-incremental"] = GetBuildProp( |
| 1019 | "ro.build.version.incremental", OPTIONS.source_info_dict) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1020 | |
Tao Bao | b31892e | 2017-02-07 11:21:17 -0800 | [diff] [blame] | 1021 | HandleDowngradeMetadata(metadata) |
| 1022 | else: |
| 1023 | metadata["post-timestamp"] = GetBuildProp( |
| 1024 | "ro.build.date.utc", OPTIONS.info_dict) |
| 1025 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1026 | # 1. Generate payload. |
| 1027 | payload_file = common.MakeTempFile(prefix="payload-", suffix=".bin") |
| 1028 | cmd = ["brillo_update_payload", "generate", |
| 1029 | "--payload", payload_file, |
| 1030 | "--target_image", target_file] |
| 1031 | if source_file is not None: |
| 1032 | cmd.extend(["--source_image", source_file]) |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1033 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1034 | p1.communicate() |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1035 | assert p1.returncode == 0, "brillo_update_payload generate failed" |
| 1036 | |
| 1037 | # 2. Generate hashes of the payload and metadata files. |
| 1038 | payload_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin") |
| 1039 | metadata_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin") |
| 1040 | cmd = ["brillo_update_payload", "hash", |
| 1041 | "--unsigned_payload", payload_file, |
| 1042 | "--signature_size", "256", |
| 1043 | "--metadata_hash_file", metadata_sig_file, |
| 1044 | "--payload_hash_file", payload_sig_file] |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1045 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1046 | p1.communicate() |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1047 | assert p1.returncode == 0, "brillo_update_payload hash failed" |
| 1048 | |
| 1049 | # 3. Sign the hashes and insert them back into the payload file. |
| 1050 | signed_payload_sig_file = common.MakeTempFile(prefix="signed-sig-", |
| 1051 | suffix=".bin") |
| 1052 | signed_metadata_sig_file = common.MakeTempFile(prefix="signed-sig-", |
| 1053 | suffix=".bin") |
| 1054 | # 3a. Sign the payload hash. |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1055 | if OPTIONS.payload_signer is not None: |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1056 | cmd = [OPTIONS.payload_signer] |
| 1057 | cmd.extend(OPTIONS.payload_signer_args) |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1058 | else: |
| 1059 | cmd = ["openssl", "pkeyutl", "-sign", |
| 1060 | "-inkey", rsa_key, |
| 1061 | "-pkeyopt", "digest:sha256"] |
| 1062 | cmd.extend(["-in", payload_sig_file, |
| 1063 | "-out", signed_payload_sig_file]) |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1064 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1065 | p1.communicate() |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1066 | assert p1.returncode == 0, "openssl sign payload failed" |
| 1067 | |
| 1068 | # 3b. Sign the metadata hash. |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1069 | if OPTIONS.payload_signer is not None: |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1070 | cmd = [OPTIONS.payload_signer] |
| 1071 | cmd.extend(OPTIONS.payload_signer_args) |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1072 | else: |
| 1073 | cmd = ["openssl", "pkeyutl", "-sign", |
| 1074 | "-inkey", rsa_key, |
| 1075 | "-pkeyopt", "digest:sha256"] |
| 1076 | cmd.extend(["-in", metadata_sig_file, |
| 1077 | "-out", signed_metadata_sig_file]) |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1078 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1079 | p1.communicate() |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1080 | assert p1.returncode == 0, "openssl sign metadata failed" |
| 1081 | |
| 1082 | # 3c. Insert the signatures back into the payload file. |
| 1083 | signed_payload_file = common.MakeTempFile(prefix="signed-payload-", |
| 1084 | suffix=".bin") |
| 1085 | cmd = ["brillo_update_payload", "sign", |
| 1086 | "--unsigned_payload", payload_file, |
| 1087 | "--payload", signed_payload_file, |
| 1088 | "--signature_size", "256", |
| 1089 | "--metadata_signature_file", signed_metadata_sig_file, |
| 1090 | "--payload_signature_file", signed_payload_sig_file] |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1091 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1092 | p1.communicate() |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1093 | assert p1.returncode == 0, "brillo_update_payload sign failed" |
| 1094 | |
Alex Deymo | 19241c1 | 2016-02-04 22:29:29 -0800 | [diff] [blame] | 1095 | # 4. Dump the signed payload properties. |
| 1096 | properties_file = common.MakeTempFile(prefix="payload-properties-", |
| 1097 | suffix=".txt") |
| 1098 | cmd = ["brillo_update_payload", "properties", |
| 1099 | "--payload", signed_payload_file, |
| 1100 | "--properties_file", properties_file] |
Alex Deymo | d8d96ec | 2016-06-10 16:38:31 -0700 | [diff] [blame] | 1101 | p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT) |
| 1102 | p1.communicate() |
Alex Deymo | 19241c1 | 2016-02-04 22:29:29 -0800 | [diff] [blame] | 1103 | assert p1.returncode == 0, "brillo_update_payload properties failed" |
| 1104 | |
Tao Bao | 7c5dc57 | 2016-06-14 17:48:11 -0700 | [diff] [blame] | 1105 | if OPTIONS.wipe_user_data: |
| 1106 | with open(properties_file, "a") as f: |
| 1107 | f.write("POWERWASH=1\n") |
| 1108 | metadata["ota-wipe"] = "yes" |
| 1109 | |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1110 | # Add the signed payload file and properties into the zip. In order to |
| 1111 | # support streaming, we pack payload.bin, payload_properties.txt and |
| 1112 | # care_map.txt as ZIP_STORED. So these entries can be read directly with |
| 1113 | # the offset and length pairs. |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1114 | common.ZipWrite(output_zip, signed_payload_file, arcname="payload.bin", |
| 1115 | compress_type=zipfile.ZIP_STORED) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1116 | common.ZipWrite(output_zip, properties_file, |
| 1117 | arcname="payload_properties.txt", |
| 1118 | compress_type=zipfile.ZIP_STORED) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1119 | |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1120 | # If dm-verity is supported for the device, copy contents of care_map |
| 1121 | # into A/B OTA package. |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1122 | target_zip = zipfile.ZipFile(target_file, "r") |
Tianjie Xu | 6b2e155 | 2017-06-01 11:32:32 -0700 | [diff] [blame] | 1123 | if (OPTIONS.info_dict.get("verity") == "true" or |
Bowgo Tsai | 3e599ea | 2017-05-26 18:30:04 +0800 | [diff] [blame] | 1124 | OPTIONS.info_dict.get("avb_enable") == "true"): |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1125 | care_map_path = "META/care_map.txt" |
| 1126 | namelist = target_zip.namelist() |
| 1127 | if care_map_path in namelist: |
| 1128 | care_map_data = target_zip.read(care_map_path) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1129 | common.ZipWriteStr(output_zip, "care_map.txt", care_map_data, |
| 1130 | compress_type=zipfile.ZIP_STORED) |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1131 | else: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1132 | print("Warning: cannot find care map file in target_file package") |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1133 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 1134 | # OPTIONS.source_info_dict must be None for incrementals. |
| 1135 | if source_file is None: |
| 1136 | assert OPTIONS.source_info_dict is None |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1137 | |
Tao Bao | bcd1d16 | 2017-08-26 13:10:26 -0700 | [diff] [blame] | 1138 | AddCompatibilityArchiveIfTrebleEnabled( |
| 1139 | target_zip, output_zip, OPTIONS.info_dict, OPTIONS.source_info_dict) |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1140 | |
Tao Bao | 21803d3 | 2017-04-19 10:16:09 -0700 | [diff] [blame] | 1141 | common.ZipClose(target_zip) |
Tianjie Xu | cfa8622 | 2016-03-07 16:31:19 -0800 | [diff] [blame] | 1142 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1143 | # Write the current metadata entry with placeholders. |
Tao Bao | bfdcb12 | 2017-01-31 15:06:05 -0800 | [diff] [blame] | 1144 | metadata['ota-streaming-property-files'] = ComputeStreamingMetadata( |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1145 | output_zip, reserve_space=True) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1146 | WriteMetadata(metadata, output_zip) |
| 1147 | common.ZipClose(output_zip) |
| 1148 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1149 | # SignOutput(), which in turn calls signapk.jar, will possibly reorder the |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1150 | # ZIP entries, as well as padding the entry headers. We do a preliminary |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1151 | # signing (with an incomplete metadata entry) to allow that to happen. Then |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1152 | # compute the ZIP entry offsets, write back the final metadata and do the |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1153 | # final signing. |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1154 | prelim_signing = common.MakeTempFile(suffix='.zip') |
| 1155 | SignOutput(temp_zip_file.name, prelim_signing) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1156 | common.ZipClose(temp_zip_file) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1157 | |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1158 | # Open the signed zip. Compute the final metadata that's needed for streaming. |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1159 | prelim_signing_zip = zipfile.ZipFile(prelim_signing, 'r') |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1160 | expected_length = len(metadata['ota-streaming-property-files']) |
| 1161 | metadata['ota-streaming-property-files'] = ComputeStreamingMetadata( |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1162 | prelim_signing_zip, reserve_space=False, expected_length=expected_length) |
| 1163 | common.ZipClose(prelim_signing_zip) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1164 | |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1165 | # Replace the METADATA entry. |
| 1166 | common.ZipDelete(prelim_signing, METADATA_NAME) |
| 1167 | output_zip = zipfile.ZipFile(prelim_signing, 'a', |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1168 | compression=zipfile.ZIP_DEFLATED) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1169 | WriteMetadata(metadata, output_zip) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1170 | common.ZipClose(output_zip) |
| 1171 | |
| 1172 | # Re-sign the package after updating the metadata entry. |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1173 | SignOutput(prelim_signing, output_file) |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1174 | |
| 1175 | # Reopen the final signed zip to double check the streaming metadata. |
Tao Bao | 89d7ab2 | 2017-12-14 17:05:33 -0800 | [diff] [blame] | 1176 | output_zip = zipfile.ZipFile(output_file, 'r') |
Tao Bao | 2dd1c48 | 2017-02-03 16:49:39 -0800 | [diff] [blame] | 1177 | actual = metadata['ota-streaming-property-files'].strip() |
| 1178 | expected = ComputeStreamingMetadata(output_zip) |
| 1179 | assert actual == expected, \ |
| 1180 | "Mismatching streaming metadata: %s vs %s." % (actual, expected) |
Tao Bao | c96316c | 2017-01-24 22:10:49 -0800 | [diff] [blame] | 1181 | common.ZipClose(output_zip) |
| 1182 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1183 | |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1184 | def main(argv): |
| 1185 | |
| 1186 | def option_handler(o, a): |
Tao Bao | 4b76a0e | 2017-10-31 12:13:33 -0700 | [diff] [blame] | 1187 | if o in ("-k", "--package_key"): |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1188 | OPTIONS.package_key = a |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1189 | elif o in ("-i", "--incremental_from"): |
| 1190 | OPTIONS.incremental_source = a |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 1191 | elif o == "--full_radio": |
| 1192 | OPTIONS.full_radio = True |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 1193 | elif o == "--full_bootloader": |
| 1194 | OPTIONS.full_bootloader = True |
Tao Bao | 337633f | 2017-12-06 15:20:19 -0800 | [diff] [blame] | 1195 | elif o == "--wipe_user_data": |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 1196 | OPTIONS.wipe_user_data = True |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1197 | elif o == "--downgrade": |
| 1198 | OPTIONS.downgrade = True |
| 1199 | OPTIONS.wipe_user_data = True |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 1200 | elif o == "--override_timestamp": |
| 1201 | OPTIONS.timestamp = True |
Michael Runge | 6e83611 | 2014-04-15 17:40:21 -0700 | [diff] [blame] | 1202 | elif o in ("-o", "--oem_settings"): |
Alain Vongsouvanh | 7f804ba | 2017-02-16 13:06:55 -0800 | [diff] [blame] | 1203 | OPTIONS.oem_source = a.split(',') |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 1204 | elif o == "--oem_no_mount": |
| 1205 | OPTIONS.oem_no_mount = True |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 1206 | elif o in ("-e", "--extra_script"): |
| 1207 | OPTIONS.extra_script = a |
Martin Blumenstingl | 374e114 | 2014-05-31 20:42:55 +0200 | [diff] [blame] | 1208 | elif o in ("-t", "--worker_threads"): |
| 1209 | if a.isdigit(): |
| 1210 | OPTIONS.worker_threads = int(a) |
| 1211 | else: |
| 1212 | raise ValueError("Cannot parse value %r for option %r - only " |
| 1213 | "integers are allowed." % (a, o)) |
Doug Zongker | 9b23f2c | 2013-11-25 14:44:12 -0800 | [diff] [blame] | 1214 | elif o in ("-2", "--two_step"): |
| 1215 | OPTIONS.two_step = True |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 1216 | elif o == "--no_signing": |
Takeshi Kanemoto | e153b34 | 2013-11-14 17:20:50 +0900 | [diff] [blame] | 1217 | OPTIONS.no_signing = True |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1218 | elif o == "--verify": |
Michael Runge | 63f01de | 2014-10-28 19:24:19 -0700 | [diff] [blame] | 1219 | OPTIONS.verify = True |
Doug Zongker | 26e6619 | 2014-02-20 13:22:07 -0800 | [diff] [blame] | 1220 | elif o == "--block": |
| 1221 | OPTIONS.block_based = True |
Doug Zongker | 2556848 | 2014-03-03 10:21:27 -0800 | [diff] [blame] | 1222 | elif o in ("-b", "--binary"): |
| 1223 | OPTIONS.updater_binary = a |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 1224 | elif o in ("--no_fallback_to_full",): |
| 1225 | OPTIONS.fallback_to_full = False |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 1226 | elif o == "--stash_threshold": |
| 1227 | try: |
| 1228 | OPTIONS.stash_threshold = float(a) |
| 1229 | except ValueError: |
| 1230 | raise ValueError("Cannot parse value %r for option %r - expecting " |
| 1231 | "a float" % (a, o)) |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 1232 | elif o == "--log_diff": |
| 1233 | OPTIONS.log_diff = a |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1234 | elif o == "--payload_signer": |
| 1235 | OPTIONS.payload_signer = a |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1236 | elif o == "--payload_signer_args": |
| 1237 | OPTIONS.payload_signer_args = shlex.split(a) |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1238 | elif o == "--extracted_input_target_files": |
| 1239 | OPTIONS.extracted_input = a |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1240 | else: |
| 1241 | return False |
Doug Zongker | dbfaae5 | 2009-04-21 17:12:54 -0700 | [diff] [blame] | 1242 | return True |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1243 | |
| 1244 | args = common.ParseOptions(argv, __doc__, |
Tao Bao | 337633f | 2017-12-06 15:20:19 -0800 | [diff] [blame] | 1245 | extra_opts="b:k:i:d:e:t:2o:", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1246 | extra_long_opts=[ |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1247 | "package_key=", |
| 1248 | "incremental_from=", |
Tao Bao | 43078aa | 2015-04-21 14:32:35 -0700 | [diff] [blame] | 1249 | "full_radio", |
leozwang | aa6c1a1 | 2015-08-14 10:57:58 -0700 | [diff] [blame] | 1250 | "full_bootloader", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1251 | "wipe_user_data", |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1252 | "downgrade", |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 1253 | "override_timestamp", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1254 | "extra_script=", |
| 1255 | "worker_threads=", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1256 | "two_step", |
| 1257 | "no_signing", |
| 1258 | "block", |
| 1259 | "binary=", |
| 1260 | "oem_settings=", |
Tao Bao | 8608cde | 2016-02-25 19:49:55 -0800 | [diff] [blame] | 1261 | "oem_no_mount", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1262 | "verify", |
| 1263 | "no_fallback_to_full", |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 1264 | "stash_threshold=", |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 1265 | "log_diff=", |
Tao Bao | dea0f8b | 2016-06-20 17:55:06 -0700 | [diff] [blame] | 1266 | "payload_signer=", |
Baligh Uddin | 2abbbd0 | 2016-06-22 12:14:16 -0700 | [diff] [blame] | 1267 | "payload_signer_args=", |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1268 | "extracted_input_target_files=", |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1269 | ], extra_option_handler=option_handler) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1270 | |
| 1271 | if len(args) != 2: |
| 1272 | common.Usage(__doc__) |
| 1273 | sys.exit(1) |
| 1274 | |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1275 | if OPTIONS.downgrade: |
| 1276 | # Sanity check to enforce a data wipe. |
| 1277 | if not OPTIONS.wipe_user_data: |
| 1278 | raise ValueError("Cannot downgrade without a data wipe") |
| 1279 | |
| 1280 | # We should only allow downgrading incrementals (as opposed to full). |
| 1281 | # Otherwise the device may go back from arbitrary build with this full |
| 1282 | # OTA package. |
| 1283 | if OPTIONS.incremental_source is None: |
Elliott Hughes | d8a52f9 | 2016-06-20 14:35:47 -0700 | [diff] [blame] | 1284 | raise ValueError("Cannot generate downgradable full OTAs") |
Tao Bao | 5d18256 | 2016-02-23 11:38:39 -0800 | [diff] [blame] | 1285 | |
Tao Bao | 3e6161a | 2017-02-28 11:48:48 -0800 | [diff] [blame] | 1286 | assert not (OPTIONS.downgrade and OPTIONS.timestamp), \ |
| 1287 | "Cannot have --downgrade AND --override_timestamp both" |
| 1288 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1289 | # Load the dict file from the zip directly to have a peek at the OTA type. |
| 1290 | # For packages using A/B update, unzipping is not needed. |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1291 | if OPTIONS.extracted_input is not None: |
| 1292 | OPTIONS.info_dict = common.LoadInfoDict(OPTIONS.extracted_input, OPTIONS.extracted_input) |
| 1293 | else: |
| 1294 | input_zip = zipfile.ZipFile(args[0], "r") |
| 1295 | OPTIONS.info_dict = common.LoadInfoDict(input_zip) |
| 1296 | common.ZipClose(input_zip) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1297 | |
| 1298 | ab_update = OPTIONS.info_dict.get("ab_update") == "true" |
| 1299 | |
Christian Oder | f63e2cd | 2017-05-01 22:30:15 +0200 | [diff] [blame] | 1300 | # Use the default key to sign the package if not specified with package_key. |
| 1301 | # package_keys are needed on ab_updates, so always define them if an |
| 1302 | # ab_update is getting created. |
| 1303 | if not OPTIONS.no_signing or ab_update: |
| 1304 | if OPTIONS.package_key is None: |
| 1305 | OPTIONS.package_key = OPTIONS.info_dict.get( |
| 1306 | "default_system_dev_certificate", |
| 1307 | "build/target/product/security/testkey") |
| 1308 | # Get signing keys |
| 1309 | OPTIONS.key_passwords = common.GetKeyPasswords([OPTIONS.package_key]) |
| 1310 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1311 | if ab_update: |
| 1312 | if OPTIONS.incremental_source is not None: |
| 1313 | OPTIONS.target_info_dict = OPTIONS.info_dict |
| 1314 | source_zip = zipfile.ZipFile(OPTIONS.incremental_source, "r") |
| 1315 | OPTIONS.source_info_dict = common.LoadInfoDict(source_zip) |
| 1316 | common.ZipClose(source_zip) |
| 1317 | |
| 1318 | if OPTIONS.verbose: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1319 | print("--- target info ---") |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1320 | common.DumpInfoDict(OPTIONS.info_dict) |
| 1321 | |
| 1322 | if OPTIONS.incremental_source is not None: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1323 | print("--- source info ---") |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1324 | common.DumpInfoDict(OPTIONS.source_info_dict) |
| 1325 | |
| 1326 | WriteABOTAPackageWithBrilloScript( |
| 1327 | target_file=args[0], |
| 1328 | output_file=args[1], |
| 1329 | source_file=OPTIONS.incremental_source) |
| 1330 | |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1331 | print("done.") |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1332 | return |
| 1333 | |
Doug Zongker | 1c390a2 | 2009-05-14 19:06:36 -0700 | [diff] [blame] | 1334 | if OPTIONS.extra_script is not None: |
| 1335 | OPTIONS.extra_script = open(OPTIONS.extra_script).read() |
| 1336 | |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1337 | if OPTIONS.extracted_input is not None: |
| 1338 | OPTIONS.input_tmp = OPTIONS.extracted_input |
| 1339 | OPTIONS.target_tmp = OPTIONS.input_tmp |
| 1340 | OPTIONS.info_dict = common.LoadInfoDict(OPTIONS.input_tmp, OPTIONS.input_tmp) |
| 1341 | input_zip = zipfile.ZipFile(args[0], "r") |
| 1342 | else: |
| 1343 | print("unzipping target target-files...") |
| 1344 | OPTIONS.input_tmp, input_zip = common.UnzipTemp( |
| 1345 | args[0], UNZIP_PATTERN) |
Doug Zongker | fdd8e69 | 2009-08-03 17:27:48 -0700 | [diff] [blame] | 1346 | |
Dan Willemsen | cea5cd2 | 2017-03-21 14:44:27 -0700 | [diff] [blame] | 1347 | OPTIONS.target_tmp = OPTIONS.input_tmp |
| 1348 | OPTIONS.info_dict = common.LoadInfoDict(input_zip, OPTIONS.target_tmp) |
Kenny Root | e2e9f61 | 2013-05-29 12:59:35 -0700 | [diff] [blame] | 1349 | |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 1350 | if OPTIONS.verbose: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1351 | print("--- target info ---") |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 1352 | common.DumpInfoDict(OPTIONS.info_dict) |
| 1353 | |
Doug Zongker | eb0a78a | 2014-01-27 10:01:06 -0800 | [diff] [blame] | 1354 | # If the caller explicitly specified the device-specific extensions |
| 1355 | # path via -s/--device_specific, use that. Otherwise, use |
| 1356 | # META/releasetools.py if it is present in the target target_files. |
| 1357 | # Otherwise, take the path of the file from 'tool_extensions' in the |
| 1358 | # info dict and look for that in the local filesystem, relative to |
| 1359 | # the current directory. |
| 1360 | |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 1361 | if OPTIONS.device_specific is None: |
Doug Zongker | eb0a78a | 2014-01-27 10:01:06 -0800 | [diff] [blame] | 1362 | from_input = os.path.join(OPTIONS.input_tmp, "META", "releasetools.py") |
| 1363 | if os.path.exists(from_input): |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1364 | print("(using device-specific extensions from target_files)") |
Doug Zongker | eb0a78a | 2014-01-27 10:01:06 -0800 | [diff] [blame] | 1365 | OPTIONS.device_specific = from_input |
| 1366 | else: |
| 1367 | OPTIONS.device_specific = OPTIONS.info_dict.get("tool_extensions", None) |
| 1368 | |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 1369 | if OPTIONS.device_specific is not None: |
Doug Zongker | eb0a78a | 2014-01-27 10:01:06 -0800 | [diff] [blame] | 1370 | OPTIONS.device_specific = os.path.abspath(OPTIONS.device_specific) |
Doug Zongker | 3797473 | 2010-09-16 17:44:38 -0700 | [diff] [blame] | 1371 | |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1372 | if OPTIONS.info_dict.get("no_recovery") == "true": |
Tao Bao | db45efa | 2015-10-27 19:25:18 -0700 | [diff] [blame] | 1373 | raise common.ExternalError( |
| 1374 | "--- target build has specified no recovery ---") |
| 1375 | |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1376 | # Set up the output zip. Create a temporary zip file if signing is needed. |
| 1377 | if OPTIONS.no_signing: |
| 1378 | if os.path.exists(args[1]): |
| 1379 | os.unlink(args[1]) |
| 1380 | output_zip = zipfile.ZipFile(args[1], "w", |
| 1381 | compression=zipfile.ZIP_DEFLATED) |
| 1382 | else: |
| 1383 | temp_zip_file = tempfile.NamedTemporaryFile() |
| 1384 | output_zip = zipfile.ZipFile(temp_zip_file, "w", |
| 1385 | compression=zipfile.ZIP_DEFLATED) |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 1386 | |
Daniel Rosenberg | 40ef35b | 2015-11-10 19:21:34 -0800 | [diff] [blame] | 1387 | # Non A/B OTAs rely on /cache partition to store temporary files. |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1388 | cache_size = OPTIONS.info_dict.get("cache_size", None) |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1389 | if cache_size is None: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1390 | print("--- can't determine the cache partition size ---") |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1391 | OPTIONS.cache_size = cache_size |
Tao Bao | 8dcf738 | 2015-05-21 14:09:49 -0700 | [diff] [blame] | 1392 | |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1393 | # Generate a full OTA. |
Tao Bao | 0c6a414 | 2017-12-15 10:11:19 -0800 | [diff] [blame] | 1394 | if OPTIONS.incremental_source is None: |
Tao Bao | c098e9e | 2016-01-07 13:03:56 -0800 | [diff] [blame] | 1395 | WriteFullOTAPackage(input_zip, output_zip) |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1396 | |
| 1397 | # Generate an incremental OTA. It will fall back to generate a full OTA on |
| 1398 | # failure unless no_fallback_to_full is specified. |
| 1399 | else: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1400 | print("unzipping source target-files...") |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1401 | OPTIONS.source_tmp, source_zip = common.UnzipTemp( |
Tao Bao | 6b0b2f9 | 2017-03-05 11:38:11 -0800 | [diff] [blame] | 1402 | OPTIONS.incremental_source, |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 1403 | UNZIP_PATTERN) |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1404 | OPTIONS.target_info_dict = OPTIONS.info_dict |
| 1405 | OPTIONS.source_info_dict = common.LoadInfoDict(source_zip, |
| 1406 | OPTIONS.source_tmp) |
| 1407 | if OPTIONS.verbose: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1408 | print("--- source info ---") |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1409 | common.DumpInfoDict(OPTIONS.source_info_dict) |
| 1410 | try: |
Tao Bao | 457cbf6 | 2017-03-06 09:56:01 -0800 | [diff] [blame] | 1411 | WriteBlockIncrementalOTAPackage(input_zip, source_zip, output_zip) |
Tao Bao | d62c603 | 2015-11-30 09:40:20 -0800 | [diff] [blame] | 1412 | if OPTIONS.log_diff: |
| 1413 | out_file = open(OPTIONS.log_diff, 'w') |
| 1414 | import target_files_diff |
| 1415 | target_files_diff.recursiveDiff('', |
| 1416 | OPTIONS.source_tmp, |
| 1417 | OPTIONS.input_tmp, |
| 1418 | out_file) |
| 1419 | out_file.close() |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1420 | except ValueError: |
| 1421 | if not OPTIONS.fallback_to_full: |
| 1422 | raise |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1423 | print("--- failed to build incremental; falling back to full ---") |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1424 | OPTIONS.incremental_source = None |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 1425 | WriteFullOTAPackage(input_zip, output_zip) |
Doug Zongker | 62d4f18 | 2014-08-04 16:06:43 -0700 | [diff] [blame] | 1426 | |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1427 | common.ZipClose(output_zip) |
Doug Zongker | afb32ea | 2011-09-22 10:28:04 -0700 | [diff] [blame] | 1428 | |
Tao Bao | 767e3ac | 2015-11-10 12:19:19 -0800 | [diff] [blame] | 1429 | # Sign the generated zip package unless no_signing is specified. |
Takeshi Kanemoto | e153b34 | 2013-11-14 17:20:50 +0900 | [diff] [blame] | 1430 | if not OPTIONS.no_signing: |
| 1431 | SignOutput(temp_zip_file.name, args[1]) |
| 1432 | temp_zip_file.close() |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1433 | |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1434 | print("done.") |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1435 | |
| 1436 | |
| 1437 | if __name__ == '__main__': |
| 1438 | try: |
Ying Wang | 7e6d4e4 | 2010-12-13 16:25:36 -0800 | [diff] [blame] | 1439 | common.CloseInheritedPipes() |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1440 | main(sys.argv[1:]) |
Dan Albert | 8b72aef | 2015-03-23 19:13:21 -0700 | [diff] [blame] | 1441 | except common.ExternalError as e: |
Tao Bao | 89fbb0f | 2017-01-10 10:47:58 -0800 | [diff] [blame] | 1442 | print("\n ERROR: %s\n" % (e,)) |
Doug Zongker | eef3944 | 2009-04-02 12:14:19 -0700 | [diff] [blame] | 1443 | sys.exit(1) |
Doug Zongker | fc44a51 | 2014-08-26 13:10:25 -0700 | [diff] [blame] | 1444 | finally: |
| 1445 | common.Cleanup() |