blob: d5ac9224a85be623c7d43773f745652b6b2c3c5a [file] [log] [blame]
Doug Zongkereef39442009-04-02 12:14:19 -07001#!/usr/bin/env python
2#
3# Copyright (C) 2008 The Android Open Source Project
4#
5# Licensed under the Apache License, Version 2.0 (the "License");
6# you may not use this file except in compliance with the License.
7# You may obtain a copy of the License at
8#
9# http://www.apache.org/licenses/LICENSE-2.0
10#
11# Unless required by applicable law or agreed to in writing, software
12# distributed under the License is distributed on an "AS IS" BASIS,
13# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
14# See the License for the specific language governing permissions and
15# limitations under the License.
16
17"""
18Given a target-files zipfile, produces an OTA package that installs
19that build. An incremental OTA is produced if -i is given, otherwise
20a full OTA is produced.
21
22Usage: ota_from_target_files [flags] input_target_files output_ota_package
23
Doug Zongkerafb32ea2011-09-22 10:28:04 -070024 -k (--package_key) <key> Key to use to sign the package (default is
25 the value of default_system_dev_certificate from the input
26 target-files's META/misc_info.txt, or
27 "build/target/product/security/testkey" if that value is not
28 specified).
29
30 For incremental OTAs, the default value is based on the source
31 target-file, not the target build.
Doug Zongkereef39442009-04-02 12:14:19 -070032
33 -i (--incremental_from) <file>
34 Generate an incremental OTA using the given target-files zip as
35 the starting build.
36
Tao Bao43078aa2015-04-21 14:32:35 -070037 --full_radio
38 When generating an incremental OTA, always include a full copy of
39 radio image. This option is only meaningful when -i is specified,
40 because a full radio is always included in a full OTA if applicable.
41
leozwangaa6c1a12015-08-14 10:57:58 -070042 --full_bootloader
43 Similar to --full_radio. When generating an incremental OTA, always
44 include a full copy of bootloader image.
45
Tao Baoedb35b82017-10-30 16:07:13 -070046 --verify
47 Remount and verify the checksums of the files written to the system and
48 vendor (if used) partitions. Non-A/B incremental OTAs only.
Michael Runge63f01de2014-10-28 19:24:19 -070049
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -080050 -o (--oem_settings) <main_file[,additional_files...]>
51 Comma seperated list of files used to specify the expected OEM-specific
52 properties on the OEM partition of the intended device.
53 Multiple expected values can be used by providing multiple files.
54
Tao Bao8608cde2016-02-25 19:49:55 -080055 --oem_no_mount
56 For devices with OEM-specific properties but without an OEM partition,
57 do not mount the OEM partition in the updater-script. This should be
58 very rarely used, since it's expected to have a dedicated OEM partition
59 for OEM-specific properties. Only meaningful when -o is specified.
60
Tao Bao337633f2017-12-06 15:20:19 -080061 --wipe_user_data
Doug Zongkerdbfaae52009-04-21 17:12:54 -070062 Generate an OTA package that will wipe the user data partition
63 when installed.
64
Tao Bao5d182562016-02-23 11:38:39 -080065 --downgrade
66 Intentionally generate an incremental OTA that updates from a newer
67 build to an older one (based on timestamp comparison). "post-timestamp"
68 will be replaced by "ota-downgrade=yes" in the metadata file. A data
69 wipe will always be enforced, so "ota-wipe=yes" will also be included in
Tao Bao4996cf02016-03-08 17:53:39 -080070 the metadata file. The update-binary in the source build will be used in
Tao Bao3e6161a2017-02-28 11:48:48 -080071 the OTA package, unless --binary flag is specified. Please also check the
72 doc for --override_timestamp below.
73
74 --override_timestamp
75 Intentionally generate an incremental OTA that updates from a newer
76 build to an older one (based on timestamp comparison), by overriding the
77 timestamp in package metadata. This differs from --downgrade flag: we
78 know for sure this is NOT an actual downgrade case, but two builds are
79 cut in a reverse order. A legit use case is that we cut a new build C
80 (after having A and B), but want to enfore an update path of A -> C -> B.
81 Specifying --downgrade may not help since that would enforce a data wipe
82 for C -> B update. The value of "post-timestamp" will be set to the newer
83 timestamp plus one, so that the package can be pushed and applied.
Tao Bao5d182562016-02-23 11:38:39 -080084
Doug Zongker1c390a22009-05-14 19:06:36 -070085 -e (--extra_script) <file>
86 Insert the contents of file at the end of the update script.
87
Doug Zongker9b23f2c2013-11-25 14:44:12 -080088 -2 (--two_step)
89 Generate a 'two-step' OTA package, where recovery is updated
90 first, so that any changes made to the system partition are done
91 using the new recovery (new kernel, etc.).
92
Doug Zongker26e66192014-02-20 13:22:07 -080093 --block
Tao Bao457cbf62017-03-06 09:56:01 -080094 Generate a block-based OTA for non-A/B device. We have deprecated the
95 support for file-based OTA since O. Block-based OTA will be used by
96 default for all non-A/B devices. Keeping this flag here to not break
97 existing callers.
Doug Zongker26e66192014-02-20 13:22:07 -080098
Doug Zongker25568482014-03-03 10:21:27 -080099 -b (--binary) <file>
100 Use the given binary as the update-binary in the output package,
101 instead of the binary in the build's target_files. Use for
102 development only.
103
Martin Blumenstingl374e1142014-05-31 20:42:55 +0200104 -t (--worker_threads) <int>
105 Specifies the number of worker-threads that will be used when
106 generating patches for incremental updates (defaults to 3).
107
Tao Bao8dcf7382015-05-21 14:09:49 -0700108 --stash_threshold <float>
109 Specifies the threshold that will be used to compute the maximum
110 allowed stash size (defaults to 0.8).
Tao Bao9bc6bb22015-11-09 16:58:28 -0800111
Tao Baod62c6032015-11-30 09:40:20 -0800112 --log_diff <file>
113 Generate a log file that shows the differences in the source and target
114 builds for an incremental package. This option is only meaningful when
115 -i is specified.
Tao Baodea0f8b2016-06-20 17:55:06 -0700116
117 --payload_signer <signer>
118 Specify the signer when signing the payload and metadata for A/B OTAs.
119 By default (i.e. without this flag), it calls 'openssl pkeyutl' to sign
120 with the package private key. If the private key cannot be accessed
121 directly, a payload signer that knows how to do that should be specified.
122 The signer will be supplied with "-inkey <path_to_key>",
123 "-in <input_file>" and "-out <output_file>" parameters.
Baligh Uddin2abbbd02016-06-22 12:14:16 -0700124
125 --payload_signer_args <args>
126 Specify the arguments needed for payload signer.
Doug Zongkereef39442009-04-02 12:14:19 -0700127"""
128
Tao Bao89fbb0f2017-01-10 10:47:58 -0800129from __future__ import print_function
130
Doug Zongkereef39442009-04-02 12:14:19 -0700131import sys
132
Doug Zongkercf6d5a92014-02-18 10:57:07 -0800133if sys.hexversion < 0x02070000:
Tao Bao89fbb0f2017-01-10 10:47:58 -0800134 print("Python 2.7 or newer is required.", file=sys.stderr)
Doug Zongkereef39442009-04-02 12:14:19 -0700135 sys.exit(1)
136
Doug Zongkerfc44a512014-08-26 13:10:25 -0700137import multiprocessing
Tao Bao2dd1c482017-02-03 16:49:39 -0800138import os.path
Tao Baoc098e9e2016-01-07 13:03:56 -0800139import subprocess
Baligh Uddin2abbbd02016-06-22 12:14:16 -0700140import shlex
Doug Zongkereef39442009-04-02 12:14:19 -0700141import tempfile
Doug Zongkereef39442009-04-02 12:14:19 -0700142import zipfile
143
144import common
Doug Zongkerc494d7c2009-06-18 08:43:44 -0700145import edify_generator
Doug Zongkerfc44a512014-08-26 13:10:25 -0700146import sparse_img
Doug Zongkereef39442009-04-02 12:14:19 -0700147
148OPTIONS = common.OPTIONS
Doug Zongkerafb32ea2011-09-22 10:28:04 -0700149OPTIONS.package_key = None
Doug Zongkereef39442009-04-02 12:14:19 -0700150OPTIONS.incremental_source = None
Michael Runge63f01de2014-10-28 19:24:19 -0700151OPTIONS.verify = False
Doug Zongkereef39442009-04-02 12:14:19 -0700152OPTIONS.patch_threshold = 0.95
Doug Zongkerdbfaae52009-04-21 17:12:54 -0700153OPTIONS.wipe_user_data = False
Tao Bao5d182562016-02-23 11:38:39 -0800154OPTIONS.downgrade = False
Tao Bao3e6161a2017-02-28 11:48:48 -0800155OPTIONS.timestamp = False
Doug Zongker1c390a22009-05-14 19:06:36 -0700156OPTIONS.extra_script = None
Doug Zongkerfc44a512014-08-26 13:10:25 -0700157OPTIONS.worker_threads = multiprocessing.cpu_count() // 2
158if OPTIONS.worker_threads == 0:
159 OPTIONS.worker_threads = 1
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800160OPTIONS.two_step = False
Takeshi Kanemotoe153b342013-11-14 17:20:50 +0900161OPTIONS.no_signing = False
Tao Bao457cbf62017-03-06 09:56:01 -0800162OPTIONS.block_based = True
Doug Zongker25568482014-03-03 10:21:27 -0800163OPTIONS.updater_binary = None
Michael Runge6e836112014-04-15 17:40:21 -0700164OPTIONS.oem_source = None
Tao Bao8608cde2016-02-25 19:49:55 -0800165OPTIONS.oem_no_mount = False
Doug Zongker62d4f182014-08-04 16:06:43 -0700166OPTIONS.fallback_to_full = True
Tao Bao43078aa2015-04-21 14:32:35 -0700167OPTIONS.full_radio = False
leozwangaa6c1a12015-08-14 10:57:58 -0700168OPTIONS.full_bootloader = False
Tao Baod47d8e12015-05-21 14:09:49 -0700169# Stash size cannot exceed cache_size * threshold.
170OPTIONS.cache_size = None
171OPTIONS.stash_threshold = 0.8
Tao Baod62c6032015-11-30 09:40:20 -0800172OPTIONS.log_diff = None
Tao Baodea0f8b2016-06-20 17:55:06 -0700173OPTIONS.payload_signer = None
Baligh Uddin2abbbd02016-06-22 12:14:16 -0700174OPTIONS.payload_signer_args = []
Tao Bao5f8ff932017-03-21 22:35:00 -0700175OPTIONS.extracted_input = None
Christian Oderf63e2cd2017-05-01 22:30:15 +0200176OPTIONS.key_passwords = []
Tao Bao8dcf7382015-05-21 14:09:49 -0700177
Tao Bao2dd1c482017-02-03 16:49:39 -0800178METADATA_NAME = 'META-INF/com/android/metadata'
Tao Bao6b0b2f92017-03-05 11:38:11 -0800179UNZIP_PATTERN = ['IMAGES/*', 'META/*']
180
Tao Bao2dd1c482017-02-03 16:49:39 -0800181
Doug Zongkereef39442009-04-02 12:14:19 -0700182def SignOutput(temp_zip_name, output_zip_name):
Christian Oderf63e2cd2017-05-01 22:30:15 +0200183 pw = OPTIONS.key_passwords[OPTIONS.package_key]
Doug Zongkereef39442009-04-02 12:14:19 -0700184
Doug Zongker951495f2009-08-14 12:44:19 -0700185 common.SignFile(temp_zip_name, output_zip_name, OPTIONS.package_key, pw,
186 whole_file=True)
Doug Zongkereef39442009-04-02 12:14:19 -0700187
188
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800189def AppendAssertions(script, info_dict, oem_dicts=None):
Michael Runge6e836112014-04-15 17:40:21 -0700190 oem_props = info_dict.get("oem_fingerprint_properties")
Tao Bao3e30d972016-03-15 13:20:19 -0700191 if not oem_props:
Michael Runge6e836112014-04-15 17:40:21 -0700192 device = GetBuildProp("ro.product.device", info_dict)
193 script.AssertDevice(device)
194 else:
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800195 if not oem_dicts:
Dan Albert8b72aef2015-03-23 19:13:21 -0700196 raise common.ExternalError(
197 "No OEM file provided to answer expected assertions")
Michael Runge6e836112014-04-15 17:40:21 -0700198 for prop in oem_props.split():
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800199 values = []
200 for oem_dict in oem_dicts:
201 if oem_dict.get(prop):
202 values.append(oem_dict[prop])
203 if not values:
Dan Albert8b72aef2015-03-23 19:13:21 -0700204 raise common.ExternalError(
205 "The OEM file is missing the property %s" % prop)
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800206 script.AssertOemProperty(prop, values)
207
208
Tao Baoebce6972017-03-06 10:22:20 -0800209def _LoadOemDicts(script, recovery_mount_options=None):
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800210 """Returns the list of loaded OEM properties dict."""
211 oem_dicts = None
212 if OPTIONS.oem_source is None:
213 raise common.ExternalError("OEM source required for this build")
Tao Baoebce6972017-03-06 10:22:20 -0800214 if not OPTIONS.oem_no_mount and script:
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800215 script.Mount("/oem", recovery_mount_options)
216 oem_dicts = []
217 for oem_file in OPTIONS.oem_source:
218 oem_dicts.append(common.LoadDictionaryFromLines(
219 open(oem_file).readlines()))
220 return oem_dicts
Doug Zongkereef39442009-04-02 12:14:19 -0700221
Doug Zongkereef39442009-04-02 12:14:19 -0700222
Tao Baod42e97e2016-11-30 12:11:57 -0800223def _WriteRecoveryImageToBoot(script, output_zip):
224 """Find and write recovery image to /boot in two-step OTA.
225
226 In two-step OTAs, we write recovery image to /boot as the first step so that
227 we can reboot to there and install a new recovery image to /recovery.
228 A special "recovery-two-step.img" will be preferred, which encodes the correct
229 path of "/boot". Otherwise the device may show "device is corrupt" message
230 when booting into /boot.
231
232 Fall back to using the regular recovery.img if the two-step recovery image
233 doesn't exist. Note that rebuilding the special image at this point may be
234 infeasible, because we don't have the desired boot signer and keys when
235 calling ota_from_target_files.py.
236 """
237
238 recovery_two_step_img_name = "recovery-two-step.img"
239 recovery_two_step_img_path = os.path.join(
240 OPTIONS.input_tmp, "IMAGES", recovery_two_step_img_name)
241 if os.path.exists(recovery_two_step_img_path):
242 recovery_two_step_img = common.GetBootableImage(
243 recovery_two_step_img_name, recovery_two_step_img_name,
244 OPTIONS.input_tmp, "RECOVERY")
245 common.ZipWriteStr(
246 output_zip, recovery_two_step_img_name, recovery_two_step_img.data)
Tao Bao89fbb0f2017-01-10 10:47:58 -0800247 print("two-step package: using %s in stage 1/3" % (
248 recovery_two_step_img_name,))
Tao Baod42e97e2016-11-30 12:11:57 -0800249 script.WriteRawImage("/boot", recovery_two_step_img_name)
250 else:
Tao Bao89fbb0f2017-01-10 10:47:58 -0800251 print("two-step package: using recovery.img in stage 1/3")
Tao Baod42e97e2016-11-30 12:11:57 -0800252 # The "recovery.img" entry has been written into package earlier.
253 script.WriteRawImage("/boot", "recovery.img")
254
255
Doug Zongkerc9253822014-02-04 12:17:58 -0800256def HasRecoveryPatch(target_files_zip):
Tao Baof2cffbd2015-07-22 12:33:18 -0700257 namelist = [name for name in target_files_zip.namelist()]
258 return ("SYSTEM/recovery-from-boot.p" in namelist or
259 "SYSTEM/etc/recovery.img" in namelist)
Doug Zongker73ef8252009-07-23 15:12:53 -0700260
Tao Bao457cbf62017-03-06 09:56:01 -0800261
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700262def HasVendorPartition(target_files_zip):
263 try:
264 target_files_zip.getinfo("VENDOR/")
265 return True
266 except KeyError:
267 return False
268
Tao Bao457cbf62017-03-06 09:56:01 -0800269
Tao Baobcd1d162017-08-26 13:10:26 -0700270def HasTrebleEnabled(target_files_zip, info_dict):
271 return (HasVendorPartition(target_files_zip) and
272 GetBuildProp("ro.treble.enabled", info_dict) == "true")
273
274
Michael Runge6e836112014-04-15 17:40:21 -0700275def GetOemProperty(name, oem_props, oem_dict, info_dict):
276 if oem_props is not None and name in oem_props:
277 return oem_dict[name]
278 return GetBuildProp(name, info_dict)
279
280
281def CalculateFingerprint(oem_props, oem_dict, info_dict):
282 if oem_props is None:
283 return GetBuildProp("ro.build.fingerprint", info_dict)
284 return "%s/%s/%s:%s" % (
Dan Albert8b72aef2015-03-23 19:13:21 -0700285 GetOemProperty("ro.product.brand", oem_props, oem_dict, info_dict),
286 GetOemProperty("ro.product.name", oem_props, oem_dict, info_dict),
287 GetOemProperty("ro.product.device", oem_props, oem_dict, info_dict),
288 GetBuildProp("ro.build.thumbprint", info_dict))
Doug Zongker73ef8252009-07-23 15:12:53 -0700289
Doug Zongkerfc44a512014-08-26 13:10:25 -0700290
Tao Bao7e0f1602017-03-06 15:50:08 -0800291def GetImage(which, tmpdir):
292 """Returns an image object suitable for passing to BlockImageDiff.
293
294 'which' partition must be "system" or "vendor". A prebuilt image and file
295 map must already exist in tmpdir.
296 """
Doug Zongker3c84f562014-07-31 11:06:30 -0700297
298 assert which in ("system", "vendor")
299
300 path = os.path.join(tmpdir, "IMAGES", which + ".img")
Doug Zongkerfc44a512014-08-26 13:10:25 -0700301 mappath = os.path.join(tmpdir, "IMAGES", which + ".map")
Doug Zongker3c84f562014-07-31 11:06:30 -0700302
Tao Bao7e0f1602017-03-06 15:50:08 -0800303 # The image and map files must have been created prior to calling
304 # ota_from_target_files.py (since LMP).
305 assert os.path.exists(path) and os.path.exists(mappath)
Doug Zongker3c84f562014-07-31 11:06:30 -0700306
Tao Baoff777812015-05-12 11:42:31 -0700307 # Bug: http://b/20939131
308 # In ext4 filesystems, block 0 might be changed even being mounted
309 # R/O. We add it to clobbered_blocks so that it will be written to the
310 # target unconditionally. Note that they are still part of care_map.
311 clobbered_blocks = "0"
312
313 return sparse_img.SparseImage(path, mappath, clobbered_blocks)
Doug Zongkerfc44a512014-08-26 13:10:25 -0700314
315
Tao Baobcd1d162017-08-26 13:10:26 -0700316def AddCompatibilityArchiveIfTrebleEnabled(target_zip, output_zip,
317 target_info_dict,
318 source_info_dict=None):
319 """Adds compatibility info into the output zip if it's Treble-enabled target.
Tao Bao21803d32017-04-19 10:16:09 -0700320
321 Metadata used for on-device compatibility verification is retrieved from
322 target_zip then added to compatibility.zip which is added to the output_zip
323 archive.
324
Tao Baobcd1d162017-08-26 13:10:26 -0700325 Compatibility archive should only be included for devices that have enabled
326 Treble support.
Tao Bao21803d32017-04-19 10:16:09 -0700327
328 Args:
329 target_zip: Zip file containing the source files to be included for OTA.
330 output_zip: Zip file that will be sent for OTA.
Tao Baobcd1d162017-08-26 13:10:26 -0700331 target_info_dict: The dict that holds the target build info.
332 source_info_dict: The dict that holds the source build info, if generating
333 an incremental OTA; None otherwise.
Tao Bao21803d32017-04-19 10:16:09 -0700334 """
335
Tao Baobcd1d162017-08-26 13:10:26 -0700336 def AddCompatibilityArchive(system_updated, vendor_updated):
337 """Adds compatibility info based on system/vendor update status.
Tao Bao21803d32017-04-19 10:16:09 -0700338
Tao Baobcd1d162017-08-26 13:10:26 -0700339 Args:
340 system_updated: If True, the system image will be updated and therefore
341 its metadata should be included.
342 vendor_updated: If True, the vendor image will be updated and therefore
343 its metadata should be included.
344 """
345 # Determine what metadata we need. Files are names relative to META/.
346 compatibility_files = []
347 vendor_metadata = ("vendor_manifest.xml", "vendor_matrix.xml")
348 system_metadata = ("system_manifest.xml", "system_matrix.xml")
349 if vendor_updated:
350 compatibility_files += vendor_metadata
351 if system_updated:
352 compatibility_files += system_metadata
Tao Bao21803d32017-04-19 10:16:09 -0700353
Tao Baobcd1d162017-08-26 13:10:26 -0700354 # Create new archive.
355 compatibility_archive = tempfile.NamedTemporaryFile()
356 compatibility_archive_zip = zipfile.ZipFile(compatibility_archive, "w",
357 compression=zipfile.ZIP_DEFLATED)
Tao Bao21803d32017-04-19 10:16:09 -0700358
Tao Baobcd1d162017-08-26 13:10:26 -0700359 # Add metadata.
360 for file_name in compatibility_files:
361 target_file_name = "META/" + file_name
Tao Bao21803d32017-04-19 10:16:09 -0700362
Tao Baobcd1d162017-08-26 13:10:26 -0700363 if target_file_name in target_zip.namelist():
364 data = target_zip.read(target_file_name)
365 common.ZipWriteStr(compatibility_archive_zip, file_name, data)
Tao Bao21803d32017-04-19 10:16:09 -0700366
Tao Baobcd1d162017-08-26 13:10:26 -0700367 # Ensure files are written before we copy into output_zip.
368 compatibility_archive_zip.close()
369
370 # Only add the archive if we have any compatibility info.
371 if compatibility_archive_zip.namelist():
372 common.ZipWrite(output_zip, compatibility_archive.name,
373 arcname="compatibility.zip",
374 compress_type=zipfile.ZIP_STORED)
375
376 # Will only proceed if the target has enabled the Treble support (as well as
377 # having a /vendor partition).
378 if not HasTrebleEnabled(target_zip, target_info_dict):
379 return
380
381 # We don't support OEM thumbprint in Treble world (which calculates
382 # fingerprints in a different way as shown in CalculateFingerprint()).
383 assert not target_info_dict.get("oem_fingerprint_properties")
384
385 # Full OTA carries the info for system/vendor both.
386 if source_info_dict is None:
387 AddCompatibilityArchive(True, True)
388 return
389
390 assert not source_info_dict.get("oem_fingerprint_properties")
391
392 source_fp = GetBuildProp("ro.build.fingerprint", source_info_dict)
393 target_fp = GetBuildProp("ro.build.fingerprint", target_info_dict)
394 system_updated = source_fp != target_fp
395
396 source_fp_vendor = GetVendorBuildProp("ro.vendor.build.fingerprint",
397 source_info_dict)
398 target_fp_vendor = GetVendorBuildProp("ro.vendor.build.fingerprint",
399 target_info_dict)
400 vendor_updated = source_fp_vendor != target_fp_vendor
401
402 AddCompatibilityArchive(system_updated, vendor_updated)
Tao Bao21803d32017-04-19 10:16:09 -0700403
404
Doug Zongkerc77a9ad2010-09-16 11:28:43 -0700405def WriteFullOTAPackage(input_zip, output_zip):
Doug Zongker9ce2ebf2010-04-21 14:08:44 -0700406 # TODO: how to determine this? We don't know what version it will
Tao Bao34b47bf2015-06-22 19:17:41 -0700407 # be installed on top of. For now, we expect the API just won't
408 # change very often. Similarly for fstab, it might have changed
409 # in the target build.
Doug Zongkerc77a9ad2010-09-16 11:28:43 -0700410 script = edify_generator.EdifyGenerator(3, OPTIONS.info_dict)
Doug Zongkereef39442009-04-02 12:14:19 -0700411
Tao Bao3e30d972016-03-15 13:20:19 -0700412 oem_props = OPTIONS.info_dict.get("oem_fingerprint_properties")
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800413 oem_dicts = None
Tao Bao3e30d972016-03-15 13:20:19 -0700414 if oem_props:
Tao Bao2f5358d2017-12-20 22:48:19 -0800415 recovery_mount_options = OPTIONS.info_dict.get("recovery_mount_options")
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800416 oem_dicts = _LoadOemDicts(script, recovery_mount_options)
Michael Runge6e836112014-04-15 17:40:21 -0700417
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800418 target_fp = CalculateFingerprint(oem_props, oem_dicts and oem_dicts[0],
419 OPTIONS.info_dict)
Dan Albert8b72aef2015-03-23 19:13:21 -0700420 metadata = {
Tao Bao39f3eaf2017-03-09 15:01:11 -0800421 "post-build": target_fp,
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800422 "pre-device": GetOemProperty("ro.product.device", oem_props,
423 oem_dicts and oem_dicts[0],
Dan Albert8b72aef2015-03-23 19:13:21 -0700424 OPTIONS.info_dict),
425 "post-timestamp": GetBuildProp("ro.build.date.utc", OPTIONS.info_dict),
426 }
Doug Zongker2ea21062010-04-28 16:05:21 -0700427
Doug Zongker05d3dea2009-06-22 11:32:31 -0700428 device_specific = common.DeviceSpecificParams(
429 input_zip=input_zip,
Doug Zongker37974732010-09-16 17:44:38 -0700430 input_version=OPTIONS.info_dict["recovery_api_version"],
Doug Zongker05d3dea2009-06-22 11:32:31 -0700431 output_zip=output_zip,
432 script=script,
Doug Zongker2ea21062010-04-28 16:05:21 -0700433 input_tmp=OPTIONS.input_tmp,
Doug Zongker96a57e72010-09-26 14:57:41 -0700434 metadata=metadata,
435 info_dict=OPTIONS.info_dict)
Doug Zongker05d3dea2009-06-22 11:32:31 -0700436
Tao Bao457cbf62017-03-06 09:56:01 -0800437 assert HasRecoveryPatch(input_zip)
Doug Zongkerc9253822014-02-04 12:17:58 -0800438
Tao Bao457cbf62017-03-06 09:56:01 -0800439 metadata["ota-type"] = "BLOCK"
Tao Baod8d14be2016-02-04 14:26:02 -0800440
Elliott Hughesd8a52f92016-06-20 14:35:47 -0700441 ts = GetBuildProp("ro.build.date.utc", OPTIONS.info_dict)
442 ts_text = GetBuildProp("ro.build.date", OPTIONS.info_dict)
443 script.AssertOlderBuild(ts, ts_text)
Doug Zongkereef39442009-04-02 12:14:19 -0700444
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800445 AppendAssertions(script, OPTIONS.info_dict, oem_dicts)
Doug Zongker05d3dea2009-06-22 11:32:31 -0700446 device_specific.FullOTA_Assertions()
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800447
448 # Two-step package strategy (in chronological order, which is *not*
449 # the order in which the generated script has things):
450 #
451 # if stage is not "2/3" or "3/3":
452 # write recovery image to boot partition
453 # set stage to "2/3"
454 # reboot to boot partition and restart recovery
455 # else if stage is "2/3":
456 # write recovery image to recovery partition
457 # set stage to "3/3"
458 # reboot to recovery partition and restart recovery
459 # else:
460 # (stage must be "3/3")
461 # set stage to ""
462 # do normal full package installation:
463 # wipe and install system, boot image, etc.
464 # set up system to update recovery partition on first boot
Dan Albert8b72aef2015-03-23 19:13:21 -0700465 # complete script normally
466 # (allow recovery to mark itself finished and reboot)
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800467
468 recovery_img = common.GetBootableImage("recovery.img", "recovery.img",
469 OPTIONS.input_tmp, "RECOVERY")
470 if OPTIONS.two_step:
471 if not OPTIONS.info_dict.get("multistage_support", None):
472 assert False, "two-step packages not supported by this build"
473 fs = OPTIONS.info_dict["fstab"]["/misc"]
474 assert fs.fs_type.upper() == "EMMC", \
475 "two-step packages only supported on devices with EMMC /misc partitions"
476 bcb_dev = {"bcb_dev": fs.device}
477 common.ZipWriteStr(output_zip, "recovery.img", recovery_img.data)
478 script.AppendExtra("""
Michael Rungefb8886d2014-10-23 13:51:04 -0700479if get_stage("%(bcb_dev)s") == "2/3" then
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800480""" % bcb_dev)
Tao Baod42e97e2016-11-30 12:11:57 -0800481
482 # Stage 2/3: Write recovery image to /recovery (currently running /boot).
483 script.Comment("Stage 2/3")
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800484 script.WriteRawImage("/recovery", "recovery.img")
485 script.AppendExtra("""
486set_stage("%(bcb_dev)s", "3/3");
487reboot_now("%(bcb_dev)s", "recovery");
Michael Rungefb8886d2014-10-23 13:51:04 -0700488else if get_stage("%(bcb_dev)s") == "3/3" then
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800489""" % bcb_dev)
490
Tao Baod42e97e2016-11-30 12:11:57 -0800491 # Stage 3/3: Make changes.
492 script.Comment("Stage 3/3")
493
Tao Bao6c55a8a2015-04-08 15:30:27 -0700494 # Dump fingerprints
Tao Bao3e30d972016-03-15 13:20:19 -0700495 script.Print("Target: %s" % target_fp)
Tao Bao6c55a8a2015-04-08 15:30:27 -0700496
Doug Zongkere5ff5902012-01-17 10:55:37 -0800497 device_specific.FullOTA_InstallBegin()
Doug Zongker171f1cd2009-06-15 22:36:37 -0700498
Doug Zongker01ce19c2014-02-04 13:48:15 -0800499 system_progress = 0.75
Doug Zongkereef39442009-04-02 12:14:19 -0700500
Doug Zongkerdbfaae52009-04-21 17:12:54 -0700501 if OPTIONS.wipe_user_data:
Doug Zongker01ce19c2014-02-04 13:48:15 -0800502 system_progress -= 0.1
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700503 if HasVendorPartition(input_zip):
504 system_progress -= 0.1
Doug Zongkerdbfaae52009-04-21 17:12:54 -0700505
Doug Zongker4b9596f2014-06-09 14:15:45 -0700506 script.ShowProgress(system_progress, 0)
Jesse Zhao75bcea02015-01-06 10:59:53 -0800507
Tao Bao457cbf62017-03-06 09:56:01 -0800508 # Full OTA is done as an "incremental" against an empty source image. This
509 # has the effect of writing new data from the package to the entire
510 # partition, but lets us reuse the updater code that writes incrementals to
511 # do it.
512 system_tgt = GetImage("system", OPTIONS.input_tmp)
513 system_tgt.ResetFileMap()
514 system_diff = common.BlockDifference("system", system_tgt, src=None)
515 system_diff.WriteScript(script, output_zip)
Doug Zongkereef39442009-04-02 12:14:19 -0700516
Tao Bao7a5bf8a2015-07-21 18:01:20 -0700517 boot_img = common.GetBootableImage(
518 "boot.img", "boot.img", OPTIONS.input_tmp, "BOOT")
Doug Zongkerc9253822014-02-04 12:17:58 -0800519
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700520 if HasVendorPartition(input_zip):
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700521 script.ShowProgress(0.1, 0)
522
Tao Bao457cbf62017-03-06 09:56:01 -0800523 vendor_tgt = GetImage("vendor", OPTIONS.input_tmp)
524 vendor_tgt.ResetFileMap()
525 vendor_diff = common.BlockDifference("vendor", vendor_tgt)
526 vendor_diff.WriteScript(script, output_zip)
Doug Zongker73ef8252009-07-23 15:12:53 -0700527
Tao Baobcd1d162017-08-26 13:10:26 -0700528 AddCompatibilityArchiveIfTrebleEnabled(input_zip, output_zip,
529 OPTIONS.info_dict)
530
Doug Zongker37974732010-09-16 17:44:38 -0700531 common.CheckSize(boot_img.data, "boot.img", OPTIONS.info_dict)
Doug Zongker73ef8252009-07-23 15:12:53 -0700532 common.ZipWriteStr(output_zip, "boot.img", boot_img.data)
Doug Zongkerc494d7c2009-06-18 08:43:44 -0700533
Doug Zongker01ce19c2014-02-04 13:48:15 -0800534 script.ShowProgress(0.05, 5)
Doug Zongker9ce0fb62010-09-20 18:04:41 -0700535 script.WriteRawImage("/boot", "boot.img")
Doug Zongker05d3dea2009-06-22 11:32:31 -0700536
Doug Zongker01ce19c2014-02-04 13:48:15 -0800537 script.ShowProgress(0.2, 10)
Doug Zongker05d3dea2009-06-22 11:32:31 -0700538 device_specific.FullOTA_InstallEnd()
Doug Zongkereef39442009-04-02 12:14:19 -0700539
Doug Zongker1c390a22009-05-14 19:06:36 -0700540 if OPTIONS.extra_script is not None:
Doug Zongkerc494d7c2009-06-18 08:43:44 -0700541 script.AppendExtra(OPTIONS.extra_script)
Doug Zongker1c390a22009-05-14 19:06:36 -0700542
Doug Zongker14833602010-02-02 13:12:04 -0800543 script.UnmountAll()
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800544
Doug Zongker922206e2014-03-04 13:16:24 -0800545 if OPTIONS.wipe_user_data:
546 script.ShowProgress(0.1, 10)
547 script.FormatPartition("/data")
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700548
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800549 if OPTIONS.two_step:
550 script.AppendExtra("""
551set_stage("%(bcb_dev)s", "");
552""" % bcb_dev)
553 script.AppendExtra("else\n")
Tao Baod42e97e2016-11-30 12:11:57 -0800554
555 # Stage 1/3: Nothing to verify for full OTA. Write recovery image to /boot.
556 script.Comment("Stage 1/3")
557 _WriteRecoveryImageToBoot(script, output_zip)
558
Doug Zongker9b23f2c2013-11-25 14:44:12 -0800559 script.AppendExtra("""
560set_stage("%(bcb_dev)s", "2/3");
561reboot_now("%(bcb_dev)s", "");
562endif;
563endif;
564""" % bcb_dev)
Tao Baod8d14be2016-02-04 14:26:02 -0800565
Tao Bao5d182562016-02-23 11:38:39 -0800566 script.SetProgress(1)
567 script.AddToZip(input_zip, output_zip, input_path=OPTIONS.updater_binary)
Tao Baod8d14be2016-02-04 14:26:02 -0800568 metadata["ota-required-cache"] = str(script.required_cache)
Doug Zongker2ea21062010-04-28 16:05:21 -0700569 WriteMetadata(metadata, output_zip)
570
Doug Zongkerfc44a512014-08-26 13:10:25 -0700571
Doug Zongker2ea21062010-04-28 16:05:21 -0700572def WriteMetadata(metadata, output_zip):
Tao Bao2dd1c482017-02-03 16:49:39 -0800573 value = "".join(["%s=%s\n" % kv for kv in sorted(metadata.iteritems())])
574 common.ZipWriteStr(output_zip, METADATA_NAME, value,
575 compress_type=zipfile.ZIP_STORED)
Doug Zongkereef39442009-04-02 12:14:19 -0700576
Doug Zongkerfc44a512014-08-26 13:10:25 -0700577
Doug Zongker1eb74dd2012-08-16 16:19:00 -0700578def GetBuildProp(prop, info_dict):
Tao Baobcd1d162017-08-26 13:10:26 -0700579 """Returns the inquired build property from a given info_dict."""
Doug Zongker1eb74dd2012-08-16 16:19:00 -0700580 try:
581 return info_dict.get("build.prop", {})[prop]
582 except KeyError:
Ying Wangc73e4612014-04-15 15:27:43 -0700583 raise common.ExternalError("couldn't find %s in build.prop" % (prop,))
Doug Zongkereef39442009-04-02 12:14:19 -0700584
Doug Zongkerfc44a512014-08-26 13:10:25 -0700585
Tao Baobcd1d162017-08-26 13:10:26 -0700586def GetVendorBuildProp(prop, info_dict):
587 """Returns the inquired vendor build property from a given info_dict."""
588 try:
589 return info_dict.get("vendor.build.prop", {})[prop]
590 except KeyError:
591 raise common.ExternalError(
592 "couldn't find %s in vendor.build.prop" % (prop,))
593
594
Tao Baob31892e2017-02-07 11:21:17 -0800595def HandleDowngradeMetadata(metadata):
596 # Only incremental OTAs are allowed to reach here.
597 assert OPTIONS.incremental_source is not None
598
599 post_timestamp = GetBuildProp("ro.build.date.utc", OPTIONS.target_info_dict)
600 pre_timestamp = GetBuildProp("ro.build.date.utc", OPTIONS.source_info_dict)
601 is_downgrade = long(post_timestamp) < long(pre_timestamp)
602
603 if OPTIONS.downgrade:
Tao Baob31892e2017-02-07 11:21:17 -0800604 if not is_downgrade:
605 raise RuntimeError("--downgrade specified but no downgrade detected: "
606 "pre: %s, post: %s" % (pre_timestamp, post_timestamp))
Tao Bao3e6161a2017-02-28 11:48:48 -0800607 metadata["ota-downgrade"] = "yes"
608 elif OPTIONS.timestamp:
609 if not is_downgrade:
610 raise RuntimeError("--timestamp specified but no timestamp hack needed: "
611 "pre: %s, post: %s" % (pre_timestamp, post_timestamp))
612 metadata["post-timestamp"] = str(long(pre_timestamp) + 1)
Tao Baob31892e2017-02-07 11:21:17 -0800613 else:
614 if is_downgrade:
Tao Bao3e6161a2017-02-28 11:48:48 -0800615 raise RuntimeError("Downgrade detected based on timestamp check: "
616 "pre: %s, post: %s. Need to specify --timestamp OR "
617 "--downgrade to allow building the incremental." % (
618 pre_timestamp, post_timestamp))
Tao Baob31892e2017-02-07 11:21:17 -0800619 metadata["post-timestamp"] = post_timestamp
620
621
Geremy Condra36bd3652014-02-06 19:45:10 -0800622def WriteBlockIncrementalOTAPackage(target_zip, source_zip, output_zip):
623 source_version = OPTIONS.source_info_dict["recovery_api_version"]
624 target_version = OPTIONS.target_info_dict["recovery_api_version"]
625
626 if source_version == 0:
Tao Bao3e30d972016-03-15 13:20:19 -0700627 print("WARNING: generating edify script for a source that "
628 "can't install it.")
Tao Bao34b47bf2015-06-22 19:17:41 -0700629 script = edify_generator.EdifyGenerator(
630 source_version, OPTIONS.target_info_dict,
631 fstab=OPTIONS.source_info_dict["fstab"])
Geremy Condra36bd3652014-02-06 19:45:10 -0800632
Tao Bao3e30d972016-03-15 13:20:19 -0700633 source_oem_props = OPTIONS.source_info_dict.get("oem_fingerprint_properties")
634 target_oem_props = OPTIONS.target_info_dict.get("oem_fingerprint_properties")
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800635 oem_dicts = None
Tao Bao2f5358d2017-12-20 22:48:19 -0800636 if source_oem_props or target_oem_props:
637 recovery_mount_options = OPTIONS.source_info_dict.get(
638 "recovery_mount_options")
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800639 oem_dicts = _LoadOemDicts(script, recovery_mount_options)
Tao Bao3806c232015-07-05 21:08:33 -0700640
Dan Albert8b72aef2015-03-23 19:13:21 -0700641 metadata = {
Tao Bao3e30d972016-03-15 13:20:19 -0700642 "pre-device": GetOemProperty("ro.product.device", source_oem_props,
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800643 oem_dicts and oem_dicts[0],
644 OPTIONS.source_info_dict),
Tao Baod8d14be2016-02-04 14:26:02 -0800645 "ota-type": "BLOCK",
Dan Albert8b72aef2015-03-23 19:13:21 -0700646 }
Geremy Condra36bd3652014-02-06 19:45:10 -0800647
Tao Baob31892e2017-02-07 11:21:17 -0800648 HandleDowngradeMetadata(metadata)
Tao Bao5d182562016-02-23 11:38:39 -0800649
Geremy Condra36bd3652014-02-06 19:45:10 -0800650 device_specific = common.DeviceSpecificParams(
651 source_zip=source_zip,
652 source_version=source_version,
653 target_zip=target_zip,
654 target_version=target_version,
655 output_zip=output_zip,
656 script=script,
657 metadata=metadata,
Tao Bao6f0b2192015-10-13 16:37:12 -0700658 info_dict=OPTIONS.source_info_dict)
Geremy Condra36bd3652014-02-06 19:45:10 -0800659
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800660 source_fp = CalculateFingerprint(source_oem_props, oem_dicts and oem_dicts[0],
Tao Bao3806c232015-07-05 21:08:33 -0700661 OPTIONS.source_info_dict)
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800662 target_fp = CalculateFingerprint(target_oem_props, oem_dicts and oem_dicts[0],
Tao Bao3806c232015-07-05 21:08:33 -0700663 OPTIONS.target_info_dict)
Geremy Condra36bd3652014-02-06 19:45:10 -0800664 metadata["pre-build"] = source_fp
665 metadata["post-build"] = target_fp
Tianjie Xud06f07e2016-06-09 14:18:45 -0700666 metadata["pre-build-incremental"] = GetBuildProp(
667 "ro.build.version.incremental", OPTIONS.source_info_dict)
668 metadata["post-build-incremental"] = GetBuildProp(
669 "ro.build.version.incremental", OPTIONS.target_info_dict)
Geremy Condra36bd3652014-02-06 19:45:10 -0800670
671 source_boot = common.GetBootableImage(
672 "/tmp/boot.img", "boot.img", OPTIONS.source_tmp, "BOOT",
673 OPTIONS.source_info_dict)
674 target_boot = common.GetBootableImage(
675 "/tmp/boot.img", "boot.img", OPTIONS.target_tmp, "BOOT")
676 updating_boot = (not OPTIONS.two_step and
677 (source_boot.data != target_boot.data))
678
Geremy Condra36bd3652014-02-06 19:45:10 -0800679 target_recovery = common.GetBootableImage(
680 "/tmp/recovery.img", "recovery.img", OPTIONS.target_tmp, "RECOVERY")
Geremy Condra36bd3652014-02-06 19:45:10 -0800681
Tao Bao7e0f1602017-03-06 15:50:08 -0800682 system_src = GetImage("system", OPTIONS.source_tmp)
683 system_tgt = GetImage("system", OPTIONS.target_tmp)
Tao Baodd2a5892015-03-12 12:32:37 -0700684
Tao Bao0582cb62017-12-21 11:47:01 -0800685 blockimgdiff_version = max(
686 int(i) for i in
687 OPTIONS.info_dict.get("blockimgdiff_versions", "1").split(","))
688 assert blockimgdiff_version >= 3
Tao Baodd2a5892015-03-12 12:32:37 -0700689
Tao Baof8acad12016-07-07 09:09:58 -0700690 # Check the first block of the source system partition for remount R/W only
691 # if the filesystem is ext4.
692 system_src_partition = OPTIONS.source_info_dict["fstab"]["/system"]
693 check_first_block = system_src_partition.fs_type == "ext4"
Tao Bao293fd132016-06-11 12:19:23 -0700694 # Disable using imgdiff for squashfs. 'imgdiff -z' expects input files to be
695 # in zip formats. However with squashfs, a) all files are compressed in LZ4;
696 # b) the blocks listed in block map may not contain all the bytes for a given
697 # file (because they're rounded to be 4K-aligned).
Tao Baof8acad12016-07-07 09:09:58 -0700698 system_tgt_partition = OPTIONS.target_info_dict["fstab"]["/system"]
699 disable_imgdiff = (system_src_partition.fs_type == "squashfs" or
700 system_tgt_partition.fs_type == "squashfs")
Doug Zongkerb34fcce2014-09-11 09:34:56 -0700701 system_diff = common.BlockDifference("system", system_tgt, system_src,
Tianjie Xufc3422a2015-12-15 11:53:59 -0800702 check_first_block,
Tao Bao293fd132016-06-11 12:19:23 -0700703 version=blockimgdiff_version,
704 disable_imgdiff=disable_imgdiff)
Doug Zongkerfc44a512014-08-26 13:10:25 -0700705
Doug Zongkerc8b4e842014-06-16 15:16:31 -0700706 if HasVendorPartition(target_zip):
707 if not HasVendorPartition(source_zip):
708 raise RuntimeError("can't generate incremental that adds /vendor")
Tao Bao7e0f1602017-03-06 15:50:08 -0800709 vendor_src = GetImage("vendor", OPTIONS.source_tmp)
710 vendor_tgt = GetImage("vendor", OPTIONS.target_tmp)
Tianjie Xufc3422a2015-12-15 11:53:59 -0800711
712 # Check first block of vendor partition for remount R/W only if
713 # disk type is ext4
714 vendor_partition = OPTIONS.source_info_dict["fstab"]["/vendor"]
Tao Baod8d14be2016-02-04 14:26:02 -0800715 check_first_block = vendor_partition.fs_type == "ext4"
Tao Bao293fd132016-06-11 12:19:23 -0700716 disable_imgdiff = vendor_partition.fs_type == "squashfs"
Doug Zongkerb34fcce2014-09-11 09:34:56 -0700717 vendor_diff = common.BlockDifference("vendor", vendor_tgt, vendor_src,
Tianjie Xufc3422a2015-12-15 11:53:59 -0800718 check_first_block,
Tao Bao293fd132016-06-11 12:19:23 -0700719 version=blockimgdiff_version,
720 disable_imgdiff=disable_imgdiff)
Doug Zongkerfc44a512014-08-26 13:10:25 -0700721 else:
722 vendor_diff = None
Geremy Condra36bd3652014-02-06 19:45:10 -0800723
Tao Baobcd1d162017-08-26 13:10:26 -0700724 AddCompatibilityArchiveIfTrebleEnabled(
725 target_zip, output_zip, OPTIONS.target_info_dict,
726 OPTIONS.source_info_dict)
727
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800728 AppendAssertions(script, OPTIONS.target_info_dict, oem_dicts)
Geremy Condra36bd3652014-02-06 19:45:10 -0800729 device_specific.IncrementalOTA_Assertions()
730
731 # Two-step incremental package strategy (in chronological order,
732 # which is *not* the order in which the generated script has
733 # things):
734 #
735 # if stage is not "2/3" or "3/3":
736 # do verification on current system
737 # write recovery image to boot partition
738 # set stage to "2/3"
739 # reboot to boot partition and restart recovery
740 # else if stage is "2/3":
741 # write recovery image to recovery partition
742 # set stage to "3/3"
743 # reboot to recovery partition and restart recovery
744 # else:
745 # (stage must be "3/3")
746 # perform update:
747 # patch system files, etc.
748 # force full install of new boot image
749 # set up system to update recovery partition on first boot
Dan Albert8b72aef2015-03-23 19:13:21 -0700750 # complete script normally
751 # (allow recovery to mark itself finished and reboot)
Geremy Condra36bd3652014-02-06 19:45:10 -0800752
753 if OPTIONS.two_step:
Tao Baodd24da92015-07-29 14:09:23 -0700754 if not OPTIONS.source_info_dict.get("multistage_support", None):
Geremy Condra36bd3652014-02-06 19:45:10 -0800755 assert False, "two-step packages not supported by this build"
Tao Baodd24da92015-07-29 14:09:23 -0700756 fs = OPTIONS.source_info_dict["fstab"]["/misc"]
Geremy Condra36bd3652014-02-06 19:45:10 -0800757 assert fs.fs_type.upper() == "EMMC", \
758 "two-step packages only supported on devices with EMMC /misc partitions"
759 bcb_dev = {"bcb_dev": fs.device}
760 common.ZipWriteStr(output_zip, "recovery.img", target_recovery.data)
761 script.AppendExtra("""
Michael Rungefb8886d2014-10-23 13:51:04 -0700762if get_stage("%(bcb_dev)s") == "2/3" then
Geremy Condra36bd3652014-02-06 19:45:10 -0800763""" % bcb_dev)
Tao Baod42e97e2016-11-30 12:11:57 -0800764
765 # Stage 2/3: Write recovery image to /recovery (currently running /boot).
766 script.Comment("Stage 2/3")
Dan Albert8b72aef2015-03-23 19:13:21 -0700767 script.AppendExtra("sleep(20);\n")
Geremy Condra36bd3652014-02-06 19:45:10 -0800768 script.WriteRawImage("/recovery", "recovery.img")
769 script.AppendExtra("""
770set_stage("%(bcb_dev)s", "3/3");
771reboot_now("%(bcb_dev)s", "recovery");
Michael Rungefb8886d2014-10-23 13:51:04 -0700772else if get_stage("%(bcb_dev)s") != "3/3" then
Geremy Condra36bd3652014-02-06 19:45:10 -0800773""" % bcb_dev)
774
Tao Baod42e97e2016-11-30 12:11:57 -0800775 # Stage 1/3: (a) Verify the current system.
776 script.Comment("Stage 1/3")
777
Tao Bao6c55a8a2015-04-08 15:30:27 -0700778 # Dump fingerprints
Tao Baof9023852016-12-14 11:53:38 -0800779 script.Print("Source: %s" % (source_fp,))
780 script.Print("Target: %s" % (target_fp,))
Tao Bao6c55a8a2015-04-08 15:30:27 -0700781
Geremy Condra36bd3652014-02-06 19:45:10 -0800782 script.Print("Verifying current system...")
783
784 device_specific.IncrementalOTA_VerifyBegin()
785
Tao Bao0582cb62017-12-21 11:47:01 -0800786 if source_oem_props is None and target_oem_props is None:
787 script.AssertSomeFingerprint(source_fp, target_fp)
788 elif source_oem_props is not None and target_oem_props is not None:
789 script.AssertSomeThumbprint(
790 GetBuildProp("ro.build.thumbprint", OPTIONS.target_info_dict),
791 GetBuildProp("ro.build.thumbprint", OPTIONS.source_info_dict))
792 elif source_oem_props is None and target_oem_props is not None:
793 script.AssertFingerprintOrThumbprint(
794 source_fp,
795 GetBuildProp("ro.build.thumbprint", OPTIONS.target_info_dict))
796 else:
797 script.AssertFingerprintOrThumbprint(
798 target_fp,
799 GetBuildProp("ro.build.thumbprint", OPTIONS.source_info_dict))
Geremy Condra36bd3652014-02-06 19:45:10 -0800800
Tao Baod8d14be2016-02-04 14:26:02 -0800801 # Check the required cache size (i.e. stashed blocks).
802 size = []
803 if system_diff:
804 size.append(system_diff.required_cache)
805 if vendor_diff:
806 size.append(vendor_diff.required_cache)
807
Geremy Condra36bd3652014-02-06 19:45:10 -0800808 if updating_boot:
Tao Baodd24da92015-07-29 14:09:23 -0700809 boot_type, boot_device = common.GetTypeAndDevice(
810 "/boot", OPTIONS.source_info_dict)
Geremy Condra36bd3652014-02-06 19:45:10 -0800811 d = common.Difference(target_boot, source_boot)
812 _, _, d = d.ComputePatch()
Doug Zongkerf8340082014-08-05 10:39:37 -0700813 if d is None:
814 include_full_boot = True
815 common.ZipWriteStr(output_zip, "boot.img", target_boot.data)
816 else:
817 include_full_boot = False
Geremy Condra36bd3652014-02-06 19:45:10 -0800818
Tao Bao89fbb0f2017-01-10 10:47:58 -0800819 print("boot target: %d source: %d diff: %d" % (
820 target_boot.size, source_boot.size, len(d)))
Geremy Condra36bd3652014-02-06 19:45:10 -0800821
Doug Zongkerf8340082014-08-05 10:39:37 -0700822 common.ZipWriteStr(output_zip, "patch/boot.img.p", d)
Geremy Condra36bd3652014-02-06 19:45:10 -0800823
Doug Zongkerf8340082014-08-05 10:39:37 -0700824 script.PatchCheck("%s:%s:%d:%s:%d:%s" %
825 (boot_type, boot_device,
826 source_boot.size, source_boot.sha1,
827 target_boot.size, target_boot.sha1))
Tao Baod8d14be2016-02-04 14:26:02 -0800828 size.append(target_boot.size)
829
830 if size:
831 script.CacheFreeSpaceCheck(max(size))
Geremy Condra36bd3652014-02-06 19:45:10 -0800832
833 device_specific.IncrementalOTA_VerifyEnd()
834
835 if OPTIONS.two_step:
Tao Baod42e97e2016-11-30 12:11:57 -0800836 # Stage 1/3: (b) Write recovery image to /boot.
837 _WriteRecoveryImageToBoot(script, output_zip)
838
Geremy Condra36bd3652014-02-06 19:45:10 -0800839 script.AppendExtra("""
840set_stage("%(bcb_dev)s", "2/3");
841reboot_now("%(bcb_dev)s", "");
842else
843""" % bcb_dev)
844
Tao Baod42e97e2016-11-30 12:11:57 -0800845 # Stage 3/3: Make changes.
846 script.Comment("Stage 3/3")
847
Jesse Zhao75bcea02015-01-06 10:59:53 -0800848 # Verify the existing partitions.
Tao Baod522bdc2016-04-12 15:53:16 -0700849 system_diff.WriteVerifyScript(script, touched_blocks_only=True)
Jesse Zhao75bcea02015-01-06 10:59:53 -0800850 if vendor_diff:
Tao Baod522bdc2016-04-12 15:53:16 -0700851 vendor_diff.WriteVerifyScript(script, touched_blocks_only=True)
Jesse Zhao75bcea02015-01-06 10:59:53 -0800852
Geremy Condra36bd3652014-02-06 19:45:10 -0800853 script.Comment("---- start making changes here ----")
854
855 device_specific.IncrementalOTA_InstallBegin()
856
Doug Zongkerab7ca1d2014-08-26 10:40:28 -0700857 system_diff.WriteScript(script, output_zip,
858 progress=0.8 if vendor_diff else 0.9)
Tao Bao68658c02015-06-01 13:40:49 -0700859
Doug Zongkerfc44a512014-08-26 13:10:25 -0700860 if vendor_diff:
Doug Zongkerab7ca1d2014-08-26 10:40:28 -0700861 vendor_diff.WriteScript(script, output_zip, progress=0.1)
Geremy Condra36bd3652014-02-06 19:45:10 -0800862
863 if OPTIONS.two_step:
864 common.ZipWriteStr(output_zip, "boot.img", target_boot.data)
865 script.WriteRawImage("/boot", "boot.img")
Tao Bao89fbb0f2017-01-10 10:47:58 -0800866 print("writing full boot image (forced by two-step mode)")
Geremy Condra36bd3652014-02-06 19:45:10 -0800867
868 if not OPTIONS.two_step:
869 if updating_boot:
Doug Zongkerf8340082014-08-05 10:39:37 -0700870 if include_full_boot:
Tao Bao89fbb0f2017-01-10 10:47:58 -0800871 print("boot image changed; including full.")
Doug Zongkerf8340082014-08-05 10:39:37 -0700872 script.Print("Installing boot image...")
873 script.WriteRawImage("/boot", "boot.img")
874 else:
875 # Produce the boot image by applying a patch to the current
876 # contents of the boot partition, and write it back to the
877 # partition.
Tao Bao89fbb0f2017-01-10 10:47:58 -0800878 print("boot image changed; including patch.")
Doug Zongkerf8340082014-08-05 10:39:37 -0700879 script.Print("Patching boot image...")
880 script.ShowProgress(0.1, 10)
881 script.ApplyPatch("%s:%s:%d:%s:%d:%s"
882 % (boot_type, boot_device,
883 source_boot.size, source_boot.sha1,
884 target_boot.size, target_boot.sha1),
885 "-",
886 target_boot.size, target_boot.sha1,
887 source_boot.sha1, "patch/boot.img.p")
Geremy Condra36bd3652014-02-06 19:45:10 -0800888 else:
Tao Bao89fbb0f2017-01-10 10:47:58 -0800889 print("boot image unchanged; skipping.")
Geremy Condra36bd3652014-02-06 19:45:10 -0800890
891 # Do device-specific installation (eg, write radio image).
892 device_specific.IncrementalOTA_InstallEnd()
893
894 if OPTIONS.extra_script is not None:
895 script.AppendExtra(OPTIONS.extra_script)
896
Doug Zongker922206e2014-03-04 13:16:24 -0800897 if OPTIONS.wipe_user_data:
898 script.Print("Erasing user data...")
899 script.FormatPartition("/data")
Tao Bao5d182562016-02-23 11:38:39 -0800900 metadata["ota-wipe"] = "yes"
Doug Zongker922206e2014-03-04 13:16:24 -0800901
Geremy Condra36bd3652014-02-06 19:45:10 -0800902 if OPTIONS.two_step:
903 script.AppendExtra("""
904set_stage("%(bcb_dev)s", "");
905endif;
906endif;
907""" % bcb_dev)
908
909 script.SetProgress(1)
Tao Bao4996cf02016-03-08 17:53:39 -0800910 # For downgrade OTAs, we prefer to use the update-binary in the source
911 # build that is actually newer than the one in the target build.
912 if OPTIONS.downgrade:
913 script.AddToZip(source_zip, output_zip, input_path=OPTIONS.updater_binary)
914 else:
915 script.AddToZip(target_zip, output_zip, input_path=OPTIONS.updater_binary)
Tao Baod8d14be2016-02-04 14:26:02 -0800916 metadata["ota-required-cache"] = str(script.required_cache)
Geremy Condra36bd3652014-02-06 19:45:10 -0800917 WriteMetadata(metadata, output_zip)
918
Doug Zongker32b527d2014-03-04 10:03:02 -0800919
Tao Baoc098e9e2016-01-07 13:03:56 -0800920def WriteABOTAPackageWithBrilloScript(target_file, output_file,
921 source_file=None):
922 """Generate an Android OTA package that has A/B update payload."""
923
Tao Bao2dd1c482017-02-03 16:49:39 -0800924 def ComputeStreamingMetadata(zip_file, reserve_space=False,
925 expected_length=None):
926 """Compute the streaming metadata for a given zip.
927
928 When 'reserve_space' is True, we reserve extra space for the offset and
929 length of the metadata entry itself, although we don't know the final
930 values until the package gets signed. This function will be called again
931 after signing. We then write the actual values and pad the string to the
932 length we set earlier. Note that we can't use the actual length of the
933 metadata entry in the second run. Otherwise the offsets for other entries
934 will be changing again.
935 """
Tao Baoc96316c2017-01-24 22:10:49 -0800936
937 def ComputeEntryOffsetSize(name):
938 """Compute the zip entry offset and size."""
939 info = zip_file.getinfo(name)
940 offset = info.header_offset + len(info.FileHeader())
941 size = info.file_size
Tao Bao2dd1c482017-02-03 16:49:39 -0800942 return '%s:%d:%d' % (os.path.basename(name), offset, size)
Tao Baoc96316c2017-01-24 22:10:49 -0800943
944 # payload.bin and payload_properties.txt must exist.
945 offsets = [ComputeEntryOffsetSize('payload.bin'),
946 ComputeEntryOffsetSize('payload_properties.txt')]
947
948 # care_map.txt is available only if dm-verity is enabled.
949 if 'care_map.txt' in zip_file.namelist():
950 offsets.append(ComputeEntryOffsetSize('care_map.txt'))
Tao Bao2dd1c482017-02-03 16:49:39 -0800951
Tao Bao21803d32017-04-19 10:16:09 -0700952 if 'compatibility.zip' in zip_file.namelist():
953 offsets.append(ComputeEntryOffsetSize('compatibility.zip'))
954
Tao Bao2dd1c482017-02-03 16:49:39 -0800955 # 'META-INF/com/android/metadata' is required. We don't know its actual
956 # offset and length (as well as the values for other entries). So we
957 # reserve 10-byte as a placeholder, which is to cover the space for metadata
958 # entry ('xx:xxx', since it's ZIP_STORED which should appear at the
959 # beginning of the zip), as well as the possible value changes in other
960 # entries.
961 if reserve_space:
962 offsets.append('metadata:' + ' ' * 10)
963 else:
964 offsets.append(ComputeEntryOffsetSize(METADATA_NAME))
965
966 value = ','.join(offsets)
967 if expected_length is not None:
968 assert len(value) <= expected_length, \
969 'Insufficient reserved space: reserved=%d, actual=%d' % (
970 expected_length, len(value))
971 value += ' ' * (expected_length - len(value))
972 return value
Tao Baoc96316c2017-01-24 22:10:49 -0800973
Alex Deymod8d96ec2016-06-10 16:38:31 -0700974 # The place where the output from the subprocess should go.
975 log_file = sys.stdout if OPTIONS.verbose else subprocess.PIPE
976
Tao Baodea0f8b2016-06-20 17:55:06 -0700977 # A/B updater expects a signing key in RSA format. Gets the key ready for
978 # later use in step 3, unless a payload_signer has been specified.
979 if OPTIONS.payload_signer is None:
980 cmd = ["openssl", "pkcs8",
981 "-in", OPTIONS.package_key + OPTIONS.private_key_suffix,
Christian Oderf63e2cd2017-05-01 22:30:15 +0200982 "-inform", "DER"]
983 pw = OPTIONS.key_passwords[OPTIONS.package_key]
984 cmd.extend(["-passin", "pass:" + pw] if pw else ["-nocrypt"])
Tao Baodea0f8b2016-06-20 17:55:06 -0700985 rsa_key = common.MakeTempFile(prefix="key-", suffix=".key")
986 cmd.extend(["-out", rsa_key])
Christian Oderf63e2cd2017-05-01 22:30:15 +0200987 p1 = common.Run(cmd, verbose=False, stdout=log_file, stderr=subprocess.STDOUT)
Tao Bao6047c242016-06-21 13:35:26 -0700988 p1.communicate()
Tao Baodea0f8b2016-06-20 17:55:06 -0700989 assert p1.returncode == 0, "openssl pkcs8 failed"
Tao Baoc098e9e2016-01-07 13:03:56 -0800990
Tao Baodea0f8b2016-06-20 17:55:06 -0700991 # Stage the output zip package for package signing.
Tao Baoc098e9e2016-01-07 13:03:56 -0800992 temp_zip_file = tempfile.NamedTemporaryFile()
993 output_zip = zipfile.ZipFile(temp_zip_file, "w",
994 compression=zipfile.ZIP_DEFLATED)
995
996 # Metadata to comply with Android OTA package format.
997 oem_props = OPTIONS.info_dict.get("oem_fingerprint_properties", None)
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -0800998 oem_dicts = None
Tao Baoc098e9e2016-01-07 13:03:56 -0800999 if oem_props:
Tao Baoebce6972017-03-06 10:22:20 -08001000 oem_dicts = _LoadOemDicts(None)
Tao Baoc098e9e2016-01-07 13:03:56 -08001001
1002 metadata = {
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -08001003 "post-build": CalculateFingerprint(oem_props, oem_dicts and oem_dicts[0],
Tao Baoc098e9e2016-01-07 13:03:56 -08001004 OPTIONS.info_dict),
Tianjie Xud06f07e2016-06-09 14:18:45 -07001005 "post-build-incremental" : GetBuildProp("ro.build.version.incremental",
1006 OPTIONS.info_dict),
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -08001007 "pre-device": GetOemProperty("ro.product.device", oem_props,
1008 oem_dicts and oem_dicts[0],
Tao Baoc098e9e2016-01-07 13:03:56 -08001009 OPTIONS.info_dict),
Tao Baod8d14be2016-02-04 14:26:02 -08001010 "ota-required-cache": "0",
1011 "ota-type": "AB",
Tao Baoc098e9e2016-01-07 13:03:56 -08001012 }
1013
1014 if source_file is not None:
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -08001015 metadata["pre-build"] = CalculateFingerprint(oem_props,
1016 oem_dicts and oem_dicts[0],
Tao Baoc098e9e2016-01-07 13:03:56 -08001017 OPTIONS.source_info_dict)
Tianjie Xud06f07e2016-06-09 14:18:45 -07001018 metadata["pre-build-incremental"] = GetBuildProp(
1019 "ro.build.version.incremental", OPTIONS.source_info_dict)
Tao Baoc098e9e2016-01-07 13:03:56 -08001020
Tao Baob31892e2017-02-07 11:21:17 -08001021 HandleDowngradeMetadata(metadata)
1022 else:
1023 metadata["post-timestamp"] = GetBuildProp(
1024 "ro.build.date.utc", OPTIONS.info_dict)
1025
Tao Baoc098e9e2016-01-07 13:03:56 -08001026 # 1. Generate payload.
1027 payload_file = common.MakeTempFile(prefix="payload-", suffix=".bin")
1028 cmd = ["brillo_update_payload", "generate",
1029 "--payload", payload_file,
1030 "--target_image", target_file]
1031 if source_file is not None:
1032 cmd.extend(["--source_image", source_file])
Alex Deymod8d96ec2016-06-10 16:38:31 -07001033 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1034 p1.communicate()
Tao Baoc098e9e2016-01-07 13:03:56 -08001035 assert p1.returncode == 0, "brillo_update_payload generate failed"
1036
1037 # 2. Generate hashes of the payload and metadata files.
1038 payload_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin")
1039 metadata_sig_file = common.MakeTempFile(prefix="sig-", suffix=".bin")
1040 cmd = ["brillo_update_payload", "hash",
1041 "--unsigned_payload", payload_file,
1042 "--signature_size", "256",
1043 "--metadata_hash_file", metadata_sig_file,
1044 "--payload_hash_file", payload_sig_file]
Alex Deymod8d96ec2016-06-10 16:38:31 -07001045 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1046 p1.communicate()
Tao Baoc098e9e2016-01-07 13:03:56 -08001047 assert p1.returncode == 0, "brillo_update_payload hash failed"
1048
1049 # 3. Sign the hashes and insert them back into the payload file.
1050 signed_payload_sig_file = common.MakeTempFile(prefix="signed-sig-",
1051 suffix=".bin")
1052 signed_metadata_sig_file = common.MakeTempFile(prefix="signed-sig-",
1053 suffix=".bin")
1054 # 3a. Sign the payload hash.
Tao Baodea0f8b2016-06-20 17:55:06 -07001055 if OPTIONS.payload_signer is not None:
Baligh Uddin2abbbd02016-06-22 12:14:16 -07001056 cmd = [OPTIONS.payload_signer]
1057 cmd.extend(OPTIONS.payload_signer_args)
Tao Baodea0f8b2016-06-20 17:55:06 -07001058 else:
1059 cmd = ["openssl", "pkeyutl", "-sign",
1060 "-inkey", rsa_key,
1061 "-pkeyopt", "digest:sha256"]
1062 cmd.extend(["-in", payload_sig_file,
1063 "-out", signed_payload_sig_file])
Alex Deymod8d96ec2016-06-10 16:38:31 -07001064 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1065 p1.communicate()
Tao Baoc098e9e2016-01-07 13:03:56 -08001066 assert p1.returncode == 0, "openssl sign payload failed"
1067
1068 # 3b. Sign the metadata hash.
Tao Baodea0f8b2016-06-20 17:55:06 -07001069 if OPTIONS.payload_signer is not None:
Baligh Uddin2abbbd02016-06-22 12:14:16 -07001070 cmd = [OPTIONS.payload_signer]
1071 cmd.extend(OPTIONS.payload_signer_args)
Tao Baodea0f8b2016-06-20 17:55:06 -07001072 else:
1073 cmd = ["openssl", "pkeyutl", "-sign",
1074 "-inkey", rsa_key,
1075 "-pkeyopt", "digest:sha256"]
1076 cmd.extend(["-in", metadata_sig_file,
1077 "-out", signed_metadata_sig_file])
Alex Deymod8d96ec2016-06-10 16:38:31 -07001078 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1079 p1.communicate()
Tao Baoc098e9e2016-01-07 13:03:56 -08001080 assert p1.returncode == 0, "openssl sign metadata failed"
1081
1082 # 3c. Insert the signatures back into the payload file.
1083 signed_payload_file = common.MakeTempFile(prefix="signed-payload-",
1084 suffix=".bin")
1085 cmd = ["brillo_update_payload", "sign",
1086 "--unsigned_payload", payload_file,
1087 "--payload", signed_payload_file,
1088 "--signature_size", "256",
1089 "--metadata_signature_file", signed_metadata_sig_file,
1090 "--payload_signature_file", signed_payload_sig_file]
Alex Deymod8d96ec2016-06-10 16:38:31 -07001091 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1092 p1.communicate()
Tao Baoc098e9e2016-01-07 13:03:56 -08001093 assert p1.returncode == 0, "brillo_update_payload sign failed"
1094
Alex Deymo19241c12016-02-04 22:29:29 -08001095 # 4. Dump the signed payload properties.
1096 properties_file = common.MakeTempFile(prefix="payload-properties-",
1097 suffix=".txt")
1098 cmd = ["brillo_update_payload", "properties",
1099 "--payload", signed_payload_file,
1100 "--properties_file", properties_file]
Alex Deymod8d96ec2016-06-10 16:38:31 -07001101 p1 = common.Run(cmd, stdout=log_file, stderr=subprocess.STDOUT)
1102 p1.communicate()
Alex Deymo19241c12016-02-04 22:29:29 -08001103 assert p1.returncode == 0, "brillo_update_payload properties failed"
1104
Tao Bao7c5dc572016-06-14 17:48:11 -07001105 if OPTIONS.wipe_user_data:
1106 with open(properties_file, "a") as f:
1107 f.write("POWERWASH=1\n")
1108 metadata["ota-wipe"] = "yes"
1109
Tao Baoc96316c2017-01-24 22:10:49 -08001110 # Add the signed payload file and properties into the zip. In order to
1111 # support streaming, we pack payload.bin, payload_properties.txt and
1112 # care_map.txt as ZIP_STORED. So these entries can be read directly with
1113 # the offset and length pairs.
Tao Baoc098e9e2016-01-07 13:03:56 -08001114 common.ZipWrite(output_zip, signed_payload_file, arcname="payload.bin",
1115 compress_type=zipfile.ZIP_STORED)
Tao Baoc96316c2017-01-24 22:10:49 -08001116 common.ZipWrite(output_zip, properties_file,
1117 arcname="payload_properties.txt",
1118 compress_type=zipfile.ZIP_STORED)
Tao Baoc098e9e2016-01-07 13:03:56 -08001119
Tianjie Xucfa86222016-03-07 16:31:19 -08001120 # If dm-verity is supported for the device, copy contents of care_map
1121 # into A/B OTA package.
Tao Bao21803d32017-04-19 10:16:09 -07001122 target_zip = zipfile.ZipFile(target_file, "r")
Tianjie Xu6b2e1552017-06-01 11:32:32 -07001123 if (OPTIONS.info_dict.get("verity") == "true" or
Bowgo Tsai3e599ea2017-05-26 18:30:04 +08001124 OPTIONS.info_dict.get("avb_enable") == "true"):
Tianjie Xucfa86222016-03-07 16:31:19 -08001125 care_map_path = "META/care_map.txt"
1126 namelist = target_zip.namelist()
1127 if care_map_path in namelist:
1128 care_map_data = target_zip.read(care_map_path)
Tao Baoc96316c2017-01-24 22:10:49 -08001129 common.ZipWriteStr(output_zip, "care_map.txt", care_map_data,
1130 compress_type=zipfile.ZIP_STORED)
Tianjie Xucfa86222016-03-07 16:31:19 -08001131 else:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001132 print("Warning: cannot find care map file in target_file package")
Tao Bao21803d32017-04-19 10:16:09 -07001133
Tao Baobcd1d162017-08-26 13:10:26 -07001134 # OPTIONS.source_info_dict must be None for incrementals.
1135 if source_file is None:
1136 assert OPTIONS.source_info_dict is None
Tao Bao21803d32017-04-19 10:16:09 -07001137
Tao Baobcd1d162017-08-26 13:10:26 -07001138 AddCompatibilityArchiveIfTrebleEnabled(
1139 target_zip, output_zip, OPTIONS.info_dict, OPTIONS.source_info_dict)
Tao Bao21803d32017-04-19 10:16:09 -07001140
Tao Bao21803d32017-04-19 10:16:09 -07001141 common.ZipClose(target_zip)
Tianjie Xucfa86222016-03-07 16:31:19 -08001142
Tao Bao2dd1c482017-02-03 16:49:39 -08001143 # Write the current metadata entry with placeholders.
Tao Baobfdcb122017-01-31 15:06:05 -08001144 metadata['ota-streaming-property-files'] = ComputeStreamingMetadata(
Tao Bao2dd1c482017-02-03 16:49:39 -08001145 output_zip, reserve_space=True)
Tao Baoc96316c2017-01-24 22:10:49 -08001146 WriteMetadata(metadata, output_zip)
1147 common.ZipClose(output_zip)
1148
Tao Bao2dd1c482017-02-03 16:49:39 -08001149 # SignOutput(), which in turn calls signapk.jar, will possibly reorder the
Tao Bao89d7ab22017-12-14 17:05:33 -08001150 # ZIP entries, as well as padding the entry headers. We do a preliminary
Tao Bao2dd1c482017-02-03 16:49:39 -08001151 # signing (with an incomplete metadata entry) to allow that to happen. Then
Tao Bao89d7ab22017-12-14 17:05:33 -08001152 # compute the ZIP entry offsets, write back the final metadata and do the
Tao Bao2dd1c482017-02-03 16:49:39 -08001153 # final signing.
Tao Bao89d7ab22017-12-14 17:05:33 -08001154 prelim_signing = common.MakeTempFile(suffix='.zip')
1155 SignOutput(temp_zip_file.name, prelim_signing)
Tao Bao2dd1c482017-02-03 16:49:39 -08001156 common.ZipClose(temp_zip_file)
Tao Baoc96316c2017-01-24 22:10:49 -08001157
Tao Bao2dd1c482017-02-03 16:49:39 -08001158 # Open the signed zip. Compute the final metadata that's needed for streaming.
Tao Bao89d7ab22017-12-14 17:05:33 -08001159 prelim_signing_zip = zipfile.ZipFile(prelim_signing, 'r')
Tao Bao2dd1c482017-02-03 16:49:39 -08001160 expected_length = len(metadata['ota-streaming-property-files'])
1161 metadata['ota-streaming-property-files'] = ComputeStreamingMetadata(
Tao Bao89d7ab22017-12-14 17:05:33 -08001162 prelim_signing_zip, reserve_space=False, expected_length=expected_length)
1163 common.ZipClose(prelim_signing_zip)
Tao Bao2dd1c482017-02-03 16:49:39 -08001164
Tao Bao89d7ab22017-12-14 17:05:33 -08001165 # Replace the METADATA entry.
1166 common.ZipDelete(prelim_signing, METADATA_NAME)
1167 output_zip = zipfile.ZipFile(prelim_signing, 'a',
Tao Bao2dd1c482017-02-03 16:49:39 -08001168 compression=zipfile.ZIP_DEFLATED)
Tao Bao2dd1c482017-02-03 16:49:39 -08001169 WriteMetadata(metadata, output_zip)
Tao Bao2dd1c482017-02-03 16:49:39 -08001170 common.ZipClose(output_zip)
1171
1172 # Re-sign the package after updating the metadata entry.
Tao Bao89d7ab22017-12-14 17:05:33 -08001173 SignOutput(prelim_signing, output_file)
Tao Bao2dd1c482017-02-03 16:49:39 -08001174
1175 # Reopen the final signed zip to double check the streaming metadata.
Tao Bao89d7ab22017-12-14 17:05:33 -08001176 output_zip = zipfile.ZipFile(output_file, 'r')
Tao Bao2dd1c482017-02-03 16:49:39 -08001177 actual = metadata['ota-streaming-property-files'].strip()
1178 expected = ComputeStreamingMetadata(output_zip)
1179 assert actual == expected, \
1180 "Mismatching streaming metadata: %s vs %s." % (actual, expected)
Tao Baoc96316c2017-01-24 22:10:49 -08001181 common.ZipClose(output_zip)
1182
Tao Baoc098e9e2016-01-07 13:03:56 -08001183
Doug Zongkereef39442009-04-02 12:14:19 -07001184def main(argv):
1185
1186 def option_handler(o, a):
Tao Bao4b76a0e2017-10-31 12:13:33 -07001187 if o in ("-k", "--package_key"):
Doug Zongkereef39442009-04-02 12:14:19 -07001188 OPTIONS.package_key = a
Doug Zongkereef39442009-04-02 12:14:19 -07001189 elif o in ("-i", "--incremental_from"):
1190 OPTIONS.incremental_source = a
Tao Bao43078aa2015-04-21 14:32:35 -07001191 elif o == "--full_radio":
1192 OPTIONS.full_radio = True
leozwangaa6c1a12015-08-14 10:57:58 -07001193 elif o == "--full_bootloader":
1194 OPTIONS.full_bootloader = True
Tao Bao337633f2017-12-06 15:20:19 -08001195 elif o == "--wipe_user_data":
Doug Zongkerdbfaae52009-04-21 17:12:54 -07001196 OPTIONS.wipe_user_data = True
Tao Bao5d182562016-02-23 11:38:39 -08001197 elif o == "--downgrade":
1198 OPTIONS.downgrade = True
1199 OPTIONS.wipe_user_data = True
Tao Bao3e6161a2017-02-28 11:48:48 -08001200 elif o == "--override_timestamp":
1201 OPTIONS.timestamp = True
Michael Runge6e836112014-04-15 17:40:21 -07001202 elif o in ("-o", "--oem_settings"):
Alain Vongsouvanh7f804ba2017-02-16 13:06:55 -08001203 OPTIONS.oem_source = a.split(',')
Tao Bao8608cde2016-02-25 19:49:55 -08001204 elif o == "--oem_no_mount":
1205 OPTIONS.oem_no_mount = True
Doug Zongker1c390a22009-05-14 19:06:36 -07001206 elif o in ("-e", "--extra_script"):
1207 OPTIONS.extra_script = a
Martin Blumenstingl374e1142014-05-31 20:42:55 +02001208 elif o in ("-t", "--worker_threads"):
1209 if a.isdigit():
1210 OPTIONS.worker_threads = int(a)
1211 else:
1212 raise ValueError("Cannot parse value %r for option %r - only "
1213 "integers are allowed." % (a, o))
Doug Zongker9b23f2c2013-11-25 14:44:12 -08001214 elif o in ("-2", "--two_step"):
1215 OPTIONS.two_step = True
Doug Zongker26e66192014-02-20 13:22:07 -08001216 elif o == "--no_signing":
Takeshi Kanemotoe153b342013-11-14 17:20:50 +09001217 OPTIONS.no_signing = True
Dan Albert8b72aef2015-03-23 19:13:21 -07001218 elif o == "--verify":
Michael Runge63f01de2014-10-28 19:24:19 -07001219 OPTIONS.verify = True
Doug Zongker26e66192014-02-20 13:22:07 -08001220 elif o == "--block":
1221 OPTIONS.block_based = True
Doug Zongker25568482014-03-03 10:21:27 -08001222 elif o in ("-b", "--binary"):
1223 OPTIONS.updater_binary = a
Doug Zongker62d4f182014-08-04 16:06:43 -07001224 elif o in ("--no_fallback_to_full",):
1225 OPTIONS.fallback_to_full = False
Tao Bao8dcf7382015-05-21 14:09:49 -07001226 elif o == "--stash_threshold":
1227 try:
1228 OPTIONS.stash_threshold = float(a)
1229 except ValueError:
1230 raise ValueError("Cannot parse value %r for option %r - expecting "
1231 "a float" % (a, o))
Tao Baod62c6032015-11-30 09:40:20 -08001232 elif o == "--log_diff":
1233 OPTIONS.log_diff = a
Tao Baodea0f8b2016-06-20 17:55:06 -07001234 elif o == "--payload_signer":
1235 OPTIONS.payload_signer = a
Baligh Uddin2abbbd02016-06-22 12:14:16 -07001236 elif o == "--payload_signer_args":
1237 OPTIONS.payload_signer_args = shlex.split(a)
Dan Willemsencea5cd22017-03-21 14:44:27 -07001238 elif o == "--extracted_input_target_files":
1239 OPTIONS.extracted_input = a
Doug Zongkereef39442009-04-02 12:14:19 -07001240 else:
1241 return False
Doug Zongkerdbfaae52009-04-21 17:12:54 -07001242 return True
Doug Zongkereef39442009-04-02 12:14:19 -07001243
1244 args = common.ParseOptions(argv, __doc__,
Tao Bao337633f2017-12-06 15:20:19 -08001245 extra_opts="b:k:i:d:e:t:2o:",
Dan Albert8b72aef2015-03-23 19:13:21 -07001246 extra_long_opts=[
Dan Albert8b72aef2015-03-23 19:13:21 -07001247 "package_key=",
1248 "incremental_from=",
Tao Bao43078aa2015-04-21 14:32:35 -07001249 "full_radio",
leozwangaa6c1a12015-08-14 10:57:58 -07001250 "full_bootloader",
Dan Albert8b72aef2015-03-23 19:13:21 -07001251 "wipe_user_data",
Tao Bao5d182562016-02-23 11:38:39 -08001252 "downgrade",
Tao Bao3e6161a2017-02-28 11:48:48 -08001253 "override_timestamp",
Dan Albert8b72aef2015-03-23 19:13:21 -07001254 "extra_script=",
1255 "worker_threads=",
Dan Albert8b72aef2015-03-23 19:13:21 -07001256 "two_step",
1257 "no_signing",
1258 "block",
1259 "binary=",
1260 "oem_settings=",
Tao Bao8608cde2016-02-25 19:49:55 -08001261 "oem_no_mount",
Dan Albert8b72aef2015-03-23 19:13:21 -07001262 "verify",
1263 "no_fallback_to_full",
Tao Bao8dcf7382015-05-21 14:09:49 -07001264 "stash_threshold=",
Tao Baod62c6032015-11-30 09:40:20 -08001265 "log_diff=",
Tao Baodea0f8b2016-06-20 17:55:06 -07001266 "payload_signer=",
Baligh Uddin2abbbd02016-06-22 12:14:16 -07001267 "payload_signer_args=",
Dan Willemsencea5cd22017-03-21 14:44:27 -07001268 "extracted_input_target_files=",
Dan Albert8b72aef2015-03-23 19:13:21 -07001269 ], extra_option_handler=option_handler)
Doug Zongkereef39442009-04-02 12:14:19 -07001270
1271 if len(args) != 2:
1272 common.Usage(__doc__)
1273 sys.exit(1)
1274
Tao Bao5d182562016-02-23 11:38:39 -08001275 if OPTIONS.downgrade:
1276 # Sanity check to enforce a data wipe.
1277 if not OPTIONS.wipe_user_data:
1278 raise ValueError("Cannot downgrade without a data wipe")
1279
1280 # We should only allow downgrading incrementals (as opposed to full).
1281 # Otherwise the device may go back from arbitrary build with this full
1282 # OTA package.
1283 if OPTIONS.incremental_source is None:
Elliott Hughesd8a52f92016-06-20 14:35:47 -07001284 raise ValueError("Cannot generate downgradable full OTAs")
Tao Bao5d182562016-02-23 11:38:39 -08001285
Tao Bao3e6161a2017-02-28 11:48:48 -08001286 assert not (OPTIONS.downgrade and OPTIONS.timestamp), \
1287 "Cannot have --downgrade AND --override_timestamp both"
1288
Tao Baoc098e9e2016-01-07 13:03:56 -08001289 # Load the dict file from the zip directly to have a peek at the OTA type.
1290 # For packages using A/B update, unzipping is not needed.
Dan Willemsencea5cd22017-03-21 14:44:27 -07001291 if OPTIONS.extracted_input is not None:
1292 OPTIONS.info_dict = common.LoadInfoDict(OPTIONS.extracted_input, OPTIONS.extracted_input)
1293 else:
1294 input_zip = zipfile.ZipFile(args[0], "r")
1295 OPTIONS.info_dict = common.LoadInfoDict(input_zip)
1296 common.ZipClose(input_zip)
Tao Baoc098e9e2016-01-07 13:03:56 -08001297
1298 ab_update = OPTIONS.info_dict.get("ab_update") == "true"
1299
Christian Oderf63e2cd2017-05-01 22:30:15 +02001300 # Use the default key to sign the package if not specified with package_key.
1301 # package_keys are needed on ab_updates, so always define them if an
1302 # ab_update is getting created.
1303 if not OPTIONS.no_signing or ab_update:
1304 if OPTIONS.package_key is None:
1305 OPTIONS.package_key = OPTIONS.info_dict.get(
1306 "default_system_dev_certificate",
1307 "build/target/product/security/testkey")
1308 # Get signing keys
1309 OPTIONS.key_passwords = common.GetKeyPasswords([OPTIONS.package_key])
1310
Tao Baoc098e9e2016-01-07 13:03:56 -08001311 if ab_update:
1312 if OPTIONS.incremental_source is not None:
1313 OPTIONS.target_info_dict = OPTIONS.info_dict
1314 source_zip = zipfile.ZipFile(OPTIONS.incremental_source, "r")
1315 OPTIONS.source_info_dict = common.LoadInfoDict(source_zip)
1316 common.ZipClose(source_zip)
1317
1318 if OPTIONS.verbose:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001319 print("--- target info ---")
Tao Baoc098e9e2016-01-07 13:03:56 -08001320 common.DumpInfoDict(OPTIONS.info_dict)
1321
1322 if OPTIONS.incremental_source is not None:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001323 print("--- source info ---")
Tao Baoc098e9e2016-01-07 13:03:56 -08001324 common.DumpInfoDict(OPTIONS.source_info_dict)
1325
1326 WriteABOTAPackageWithBrilloScript(
1327 target_file=args[0],
1328 output_file=args[1],
1329 source_file=OPTIONS.incremental_source)
1330
Tao Bao89fbb0f2017-01-10 10:47:58 -08001331 print("done.")
Tao Baoc098e9e2016-01-07 13:03:56 -08001332 return
1333
Doug Zongker1c390a22009-05-14 19:06:36 -07001334 if OPTIONS.extra_script is not None:
1335 OPTIONS.extra_script = open(OPTIONS.extra_script).read()
1336
Dan Willemsencea5cd22017-03-21 14:44:27 -07001337 if OPTIONS.extracted_input is not None:
1338 OPTIONS.input_tmp = OPTIONS.extracted_input
1339 OPTIONS.target_tmp = OPTIONS.input_tmp
1340 OPTIONS.info_dict = common.LoadInfoDict(OPTIONS.input_tmp, OPTIONS.input_tmp)
1341 input_zip = zipfile.ZipFile(args[0], "r")
1342 else:
1343 print("unzipping target target-files...")
1344 OPTIONS.input_tmp, input_zip = common.UnzipTemp(
1345 args[0], UNZIP_PATTERN)
Doug Zongkerfdd8e692009-08-03 17:27:48 -07001346
Dan Willemsencea5cd22017-03-21 14:44:27 -07001347 OPTIONS.target_tmp = OPTIONS.input_tmp
1348 OPTIONS.info_dict = common.LoadInfoDict(input_zip, OPTIONS.target_tmp)
Kenny Roote2e9f612013-05-29 12:59:35 -07001349
Doug Zongker37974732010-09-16 17:44:38 -07001350 if OPTIONS.verbose:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001351 print("--- target info ---")
Doug Zongker37974732010-09-16 17:44:38 -07001352 common.DumpInfoDict(OPTIONS.info_dict)
1353
Doug Zongkereb0a78a2014-01-27 10:01:06 -08001354 # If the caller explicitly specified the device-specific extensions
1355 # path via -s/--device_specific, use that. Otherwise, use
1356 # META/releasetools.py if it is present in the target target_files.
1357 # Otherwise, take the path of the file from 'tool_extensions' in the
1358 # info dict and look for that in the local filesystem, relative to
1359 # the current directory.
1360
Doug Zongker37974732010-09-16 17:44:38 -07001361 if OPTIONS.device_specific is None:
Doug Zongkereb0a78a2014-01-27 10:01:06 -08001362 from_input = os.path.join(OPTIONS.input_tmp, "META", "releasetools.py")
1363 if os.path.exists(from_input):
Tao Bao89fbb0f2017-01-10 10:47:58 -08001364 print("(using device-specific extensions from target_files)")
Doug Zongkereb0a78a2014-01-27 10:01:06 -08001365 OPTIONS.device_specific = from_input
1366 else:
1367 OPTIONS.device_specific = OPTIONS.info_dict.get("tool_extensions", None)
1368
Doug Zongker37974732010-09-16 17:44:38 -07001369 if OPTIONS.device_specific is not None:
Doug Zongkereb0a78a2014-01-27 10:01:06 -08001370 OPTIONS.device_specific = os.path.abspath(OPTIONS.device_specific)
Doug Zongker37974732010-09-16 17:44:38 -07001371
Tao Baoc098e9e2016-01-07 13:03:56 -08001372 if OPTIONS.info_dict.get("no_recovery") == "true":
Tao Baodb45efa2015-10-27 19:25:18 -07001373 raise common.ExternalError(
1374 "--- target build has specified no recovery ---")
1375
Tao Bao767e3ac2015-11-10 12:19:19 -08001376 # Set up the output zip. Create a temporary zip file if signing is needed.
1377 if OPTIONS.no_signing:
1378 if os.path.exists(args[1]):
1379 os.unlink(args[1])
1380 output_zip = zipfile.ZipFile(args[1], "w",
1381 compression=zipfile.ZIP_DEFLATED)
1382 else:
1383 temp_zip_file = tempfile.NamedTemporaryFile()
1384 output_zip = zipfile.ZipFile(temp_zip_file, "w",
1385 compression=zipfile.ZIP_DEFLATED)
Doug Zongker62d4f182014-08-04 16:06:43 -07001386
Daniel Rosenberg40ef35b2015-11-10 19:21:34 -08001387 # Non A/B OTAs rely on /cache partition to store temporary files.
Tao Bao767e3ac2015-11-10 12:19:19 -08001388 cache_size = OPTIONS.info_dict.get("cache_size", None)
Tao Baoc098e9e2016-01-07 13:03:56 -08001389 if cache_size is None:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001390 print("--- can't determine the cache partition size ---")
Tao Bao767e3ac2015-11-10 12:19:19 -08001391 OPTIONS.cache_size = cache_size
Tao Bao8dcf7382015-05-21 14:09:49 -07001392
Tao Bao767e3ac2015-11-10 12:19:19 -08001393 # Generate a full OTA.
Tao Bao0c6a4142017-12-15 10:11:19 -08001394 if OPTIONS.incremental_source is None:
Tao Baoc098e9e2016-01-07 13:03:56 -08001395 WriteFullOTAPackage(input_zip, output_zip)
Tao Bao767e3ac2015-11-10 12:19:19 -08001396
1397 # Generate an incremental OTA. It will fall back to generate a full OTA on
1398 # failure unless no_fallback_to_full is specified.
1399 else:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001400 print("unzipping source target-files...")
Tao Bao767e3ac2015-11-10 12:19:19 -08001401 OPTIONS.source_tmp, source_zip = common.UnzipTemp(
Tao Bao6b0b2f92017-03-05 11:38:11 -08001402 OPTIONS.incremental_source,
Tao Bao457cbf62017-03-06 09:56:01 -08001403 UNZIP_PATTERN)
Tao Bao767e3ac2015-11-10 12:19:19 -08001404 OPTIONS.target_info_dict = OPTIONS.info_dict
1405 OPTIONS.source_info_dict = common.LoadInfoDict(source_zip,
1406 OPTIONS.source_tmp)
1407 if OPTIONS.verbose:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001408 print("--- source info ---")
Tao Bao767e3ac2015-11-10 12:19:19 -08001409 common.DumpInfoDict(OPTIONS.source_info_dict)
1410 try:
Tao Bao457cbf62017-03-06 09:56:01 -08001411 WriteBlockIncrementalOTAPackage(input_zip, source_zip, output_zip)
Tao Baod62c6032015-11-30 09:40:20 -08001412 if OPTIONS.log_diff:
1413 out_file = open(OPTIONS.log_diff, 'w')
1414 import target_files_diff
1415 target_files_diff.recursiveDiff('',
1416 OPTIONS.source_tmp,
1417 OPTIONS.input_tmp,
1418 out_file)
1419 out_file.close()
Tao Bao767e3ac2015-11-10 12:19:19 -08001420 except ValueError:
1421 if not OPTIONS.fallback_to_full:
1422 raise
Tao Bao89fbb0f2017-01-10 10:47:58 -08001423 print("--- failed to build incremental; falling back to full ---")
Tao Bao767e3ac2015-11-10 12:19:19 -08001424 OPTIONS.incremental_source = None
Doug Zongker62d4f182014-08-04 16:06:43 -07001425 WriteFullOTAPackage(input_zip, output_zip)
Doug Zongker62d4f182014-08-04 16:06:43 -07001426
Tao Bao767e3ac2015-11-10 12:19:19 -08001427 common.ZipClose(output_zip)
Doug Zongkerafb32ea2011-09-22 10:28:04 -07001428
Tao Bao767e3ac2015-11-10 12:19:19 -08001429 # Sign the generated zip package unless no_signing is specified.
Takeshi Kanemotoe153b342013-11-14 17:20:50 +09001430 if not OPTIONS.no_signing:
1431 SignOutput(temp_zip_file.name, args[1])
1432 temp_zip_file.close()
Doug Zongkereef39442009-04-02 12:14:19 -07001433
Tao Bao89fbb0f2017-01-10 10:47:58 -08001434 print("done.")
Doug Zongkereef39442009-04-02 12:14:19 -07001435
1436
1437if __name__ == '__main__':
1438 try:
Ying Wang7e6d4e42010-12-13 16:25:36 -08001439 common.CloseInheritedPipes()
Doug Zongkereef39442009-04-02 12:14:19 -07001440 main(sys.argv[1:])
Dan Albert8b72aef2015-03-23 19:13:21 -07001441 except common.ExternalError as e:
Tao Bao89fbb0f2017-01-10 10:47:58 -08001442 print("\n ERROR: %s\n" % (e,))
Doug Zongkereef39442009-04-02 12:14:19 -07001443 sys.exit(1)
Doug Zongkerfc44a512014-08-26 13:10:25 -07001444 finally:
1445 common.Cleanup()