| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 1 | #!/bin/bash | 
 | 2 |  | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 3 | # | 
 | 4 | # Copyright (C) 2015 The Android Open Source Project | 
 | 5 | # | 
 | 6 | # Licensed under the Apache License, Version 2.0 (the "License"); | 
 | 7 | # you may not use this file except in compliance with the License. | 
 | 8 | # You may obtain a copy of the License at | 
 | 9 | # | 
 | 10 | #      http://www.apache.org/licenses/LICENSE-2.0 | 
 | 11 | # | 
 | 12 | # Unless required by applicable law or agreed to in writing, software | 
 | 13 | # distributed under the License is distributed on an "AS IS" BASIS, | 
 | 14 | # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. | 
 | 15 | # See the License for the specific language governing permissions and | 
 | 16 | # limitations under the License. | 
 | 17 | # | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 18 |  | 
 | 19 | # Script to generate a Brillo update for use by the update engine. | 
 | 20 | # | 
 | 21 | # usage: brillo_update_payload COMMAND [ARGS] | 
 | 22 | # The following commands are supported: | 
 | 23 | #  generate    generate an unsigned payload | 
 | 24 | #  hash        generate a payload or metadata hash | 
 | 25 | #  sign        generate a signed payload | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 26 | #  properties  generate a properties file from a payload | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 27 | #  verify      verify a payload by recreating a target image. | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 28 | #  check       verify a payload using paycheck (static testing) | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 29 | # | 
 | 30 | #  Generate command arguments: | 
| Tianjie Xu | 72d512c | 2019-08-21 15:20:35 -0700 | [diff] [blame] | 31 | #  --payload                  generated unsigned payload output file | 
 | 32 | #  --source_image             if defined, generate a delta payload from the | 
 | 33 | #                             specified image to the target_image | 
 | 34 | #  --target_image             the target image that should be sent to clients | 
 | 35 | #  --metadata_size_file       if defined, generate a file containing the size | 
 | 36 | #                             of the ayload metadata in bytes to the specified | 
 | 37 | #                             file | 
 | 38 | #  --disable_fec_computation  Disable the on device fec data computation for | 
 | 39 | #                             incremental update. This feature is enabled by | 
 | 40 | #                             default | 
| Tianjie | f4502bb | 2021-09-08 19:08:53 -0700 | [diff] [blame] | 41 | #  --force_minor_version      Override the minor version used for delta | 
 | 42 | #                             generation. | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 43 | # | 
 | 44 | #  Hash command arguments: | 
 | 45 | #  --unsigned_payload    the input unsigned payload to generate the hash from | 
 | 46 | #  --signature_size      signature sizes in bytes in the following format: | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 47 | #                        "size1:size2[:...]" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 48 | #  --payload_hash_file   if defined, generate a payload hash and output to the | 
 | 49 | #                        specified file | 
 | 50 | #  --metadata_hash_file  if defined, generate a metadata hash and output to the | 
 | 51 | #                        specified file | 
 | 52 | # | 
 | 53 | #  Sign command arguments: | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 54 | #  --unsigned_payload        the input unsigned payload to insert the signatures | 
 | 55 | #  --payload                 the output signed payload | 
 | 56 | #  --signature_size          signature sizes in bytes in the following format: | 
 | 57 | #                            "size1:size2[:...]" | 
 | 58 | #  --payload_signature_file  the payload signature files in the following | 
 | 59 | #                            format: | 
 | 60 | #                            "payload_signature1:payload_signature2[:...]" | 
 | 61 | #  --metadata_signature_file the metadata signature files in the following | 
 | 62 | #                            format: | 
 | 63 | #                            "metadata_signature1:metadata_signature2[:...]" | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 64 | #  --metadata_size_file      if defined, generate a file containing the size of | 
 | 65 | #                            the signed payload metadata in bytes to the | 
 | 66 | #                            specified file | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 67 | #  Note that the number of signature sizes and payload signatures have to match. | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 68 | # | 
 | 69 | #  Properties command arguments: | 
 | 70 | #  --payload                 the input signed or unsigned payload | 
 | 71 | #  --properties_file         the output path where to write the properties, or | 
 | 72 | #                            '-' for stdout. | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 73 | #  Verify command arguments: | 
 | 74 | #  --payload             payload input file | 
 | 75 | #  --source_image        verify payload to the specified source image. | 
 | 76 | #  --target_image        the target image to verify upon. | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 77 | # | 
 | 78 | #  Check command arguments: | 
 | 79 | #     Symmetrical with the verify command. | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 80 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 81 |  | 
| Alex Deymo | 61e1fa8 | 2016-01-19 15:16:34 -0800 | [diff] [blame] | 82 | # Exit codes: | 
 | 83 | EX_UNSUPPORTED_DELTA=100 | 
 | 84 |  | 
| Jason Kusuma | f514c54 | 2015-11-05 18:43:45 -0800 | [diff] [blame] | 85 | warn() { | 
 | 86 |   echo "brillo_update_payload: warning: $*" >&2 | 
 | 87 | } | 
 | 88 |  | 
| Gilad Arnold | 957ce12 | 2015-10-14 16:02:55 -0700 | [diff] [blame] | 89 | die() { | 
 | 90 |   echo "brillo_update_payload: error: $*" >&2 | 
 | 91 |   exit 1 | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 92 | } | 
 | 93 |  | 
| Parveen Kumar | b31e1ac | 2020-10-16 15:30:09 -0700 | [diff] [blame] | 94 | # Loads shflags. We first look at the default install location; then our own | 
 | 95 | # directory; finally the parent directory. | 
| Gilad Arnold | 957ce12 | 2015-10-14 16:02:55 -0700 | [diff] [blame] | 96 | load_shflags() { | 
 | 97 |   local my_dir="$(dirname "$(readlink -f "$0")")" | 
 | 98 |   local path | 
| Parveen Kumar | b31e1ac | 2020-10-16 15:30:09 -0700 | [diff] [blame] | 99 |   for path in /usr/share/misc \ | 
 | 100 |     "${my_dir}"/lib/shflags \ | 
 | 101 |     "${my_dir}"/../lib/shflags; do | 
| Gilad Arnold | 957ce12 | 2015-10-14 16:02:55 -0700 | [diff] [blame] | 102 |     if [[ -r "${path}/shflags" ]]; then | 
 | 103 |       . "${path}/shflags" || die "Could not load ${path}/shflags." | 
 | 104 |       return | 
 | 105 |     fi | 
 | 106 |   done | 
 | 107 |   die "Could not find shflags." | 
 | 108 | } | 
 | 109 |  | 
 | 110 | load_shflags | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 111 |  | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 112 | HELP_GENERATE="generate: Generate an unsigned update payload." | 
 | 113 | HELP_HASH="hash: Generate the hashes of the unsigned payload and metadata used \ | 
 | 114 | for signing." | 
 | 115 | HELP_SIGN="sign: Insert the signatures into the unsigned payload." | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 116 | HELP_PROPERTIES="properties: Extract payload properties to a file." | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 117 | HELP_VERIFY="verify: Verify a (signed) update payload using delta_generator." | 
 | 118 | HELP_CHECK="check: Check a (signed) update payload using paycheck (static \ | 
 | 119 | testing)." | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 120 |  | 
 | 121 | usage() { | 
 | 122 |   echo "Supported commands:" | 
 | 123 |   echo | 
 | 124 |   echo "${HELP_GENERATE}" | 
 | 125 |   echo "${HELP_HASH}" | 
 | 126 |   echo "${HELP_SIGN}" | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 127 |   echo "${HELP_PROPERTIES}" | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 128 |   echo "${HELP_VERIFY}" | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 129 |   echo "${HELP_CHECK}" | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 130 |   echo | 
 | 131 |   echo "Use: \"$0 <command> --help\" for more options." | 
 | 132 | } | 
 | 133 |  | 
 | 134 | # Check that a command is specified. | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 135 | if [[ $# -lt 1 ]]; then | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 136 |   echo "Please specify a command [generate|hash|sign|properties|verify|check]" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 137 |   exit 1 | 
 | 138 | fi | 
 | 139 |  | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 140 | # Parse command. | 
 | 141 | COMMAND="${1:-}" | 
 | 142 | shift | 
 | 143 |  | 
 | 144 | case "${COMMAND}" in | 
 | 145 |   generate) | 
 | 146 |     FLAGS_HELP="${HELP_GENERATE}" | 
 | 147 |     ;; | 
 | 148 |  | 
 | 149 |   hash) | 
 | 150 |     FLAGS_HELP="${HELP_HASH}" | 
 | 151 |     ;; | 
 | 152 |  | 
 | 153 |   sign) | 
 | 154 |     FLAGS_HELP="${HELP_SIGN}" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 155 |     ;; | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 156 |  | 
 | 157 |   properties) | 
 | 158 |     FLAGS_HELP="${HELP_PROPERTIES}" | 
 | 159 |     ;; | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 160 |  | 
 | 161 |   verify) | 
 | 162 |     FLAGS_HELP="${HELP_VERIFY}" | 
 | 163 |     ;; | 
 | 164 |  | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 165 |   check) | 
 | 166 |     FLAGS_HELP="${HELP_CHECK}" | 
 | 167 |     ;; | 
 | 168 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 169 |   *) | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 170 |     echo "Unrecognized command: \"${COMMAND}\"" >&2 | 
 | 171 |     usage >&2 | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 172 |     exit 1 | 
 | 173 |     ;; | 
 | 174 | esac | 
 | 175 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 176 | # Flags | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 177 | FLAGS_HELP="Usage: $0 ${COMMAND} [flags] | 
 | 178 | ${FLAGS_HELP}" | 
 | 179 |  | 
 | 180 | if [[ "${COMMAND}" == "generate" ]]; then | 
 | 181 |   DEFINE_string payload "" \ | 
 | 182 |     "Path to output the generated unsigned payload file." | 
 | 183 |   DEFINE_string target_image "" \ | 
 | 184 |     "Path to the target image that should be sent to clients." | 
 | 185 |   DEFINE_string source_image "" \ | 
 | 186 |     "Optional: Path to a source image. If specified, this makes a delta update." | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 187 |   DEFINE_string metadata_size_file "" \ | 
 | 188 |     "Optional: Path to output metadata size." | 
| Sen Jiang | 8e768e9 | 2017-06-28 17:13:19 -0700 | [diff] [blame] | 189 |   DEFINE_string max_timestamp "" \ | 
 | 190 |     "Optional: The maximum unix timestamp of the OS allowed to apply this \ | 
 | 191 | payload, should be set to a number higher than the build timestamp of the \ | 
 | 192 | system running on the device, 0 if not specified." | 
| Kelvin Zhang | 1f49642 | 2020-08-11 17:18:23 -0400 | [diff] [blame] | 193 |   DEFINE_string partition_timestamps "" \ | 
 | 194 |     "Optional: Per-partition maximum unix timestamp of the OS allowed to \ | 
 | 195 | apply this payload. Should be a comma separated key value pairs. e.x.\ | 
 | 196 | system:1234,vendor:456" | 
| Tianjie Xu | 72d512c | 2019-08-21 15:20:35 -0700 | [diff] [blame] | 197 |   DEFINE_string disable_fec_computation "" \ | 
 | 198 |     "Optional: Disables the on device fec data computation for incremental \ | 
 | 199 | update. This feature is enabled by default." | 
| Kelvin Zhang | 098e79a | 2020-11-19 17:40:56 -0500 | [diff] [blame] | 200 |   DEFINE_string disable_verity_computation "" \ | 
 | 201 |     "Optional: Disables the on device verity computation for incremental \ | 
 | 202 | update. This feature is enabled by default." | 
| Tianjie | f5baff4 | 2020-07-17 21:43:22 -0700 | [diff] [blame] | 203 |   DEFINE_string is_partial_update "" \ | 
 | 204 |     "Optional: True if the payload is for partial update. i.e. it only updates \ | 
 | 205 | a subset of partitions on device." | 
| Kelvin Zhang | dde2ef4 | 2020-11-20 12:26:19 -0500 | [diff] [blame] | 206 |   DEFINE_string full_boot "" "Will include full boot image" | 
| Kelvin Zhang | 9101ff3 | 2021-01-19 15:48:53 -0500 | [diff] [blame] | 207 |   DEFINE_string disable_vabc "" \ | 
 | 208 |     "Optional: Disables Virtual AB Compression when installing the OTA" | 
| Kelvin Zhang | 02df21b | 2021-01-07 14:55:18 -0500 | [diff] [blame] | 209 |   DEFINE_string enable_vabc_xor "" \ | 
 | 210 |     "Optional: Enable the use of Virtual AB Compression XOR feature" | 
| Tianjie | f4502bb | 2021-09-08 19:08:53 -0700 | [diff] [blame] | 211 |   DEFINE_string force_minor_version "" \ | 
 | 212 |     "Optional: Override the minor version for the delta generation." | 
| Kelvin Zhang | 0aa4fae | 2021-10-28 09:15:27 -0700 | [diff] [blame] | 213 |   DEFINE_string compressor_types "" \ | 
 | 214 |     "Optional: allowed compressor types. Colon separated, allowe values are bz2 and brotli" | 
| Kelvin Zhang | 2298798 | 2022-01-04 14:37:28 -0800 | [diff] [blame] | 215 |   DEFINE_string enable_zucchini "" \ | 
 | 216 |     "Optional: Whether to enable zucchini diffing" | 
| Kelvin Zhang | 907b0e6 | 2022-01-10 06:23:10 -0800 | [diff] [blame] | 217 |   DEFINE_string enable_lz4diff "" \ | 
 | 218 |     "Optional: Whether to enable lz4 diffing for EROFS" | 
 | 219 |   DEFINE_string liblz4_path "" \ | 
 | 220 |     "Required if --enabled_lz4diff true is passed. Path to liblz4.so. delta_generator will use this copy of liblz4.so for compression. It is important that this copy of liblz4.so is the same as the one on source build." | 
| Kelvin Zhang | 8389dfe | 2022-01-13 12:47:11 -0800 | [diff] [blame] | 221 |   DEFINE_string erofs_compression_param "" \ | 
 | 222 |     "Compression parameter passed to mkfs.erofs's -z option." | 
| Kelvin Zhang | cfc531f | 2022-08-24 17:58:53 +0000 | [diff] [blame] | 223 |   DEFINE_string security_patch_level "" \ | 
 | 224 |     "Optional: security patch level of this OTA" | 
| Daniel Zheng | cbe8e63 | 2023-04-25 12:43:43 -0700 | [diff] [blame] | 225 |   DEFINE_string max_threads "" \ | 
 | 226 |     "Optional: specifies max_threads used to generate OTA" | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 227 | fi | 
 | 228 | if [[ "${COMMAND}" == "hash" || "${COMMAND}" == "sign" ]]; then | 
 | 229 |   DEFINE_string unsigned_payload "" "Path to the input unsigned payload." | 
 | 230 |   DEFINE_string signature_size "" \ | 
 | 231 |     "Signature sizes in bytes in the following format: size1:size2[:...]" | 
 | 232 | fi | 
 | 233 | if [[ "${COMMAND}" == "hash" ]]; then | 
 | 234 |   DEFINE_string metadata_hash_file "" \ | 
 | 235 |     "Optional: Path to output metadata hash file." | 
 | 236 |   DEFINE_string payload_hash_file "" \ | 
 | 237 |     "Optional: Path to output payload hash file." | 
 | 238 | fi | 
 | 239 | if [[ "${COMMAND}" == "sign" ]]; then | 
 | 240 |   DEFINE_string payload "" \ | 
 | 241 |     "Path to output the generated unsigned payload file." | 
 | 242 |   DEFINE_string metadata_signature_file "" \ | 
 | 243 |     "The metatada signatures in the following format: \ | 
 | 244 | metadata_signature1:metadata_signature2[:...]" | 
 | 245 |   DEFINE_string payload_signature_file "" \ | 
 | 246 |     "The payload signatures in the following format: \ | 
 | 247 | payload_signature1:payload_signature2[:...]" | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 248 |   DEFINE_string metadata_size_file "" \ | 
 | 249 |     "Optional: Path to output metadata size." | 
| Alex Deymo | c64ffd5 | 2015-09-25 18:10:07 -0700 | [diff] [blame] | 250 | fi | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 251 | if [[ "${COMMAND}" == "properties" ]]; then | 
 | 252 |   DEFINE_string payload "" \ | 
 | 253 |     "Path to the input signed or unsigned payload file." | 
 | 254 |   DEFINE_string properties_file "-" \ | 
 | 255 |     "Path to output the extracted property files. If '-' is passed stdout will \ | 
 | 256 | be used." | 
 | 257 | fi | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 258 | if [[ "${COMMAND}" == "verify" || "${COMMAND}" == "check" ]]; then | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 259 |   DEFINE_string payload "" \ | 
 | 260 |     "Path to the input payload file." | 
 | 261 |   DEFINE_string target_image "" \ | 
 | 262 |     "Path to the target image to verify upon." | 
 | 263 |   DEFINE_string source_image "" \ | 
 | 264 |     "Optional: Path to a source image. If specified, the delta update is \ | 
 | 265 | applied to this." | 
 | 266 | fi | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 267 |  | 
| Alex Deymo | 5fbb110 | 2017-01-12 13:55:52 -0800 | [diff] [blame] | 268 | DEFINE_string work_dir "${TMPDIR:-/tmp}" "Where to dump temporary files." | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 269 |  | 
 | 270 | # Parse command line flag arguments | 
 | 271 | FLAGS "$@" || exit 1 | 
 | 272 | eval set -- "${FLAGS_ARGV}" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 273 | set -e | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 274 |  | 
| Alex Deymo | 5fbb110 | 2017-01-12 13:55:52 -0800 | [diff] [blame] | 275 | # Override the TMPDIR with the passed work_dir flags, which anyway defaults to | 
 | 276 | # ${TMPDIR}. | 
 | 277 | TMPDIR="${FLAGS_work_dir}" | 
 | 278 | export TMPDIR | 
 | 279 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 280 | # Associative arrays from partition name to file in the source and target | 
 | 281 | # images. The size of the updated area must be the size of the file. | 
 | 282 | declare -A SRC_PARTITIONS | 
 | 283 | declare -A DST_PARTITIONS | 
 | 284 |  | 
| Alex Deymo | 20bdc70 | 2016-12-07 21:07:11 -0800 | [diff] [blame] | 285 | # Associative arrays for the .map files associated with each src/dst partition | 
 | 286 | # file in SRC_PARTITIONS and DST_PARTITIONS. | 
 | 287 | declare -A SRC_PARTITIONS_MAP | 
 | 288 | declare -A DST_PARTITIONS_MAP | 
 | 289 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 290 | # List of partition names in order. | 
 | 291 | declare -a PARTITIONS_ORDER | 
 | 292 |  | 
| Tao Bao | 9648990 | 2019-04-02 16:25:03 -0700 | [diff] [blame] | 293 | # A list of PIDs of the extract_image workers. | 
 | 294 | EXTRACT_IMAGE_PIDS=() | 
 | 295 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 296 | # A list of temporary files to remove during cleanup. | 
 | 297 | CLEANUP_FILES=() | 
 | 298 |  | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 299 | # Global options to force the version of the payload. | 
 | 300 | FORCE_MAJOR_VERSION="" | 
 | 301 | FORCE_MINOR_VERSION="" | 
 | 302 |  | 
| Sen Jiang | 6f7b22c | 2015-11-12 15:50:39 -0800 | [diff] [blame] | 303 | # Path to the postinstall config file in target image if exists. | 
 | 304 | POSTINSTALL_CONFIG_FILE="" | 
 | 305 |  | 
| Yifan Hong | 398cb54 | 2018-10-18 11:29:40 -0700 | [diff] [blame] | 306 | # Path to the dynamic partition info file in target image if exists. | 
 | 307 | DYNAMIC_PARTITION_INFO_FILE="" | 
 | 308 |  | 
| Kelvin Zhang | deb3445 | 2021-01-21 11:54:36 -0500 | [diff] [blame] | 309 | # Path to the META/apex_info.pb found in target build | 
 | 310 | APEX_INFO_FILE="" | 
 | 311 |  | 
| Alex Deymo | c97df43 | 2015-09-25 17:23:52 -0700 | [diff] [blame] | 312 | # read_option_int <file.txt> <option_key> [default_value] | 
 | 313 | # | 
 | 314 | # Reads the unsigned integer value associated with |option_key| in a key=value | 
 | 315 | # file |file.txt|. Prints the read value if found and valid, otherwise prints | 
 | 316 | # the |default_value|. | 
 | 317 | read_option_uint() { | 
 | 318 |   local file_txt="$1" | 
 | 319 |   local option_key="$2" | 
 | 320 |   local default_value="${3:-}" | 
 | 321 |   local value | 
| Tao Bao | c288d5b | 2019-10-03 13:47:06 -0700 | [diff] [blame] | 322 |   if value=$(grep "^${option_key}=" "${file_txt}" | tail -n 1); then | 
| Alex Deymo | c97df43 | 2015-09-25 17:23:52 -0700 | [diff] [blame] | 323 |     if value=$(echo "${value}" | cut -f 2- -d "=" | grep -E "^[0-9]+$"); then | 
 | 324 |       echo "${value}" | 
 | 325 |       return | 
 | 326 |     fi | 
 | 327 |   fi | 
 | 328 |   echo "${default_value}" | 
 | 329 | } | 
 | 330 |  | 
| Sen Jiang | d0e9a89 | 2016-07-22 16:28:07 -0700 | [diff] [blame] | 331 | # truncate_file <file_path> <file_size> | 
 | 332 | # | 
| Dan Willemsen | 3271186 | 2018-10-04 21:25:50 -0700 | [diff] [blame] | 333 | # Truncate the given |file_path| to |file_size| using python. | 
| Sen Jiang | d0e9a89 | 2016-07-22 16:28:07 -0700 | [diff] [blame] | 334 | # The truncate binary might not be available. | 
 | 335 | truncate_file() { | 
 | 336 |   local file_path="$1" | 
 | 337 |   local file_size="$2" | 
| Dan Willemsen | 3271186 | 2018-10-04 21:25:50 -0700 | [diff] [blame] | 338 |   python -c "open(\"${file_path}\", 'a').truncate(${file_size})" | 
| Sen Jiang | d0e9a89 | 2016-07-22 16:28:07 -0700 | [diff] [blame] | 339 | } | 
 | 340 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 341 | # Create a temporary file in the work_dir with an optional pattern name. | 
 | 342 | # Prints the name of the newly created file. | 
 | 343 | create_tempfile() { | 
 | 344 |   local pattern="${1:-tempfile.XXXXXX}" | 
 | 345 |   mktemp --tmpdir="${FLAGS_work_dir}" "${pattern}" | 
 | 346 | } | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 347 |  | 
 | 348 | cleanup() { | 
 | 349 |   local err="" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 350 |   rm -f "${CLEANUP_FILES[@]}" || err=1 | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 351 |  | 
 | 352 |   # If we are cleaning up after an error, or if we got an error during | 
 | 353 |   # cleanup (even if we eventually succeeded) return a non-zero exit | 
 | 354 |   # code. This triggers additional logging in most environments that call | 
 | 355 |   # this script. | 
 | 356 |   if [[ -n "${err}" ]]; then | 
 | 357 |     die "Cleanup encountered an error." | 
 | 358 |   fi | 
 | 359 | } | 
 | 360 |  | 
 | 361 | cleanup_on_error() { | 
 | 362 |   trap - INT TERM ERR EXIT | 
 | 363 |   cleanup | 
 | 364 |   die "Cleanup success after an error." | 
 | 365 | } | 
 | 366 |  | 
 | 367 | cleanup_on_exit() { | 
 | 368 |   trap - INT TERM ERR EXIT | 
 | 369 |   cleanup | 
 | 370 | } | 
 | 371 |  | 
 | 372 | trap cleanup_on_error INT TERM ERR | 
 | 373 | trap cleanup_on_exit EXIT | 
 | 374 |  | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 375 | # extract_file <zip_file> <entry_name> <destination> | 
 | 376 | # | 
 | 377 | # Extracts |entry_name| from |zip_file| to |destination|. | 
 | 378 | extract_file() { | 
 | 379 |   local zip_file="$1" | 
 | 380 |   local entry_name="$2" | 
 | 381 |   local destination="$3" | 
 | 382 |  | 
 | 383 |   # unzip -p won't report error upon ENOSPC. Therefore, create a temp directory | 
 | 384 |   # as the destination of the unzip, and move the file to the intended | 
 | 385 |   # destination. | 
 | 386 |   local output_directory=$( | 
 | 387 |     mktemp --directory --tmpdir="${FLAGS_work_dir}" "TEMP.XXXXXX") | 
 | 388 |   unzip "${zip_file}" "${entry_name}" -d "${output_directory}" || | 
 | 389 |     { rm -rf "${output_directory}"; die "Failed to extract ${entry_name}"; } | 
 | 390 |  | 
 | 391 |   mv "${output_directory}/${entry_name}" "${destination}" | 
 | 392 |   rm -rf "${output_directory}" | 
 | 393 | } | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 394 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 395 | # extract_image <image> <partitions_array> [partitions_order] | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 396 | # | 
 | 397 | # Detect the format of the |image| file and extract its updatable partitions | 
 | 398 | # into new temporary files. Add the list of partition names and its files to the | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 399 | # associative array passed in |partitions_array|. If |partitions_order| is | 
 | 400 | # passed, set it to list of partition names in order. | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 401 | extract_image() { | 
 | 402 |   local image="$1" | 
 | 403 |  | 
 | 404 |   # Brillo images are zip files. We detect the 4-byte magic header of the zip | 
 | 405 |   # file. | 
| Elliott Hughes | 5df503c | 2018-11-27 16:57:34 -0800 | [diff] [blame] | 406 |   local magic=$(xxd -p -l4 "${image}") | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 407 |   if [[ "${magic}" == "504b0304" ]]; then | 
 | 408 |     echo "Detected .zip file, extracting Brillo image." | 
 | 409 |     extract_image_brillo "$@" | 
 | 410 |     return | 
 | 411 |   fi | 
 | 412 |  | 
 | 413 |   # Chrome OS images are GPT partitioned disks. We should have the cgpt binary | 
 | 414 |   # bundled here and we will use it to extract the partitions, so the GPT | 
 | 415 |   # headers must be valid. | 
 | 416 |   if cgpt show -q -n "${image}" >/dev/null; then | 
 | 417 |     echo "Detected GPT image, extracting Chrome OS image." | 
 | 418 |     extract_image_cros "$@" | 
 | 419 |     return | 
 | 420 |   fi | 
 | 421 |  | 
 | 422 |   die "Couldn't detect the image format of ${image}" | 
 | 423 | } | 
 | 424 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 425 | # extract_image_cros <image.bin> <partitions_array> [partitions_order] | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 426 | # | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 427 | # Extract Chromium OS recovery images into new temporary files. | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 428 | extract_image_cros() { | 
 | 429 |   local image="$1" | 
 | 430 |   local partitions_array="$2" | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 431 |   local partitions_order="${3:-}" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 432 |  | 
 | 433 |   local kernel root | 
 | 434 |   kernel=$(create_tempfile "kernel.bin.XXXXXX") | 
 | 435 |   CLEANUP_FILES+=("${kernel}") | 
 | 436 |   root=$(create_tempfile "root.bin.XXXXXX") | 
 | 437 |   CLEANUP_FILES+=("${root}") | 
 | 438 |  | 
 | 439 |   cros_generate_update_payload --extract \ | 
 | 440 |     --image "${image}" \ | 
| Amin Hassani | 58e01d6 | 2018-09-19 14:56:15 -0700 | [diff] [blame] | 441 |     --kern_path "${kernel}" --root_path "${root}" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 442 |  | 
| Amin Hassani | 58e01d6 | 2018-09-19 14:56:15 -0700 | [diff] [blame] | 443 |   # Chrome OS now uses major_version 2 payloads for all boards. | 
 | 444 |   # See crbug.com/794404 for more information. | 
 | 445 |   FORCE_MAJOR_VERSION="2" | 
| Alex Deymo | 83f2f70 | 2015-10-14 14:49:33 -0700 | [diff] [blame] | 446 |  | 
| Tudor Brindus | dda79e2 | 2018-06-28 18:03:21 -0700 | [diff] [blame] | 447 |   eval ${partitions_array}[kernel]=\""${kernel}"\" | 
 | 448 |   eval ${partitions_array}[root]=\""${root}"\" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 449 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 450 |   if [[ -n "${partitions_order}" ]]; then | 
| Tudor Brindus | dda79e2 | 2018-06-28 18:03:21 -0700 | [diff] [blame] | 451 |     eval "${partitions_order}=( \"root\" \"kernel\" )" | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 452 |   fi | 
 | 453 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 454 |   local part varname | 
| Tudor Brindus | dda79e2 | 2018-06-28 18:03:21 -0700 | [diff] [blame] | 455 |   for part in kernel root; do | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 456 |     varname="${partitions_array}[${part}]" | 
 | 457 |     printf "md5sum of %s: " "${varname}" | 
 | 458 |     md5sum "${!varname}" | 
 | 459 |   done | 
 | 460 | } | 
 | 461 |  | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 462 | # extract_partition_brillo <target_files.zip> <partitions_array> <partition> | 
 | 463 | #     <part_file> <part_map_file> | 
 | 464 | # | 
 | 465 | # Extract the <partition> from target_files zip file into <part_file> and its | 
 | 466 | # map file into <part_map_file>. | 
 | 467 | extract_partition_brillo() { | 
 | 468 |   local image="$1" | 
 | 469 |   local partitions_array="$2" | 
 | 470 |   local part="$3" | 
 | 471 |   local part_file="$4" | 
 | 472 |   local part_map_file="$5" | 
 | 473 |  | 
 | 474 |   # For each partition, we in turn look for its image file under IMAGES/ and | 
 | 475 |   # RADIO/ in the given target_files zip file. | 
 | 476 |   local path path_in_zip | 
 | 477 |   for path in IMAGES RADIO; do | 
 | 478 |     if unzip -l "${image}" "${path}/${part}.img" >/dev/null; then | 
 | 479 |       path_in_zip="${path}" | 
 | 480 |       break | 
 | 481 |     fi | 
 | 482 |   done | 
 | 483 |   [[ -n "${path_in_zip}" ]] || die "Failed to find ${part}.img" | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 484 |   extract_file "${image}" "${path_in_zip}/${part}.img" "${part_file}" | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 485 |  | 
 | 486 |   # If the partition is stored as an Android sparse image file, we need to | 
 | 487 |   # convert them to a raw image for the update. | 
| Yifan Hong | 4b821d7 | 2018-12-07 17:26:04 -0800 | [diff] [blame] | 488 |   local magic=$(xxd -p -l4 "${part_file}") | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 489 |   if [[ "${magic}" == "3aff26ed" ]]; then | 
 | 490 |     local temp_sparse=$(create_tempfile "${part}.sparse.XXXXXX") | 
 | 491 |     echo "Converting Android sparse image ${part}.img to RAW." | 
 | 492 |     mv "${part_file}" "${temp_sparse}" | 
 | 493 |     simg2img "${temp_sparse}" "${part_file}" | 
 | 494 |     rm -f "${temp_sparse}" | 
 | 495 |   fi | 
 | 496 |  | 
 | 497 |   # Extract the .map file (if one is available). | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 498 |   if unzip -l "${image}" "${path_in_zip}/${part}.map" > /dev/null; then | 
 | 499 |     extract_file "${image}" "${path_in_zip}/${part}.map" "${part_map_file}" | 
 | 500 |   fi | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 501 |  | 
 | 502 |   # delta_generator only supports images multiple of 4 KiB. For target images | 
 | 503 |   # we pad the data with zeros if needed, but for source images we truncate | 
 | 504 |   # down the data since the last block of the old image could be padded on | 
 | 505 |   # disk with unknown data. | 
 | 506 |   local filesize=$(stat -c%s "${part_file}") | 
 | 507 |   if [[ $(( filesize % 4096 )) -ne 0 ]]; then | 
 | 508 |     if [[ "${partitions_array}" == "SRC_PARTITIONS" ]]; then | 
 | 509 |       echo "Rounding DOWN partition ${part}.img to a multiple of 4 KiB." | 
 | 510 |       : $(( filesize = filesize & -4096 )) | 
 | 511 |     else | 
 | 512 |       echo "Rounding UP partition ${part}.img to a multiple of 4 KiB." | 
 | 513 |       : $(( filesize = (filesize + 4095) & -4096 )) | 
 | 514 |     fi | 
 | 515 |     truncate_file "${part_file}" "${filesize}" | 
 | 516 |   fi | 
 | 517 |  | 
 | 518 |   echo "Extracted ${partitions_array}[${part}]: ${filesize} bytes" | 
 | 519 | } | 
 | 520 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 521 | # extract_image_brillo <target_files.zip> <partitions_array> [partitions_order] | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 522 | # | 
 | 523 | # Extract the A/B updated partitions from a Brillo target_files zip file into | 
 | 524 | # new temporary files. | 
 | 525 | extract_image_brillo() { | 
 | 526 |   local image="$1" | 
 | 527 |   local partitions_array="$2" | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 528 |   local partitions_order="${3:-}" | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 529 |  | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 530 |   local partitions=( "boot" "system" ) | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 531 |   local ab_partitions_list | 
 | 532 |   ab_partitions_list=$(create_tempfile "ab_partitions_list.XXXXXX") | 
 | 533 |   CLEANUP_FILES+=("${ab_partitions_list}") | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 534 |   if unzip -l "${image}" "META/ab_partitions.txt" > /dev/null; then | 
 | 535 |     extract_file "${image}" "META/ab_partitions.txt" "${ab_partitions_list}" | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 536 |     if grep -v -E '^[a-zA-Z0-9_-]*$' "${ab_partitions_list}" >&2; then | 
 | 537 |       die "Invalid partition names found in the partition list." | 
 | 538 |     fi | 
| Sen Jiang | 34c711a | 2017-10-25 17:25:21 -0700 | [diff] [blame] | 539 |     # Get partition list without duplicates. | 
 | 540 |     partitions=($(awk '!seen[$0]++' "${ab_partitions_list}")) | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 541 |     if [[ ${#partitions[@]} -eq 0 ]]; then | 
 | 542 |       die "The list of partitions is empty. Can't generate a payload." | 
 | 543 |     fi | 
 | 544 |   else | 
 | 545 |     warn "No ab_partitions.txt found. Using default." | 
 | 546 |   fi | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 547 |   echo "List of A/B partitions for ${partitions_array}: ${partitions[@]}" | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 548 |  | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 549 |   if [[ -n "${partitions_order}" ]]; then | 
 | 550 |     eval "${partitions_order}=(${partitions[@]})" | 
 | 551 |   fi | 
 | 552 |  | 
| Alex Deymo | 83f2f70 | 2015-10-14 14:49:33 -0700 | [diff] [blame] | 553 |   # All Brillo updaters support major version 2. | 
 | 554 |   FORCE_MAJOR_VERSION="2" | 
 | 555 |  | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 556 |   if [[ "${partitions_array}" == "SRC_PARTITIONS" ]]; then | 
| Sen Jiang | 6f7b22c | 2015-11-12 15:50:39 -0800 | [diff] [blame] | 557 |     # Source image | 
 | 558 |     local ue_config=$(create_tempfile "ue_config.XXXXXX") | 
| Alex Deymo | c97df43 | 2015-09-25 17:23:52 -0700 | [diff] [blame] | 559 |     CLEANUP_FILES+=("${ue_config}") | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 560 |     if unzip -l "${image}" "META/update_engine_config.txt" > /dev/null; then | 
 | 561 |       extract_file "${image}" "META/update_engine_config.txt" "${ue_config}" | 
 | 562 |     else | 
| Alex Deymo | c97df43 | 2015-09-25 17:23:52 -0700 | [diff] [blame] | 563 |       warn "No update_engine_config.txt found. Assuming pre-release image, \ | 
 | 564 | using payload minor version 2" | 
 | 565 |     fi | 
| Alex Deymo | 83f2f70 | 2015-10-14 14:49:33 -0700 | [diff] [blame] | 566 |     # For delta payloads, we use the major and minor version supported by the | 
 | 567 |     # old updater. | 
| Alex Deymo | c97df43 | 2015-09-25 17:23:52 -0700 | [diff] [blame] | 568 |     FORCE_MINOR_VERSION=$(read_option_uint "${ue_config}" \ | 
 | 569 |       "PAYLOAD_MINOR_VERSION" 2) | 
| Tianjie | f4502bb | 2021-09-08 19:08:53 -0700 | [diff] [blame] | 570 |     if [[ -n "${FLAGS_force_minor_version}" ]]; then | 
 | 571 |       FORCE_MINOR_VERSION="${FLAGS_force_minor_version}" | 
 | 572 |     fi | 
| Alex Deymo | 83f2f70 | 2015-10-14 14:49:33 -0700 | [diff] [blame] | 573 |     FORCE_MAJOR_VERSION=$(read_option_uint "${ue_config}" \ | 
 | 574 |       "PAYLOAD_MAJOR_VERSION" 2) | 
| Alex Deymo | 61e1fa8 | 2016-01-19 15:16:34 -0800 | [diff] [blame] | 575 |  | 
 | 576 |     # Brillo support for deltas started with minor version 3. | 
 | 577 |     if [[ "${FORCE_MINOR_VERSION}" -le 2 ]]; then | 
 | 578 |       warn "No delta support from minor version ${FORCE_MINOR_VERSION}. \ | 
 | 579 | Disabling deltas for this source version." | 
 | 580 |       exit ${EX_UNSUPPORTED_DELTA} | 
 | 581 |     fi | 
| Sen Jiang | 6f7b22c | 2015-11-12 15:50:39 -0800 | [diff] [blame] | 582 |   else | 
 | 583 |     # Target image | 
 | 584 |     local postinstall_config=$(create_tempfile "postinstall_config.XXXXXX") | 
 | 585 |     CLEANUP_FILES+=("${postinstall_config}") | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 586 |     if unzip -l "${image}" "META/postinstall_config.txt" > /dev/null; then | 
 | 587 |       extract_file "${image}" "META/postinstall_config.txt" \ | 
 | 588 |         "${postinstall_config}" | 
| Sen Jiang | 6f7b22c | 2015-11-12 15:50:39 -0800 | [diff] [blame] | 589 |       POSTINSTALL_CONFIG_FILE="${postinstall_config}" | 
 | 590 |     fi | 
| Yifan Hong | 398cb54 | 2018-10-18 11:29:40 -0700 | [diff] [blame] | 591 |     local dynamic_partitions_info=$(create_tempfile "dynamic_partitions_info.XXXXXX") | 
 | 592 |     CLEANUP_FILES+=("${dynamic_partitions_info}") | 
| Tianjie Xu | 14715ce | 2019-08-06 17:24:43 -0700 | [diff] [blame] | 593 |     if unzip -l "${image}" "META/dynamic_partitions_info.txt" > /dev/null; then | 
 | 594 |       extract_file "${image}" "META/dynamic_partitions_info.txt" \ | 
 | 595 |         "${dynamic_partitions_info}" | 
| Yifan Hong | 398cb54 | 2018-10-18 11:29:40 -0700 | [diff] [blame] | 596 |       DYNAMIC_PARTITION_INFO_FILE="${dynamic_partitions_info}" | 
 | 597 |     fi | 
| Kelvin Zhang | deb3445 | 2021-01-21 11:54:36 -0500 | [diff] [blame] | 598 |     local apex_info=$(create_tempfile "apex_info.XXXXXX") | 
 | 599 |     CLEANUP_FILES+=("${apex_info}") | 
 | 600 |     if unzip -l "${image}" "META/apex_info.pb" > /dev/null; then | 
 | 601 |       extract_file "${image}" "META/apex_info.pb" \ | 
 | 602 |         "${apex_info}" | 
 | 603 |       APEX_INFO_FILE="${apex_info}" | 
 | 604 |     fi | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 605 |   fi | 
 | 606 |  | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 607 |   local part | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 608 |   for part in "${partitions[@]}"; do | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 609 |     local part_file=$(create_tempfile "${part}.img.XXXXXX") | 
 | 610 |     local part_map_file=$(create_tempfile "${part}.map.XXXXXX") | 
 | 611 |     CLEANUP_FILES+=("${part_file}" "${part_map_file}") | 
 | 612 |     # Extract partitions in background. | 
 | 613 |     extract_partition_brillo "${image}" "${partitions_array}" "${part}" \ | 
 | 614 |         "${part_file}" "${part_map_file}" & | 
| Tao Bao | 9648990 | 2019-04-02 16:25:03 -0700 | [diff] [blame] | 615 |     EXTRACT_IMAGE_PIDS+=("$!") | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 616 |     eval "${partitions_array}[\"${part}\"]=\"${part_file}\"" | 
| Alex Deymo | 20bdc70 | 2016-12-07 21:07:11 -0800 | [diff] [blame] | 617 |     eval "${partitions_array}_MAP[\"${part}\"]=\"${part_map_file}\"" | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 618 |   done | 
 | 619 | } | 
 | 620 |  | 
 | 621 | # cleanup_partition_array <partitions_array> | 
 | 622 | # | 
 | 623 | # Remove all empty files in <partitions_array>. | 
 | 624 | cleanup_partition_array() { | 
 | 625 |   local partitions_array="$1" | 
 | 626 |   # Have to use eval to iterate over associative array keys with variable array | 
 | 627 |   # names, we should change it to use nameref once bash 4.3 is available | 
 | 628 |   # everywhere. | 
 | 629 |   for part in $(eval "echo \${!${partitions_array}[@]}"); do | 
 | 630 |     local path="${partitions_array}[$part]" | 
 | 631 |     if [[ ! -s "${!path}" ]]; then | 
 | 632 |       eval "unset ${partitions_array}[${part}]" | 
 | 633 |     fi | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 634 |   done | 
 | 635 | } | 
 | 636 |  | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 637 | extract_payload_images() { | 
 | 638 |   local payload_type=$1 | 
 | 639 |   echo "Extracting images for ${payload_type} update." | 
 | 640 |  | 
 | 641 |   if [[ "${payload_type}" == "delta" ]]; then | 
 | 642 |     extract_image "${FLAGS_source_image}" SRC_PARTITIONS | 
 | 643 |   fi | 
 | 644 |   extract_image "${FLAGS_target_image}" DST_PARTITIONS PARTITIONS_ORDER | 
| Tao Bao | 9648990 | 2019-04-02 16:25:03 -0700 | [diff] [blame] | 645 |   # Wait for all subprocesses to finish. Not using `wait` since it doesn't die | 
 | 646 |   # on non-zero subprocess exit code. Not using `wait ${EXTRACT_IMAGE_PIDS[@]}` | 
 | 647 |   # as it gives the status of the last process it has waited for. | 
 | 648 |   for pid in ${EXTRACT_IMAGE_PIDS[@]}; do | 
 | 649 |     wait ${pid} | 
 | 650 |   done | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 651 |   cleanup_partition_array SRC_PARTITIONS | 
 | 652 |   cleanup_partition_array SRC_PARTITIONS_MAP | 
 | 653 |   cleanup_partition_array DST_PARTITIONS | 
 | 654 |   cleanup_partition_array DST_PARTITIONS_MAP | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 655 | } | 
 | 656 |  | 
 | 657 | get_payload_type() { | 
 | 658 |   if [[ -z "${FLAGS_source_image}" ]]; then | 
 | 659 |     echo "full" | 
 | 660 |   else | 
 | 661 |     echo "delta" | 
 | 662 |   fi | 
 | 663 | } | 
 | 664 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 665 | validate_generate() { | 
 | 666 |   [[ -n "${FLAGS_payload}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 667 |     die "You must specify an output filename with --payload FILENAME" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 668 |  | 
 | 669 |   [[ -n "${FLAGS_target_image}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 670 |     die "You must specify a target image with --target_image FILENAME" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 671 | } | 
 | 672 |  | 
 | 673 | cmd_generate() { | 
| Sen Jiang | 3e5804d | 2018-09-06 15:53:00 -0700 | [diff] [blame] | 674 |   local payload_type=$(get_payload_type) | 
 | 675 |   extract_payload_images ${payload_type} | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 676 |  | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 677 |   echo "Generating ${payload_type} update." | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 678 |   # Common payload args: | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 679 |   GENERATOR_ARGS=( --out_file="${FLAGS_payload}" ) | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 680 |  | 
 | 681 |   local part old_partitions="" new_partitions="" partition_names="" | 
| Alex Deymo | 20bdc70 | 2016-12-07 21:07:11 -0800 | [diff] [blame] | 682 |   local old_mapfiles="" new_mapfiles="" | 
| Sen Jiang | 788c2d9 | 2016-03-09 12:48:40 -0800 | [diff] [blame] | 683 |   for part in "${PARTITIONS_ORDER[@]}"; do | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 684 |     if [[ -n "${partition_names}" ]]; then | 
 | 685 |       partition_names+=":" | 
 | 686 |       new_partitions+=":" | 
 | 687 |       old_partitions+=":" | 
| Alex Deymo | 20bdc70 | 2016-12-07 21:07:11 -0800 | [diff] [blame] | 688 |       new_mapfiles+=":" | 
 | 689 |       old_mapfiles+=":" | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 690 |     fi | 
 | 691 |     partition_names+="${part}" | 
 | 692 |     new_partitions+="${DST_PARTITIONS[${part}]}" | 
| Kelvin Zhang | 999705e | 2020-11-03 10:07:09 -0500 | [diff] [blame] | 693 |     if [ "${FLAGS_full_boot}" == "true" ] && [ "${part}" == "boot" ]; then | 
 | 694 |       # Skip boot partition. | 
 | 695 |       old_partitions+="" | 
 | 696 |     else | 
 | 697 |       old_partitions+="${SRC_PARTITIONS[${part}]:-}" | 
 | 698 |     fi | 
| Alex Deymo | 20bdc70 | 2016-12-07 21:07:11 -0800 | [diff] [blame] | 699 |     new_mapfiles+="${DST_PARTITIONS_MAP[${part}]:-}" | 
 | 700 |     old_mapfiles+="${SRC_PARTITIONS_MAP[${part}]:-}" | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 701 |   done | 
 | 702 |  | 
 | 703 |   # Target image args: | 
 | 704 |   GENERATOR_ARGS+=( | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 705 |     --partition_names="${partition_names}" | 
 | 706 |     --new_partitions="${new_partitions}" | 
 | 707 |     --new_mapfiles="${new_mapfiles}" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 708 |   ) | 
 | 709 |  | 
| Tianjie | f5baff4 | 2020-07-17 21:43:22 -0700 | [diff] [blame] | 710 |   if [[ "${FLAGS_is_partial_update}" == "true" ]]; then | 
 | 711 |     GENERATOR_ARGS+=( --is_partial_update="true" ) | 
 | 712 |     # Need at least minor version 7 for partial update, so generate with minor | 
 | 713 |     # version 7 if we don't have a source image. Let the delta_generator to fail | 
 | 714 |     # the other incompatiable minor versions. | 
 | 715 |     if [[ -z "${FORCE_MINOR_VERSION}" ]]; then | 
 | 716 |       FORCE_MINOR_VERSION="7" | 
 | 717 |     fi | 
 | 718 |   fi | 
 | 719 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 720 |   if [[ "${payload_type}" == "delta" ]]; then | 
| Alex Deymo | 168b535 | 2015-11-04 13:51:52 -0800 | [diff] [blame] | 721 |     # Source image args: | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 722 |     GENERATOR_ARGS+=( | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 723 |       --old_partitions="${old_partitions}" | 
 | 724 |       --old_mapfiles="${old_mapfiles}" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 725 |     ) | 
| Tianjie Xu | 72d512c | 2019-08-21 15:20:35 -0700 | [diff] [blame] | 726 |     if [[ -n "${FLAGS_disable_fec_computation}" ]]; then | 
 | 727 |       GENERATOR_ARGS+=( | 
 | 728 |         --disable_fec_computation="${FLAGS_disable_fec_computation}" ) | 
 | 729 |     fi | 
| Kelvin Zhang | 098e79a | 2020-11-19 17:40:56 -0500 | [diff] [blame] | 730 |     if [[ -n "${FLAGS_disable_verity_computation}" ]]; then | 
 | 731 |       GENERATOR_ARGS+=( | 
 | 732 |         --disable_verity_computation="${FLAGS_disable_verity_computation}" ) | 
 | 733 |     fi | 
| Kelvin Zhang | 0aa4fae | 2021-10-28 09:15:27 -0700 | [diff] [blame] | 734 |     if [[ -n "${FLAGS_compressor_types}" ]]; then | 
 | 735 |       GENERATOR_ARGS+=( | 
 | 736 |         --compressor_types="${FLAGS_compressor_types}" ) | 
 | 737 |     fi | 
| Kelvin Zhang | 2298798 | 2022-01-04 14:37:28 -0800 | [diff] [blame] | 738 |     if [[ -n "${FLAGS_enable_zucchini}" ]]; then | 
 | 739 |       GENERATOR_ARGS+=( | 
 | 740 |         --enable_zucchini="${FLAGS_enable_zucchini}" ) | 
 | 741 |     fi | 
| Kelvin Zhang | 907b0e6 | 2022-01-10 06:23:10 -0800 | [diff] [blame] | 742 |     if [[ -n "${FLAGS_enable_lz4diff}" ]]; then | 
 | 743 |       if [[ "${FLAGS_enable_lz4diff}" == "true" && -z "${FLAGS_liblz4_path}" ]]; then | 
 | 744 |         echo "--liblz4_path is required when enable_lz4diff is set to true." | 
 | 745 |         exit 1 | 
 | 746 |       fi | 
 | 747 |       GENERATOR_ARGS+=( | 
 | 748 |         --enable_lz4diff="${FLAGS_enable_lz4diff}" ) | 
 | 749 |     fi | 
| Kelvin Zhang | 8389dfe | 2022-01-13 12:47:11 -0800 | [diff] [blame] | 750 |     if [[ -n "${FLAGS_erofs_compression_param}" ]]; then | 
 | 751 |       GENERATOR_ARGS+=( | 
 | 752 |         --erofs_compression_param="${FLAGS_erofs_compression_param}" ) | 
 | 753 |     fi | 
| Kelvin Zhang | 413982e | 2021-03-02 15:34:50 -0500 | [diff] [blame] | 754 |   fi | 
 | 755 |  | 
| Kelvin Zhang | 02df21b | 2021-01-07 14:55:18 -0500 | [diff] [blame] | 756 |   if [[ -n "${FLAGS_enable_vabc_xor}" ]]; then | 
 | 757 |     GENERATOR_ARGS+=( | 
 | 758 |       --enable_vabc_xor="${FLAGS_enable_vabc_xor}" ) | 
 | 759 |   fi | 
 | 760 |  | 
| Kelvin Zhang | 413982e | 2021-03-02 15:34:50 -0500 | [diff] [blame] | 761 |   if [[ -n "${FLAGS_disable_vabc}" ]]; then | 
 | 762 |     GENERATOR_ARGS+=( | 
 | 763 |       --disable_vabc="${FLAGS_disable_vabc}" ) | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 764 |   fi | 
 | 765 |  | 
| Daniel Zheng | cbe8e63 | 2023-04-25 12:43:43 -0700 | [diff] [blame] | 766 |   if [[ -n "${FLAGS_max_threads}" ]]; then | 
 | 767 |     GENERATOR_ARGS+=( | 
 | 768 |       --max_threads="${FLAGS_max_threads}" ) | 
 | 769 |   fi | 
 | 770 |  | 
| Tianjie | f5baff4 | 2020-07-17 21:43:22 -0700 | [diff] [blame] | 771 |   # minor version is set only for delta or partial payload. | 
 | 772 |   if [[ -n "${FORCE_MINOR_VERSION}" ]]; then | 
 | 773 |     GENERATOR_ARGS+=( --minor_version="${FORCE_MINOR_VERSION}" ) | 
 | 774 |   fi | 
 | 775 |  | 
| Alex Deymo | 48b502a | 2015-09-17 19:00:18 -0700 | [diff] [blame] | 776 |   if [[ -n "${FORCE_MAJOR_VERSION}" ]]; then | 
 | 777 |     GENERATOR_ARGS+=( --major_version="${FORCE_MAJOR_VERSION}" ) | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 778 |   fi | 
 | 779 |  | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 780 |   if [[ -n "${FLAGS_metadata_size_file}" ]]; then | 
 | 781 |     GENERATOR_ARGS+=( --out_metadata_size_file="${FLAGS_metadata_size_file}" ) | 
 | 782 |   fi | 
 | 783 |  | 
| Sen Jiang | 8e768e9 | 2017-06-28 17:13:19 -0700 | [diff] [blame] | 784 |   if [[ -n "${FLAGS_max_timestamp}" ]]; then | 
 | 785 |     GENERATOR_ARGS+=( --max_timestamp="${FLAGS_max_timestamp}" ) | 
 | 786 |   fi | 
 | 787 |  | 
| Kelvin Zhang | cfc531f | 2022-08-24 17:58:53 +0000 | [diff] [blame] | 788 |   if [[ -n "${FLAGS_security_patch_level}" ]]; then | 
 | 789 |     GENERATOR_ARGS+=( --security_patch_level="${FLAGS_security_patch_level}" ) | 
 | 790 |   fi | 
 | 791 |  | 
| Kelvin Zhang | 1f49642 | 2020-08-11 17:18:23 -0400 | [diff] [blame] | 792 |   if [[ -n "${FLAGS_partition_timestamps}" ]]; then | 
 | 793 |     GENERATOR_ARGS+=( --partition_timestamps="${FLAGS_partition_timestamps}" ) | 
 | 794 |   fi | 
 | 795 |  | 
| Sen Jiang | 6f7b22c | 2015-11-12 15:50:39 -0800 | [diff] [blame] | 796 |   if [[ -n "${POSTINSTALL_CONFIG_FILE}" ]]; then | 
 | 797 |     GENERATOR_ARGS+=( | 
 | 798 |       --new_postinstall_config_file="${POSTINSTALL_CONFIG_FILE}" | 
 | 799 |     ) | 
 | 800 |   fi | 
 | 801 |  | 
| Yifan Hong | 398cb54 | 2018-10-18 11:29:40 -0700 | [diff] [blame] | 802 |   if [[ -n "{DYNAMIC_PARTITION_INFO_FILE}" ]]; then | 
 | 803 |     GENERATOR_ARGS+=( | 
 | 804 |       --dynamic_partition_info_file="${DYNAMIC_PARTITION_INFO_FILE}" | 
 | 805 |     ) | 
 | 806 |   fi | 
| Kelvin Zhang | deb3445 | 2021-01-21 11:54:36 -0500 | [diff] [blame] | 807 |   if [[ -n "{APEX_INFO_FILE}" ]]; then | 
 | 808 |     GENERATOR_ARGS+=( | 
 | 809 |       --apex_info_file="${APEX_INFO_FILE}" | 
 | 810 |     ) | 
 | 811 |   fi | 
| Yifan Hong | 398cb54 | 2018-10-18 11:29:40 -0700 | [diff] [blame] | 812 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 813 |   echo "Running delta_generator with args: ${GENERATOR_ARGS[@]}" | 
| Kelvin Zhang | 907b0e6 | 2022-01-10 06:23:10 -0800 | [diff] [blame] | 814 |   if [[ -n "${FLAGS_enable_lz4diff}" ]]; then | 
 | 815 |     LD_PRELOAD=${LD_PRELOAD}:${FLAGS_liblz4_path} "${GENERATOR}" "${GENERATOR_ARGS[@]}" | 
 | 816 |   else | 
 | 817 |     "${GENERATOR}" "${GENERATOR_ARGS[@]}" | 
 | 818 |   fi | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 819 |  | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 820 |   echo "Done generating ${payload_type} update." | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 821 | } | 
 | 822 |  | 
 | 823 | validate_hash() { | 
 | 824 |   [[ -n "${FLAGS_signature_size}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 825 |     die "You must specify signature size with --signature_size SIZES" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 826 |  | 
 | 827 |   [[ -n "${FLAGS_unsigned_payload}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 828 |     die "You must specify the input unsigned payload with \ | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 829 | --unsigned_payload FILENAME" | 
 | 830 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 831 |   [[ -n "${FLAGS_payload_hash_file}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 832 |     die "You must specify --payload_hash_file FILENAME" | 
| Jason Kusuma | f514c54 | 2015-11-05 18:43:45 -0800 | [diff] [blame] | 833 |  | 
 | 834 |   [[ -n "${FLAGS_metadata_hash_file}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 835 |     die "You must specify --metadata_hash_file FILENAME" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 836 | } | 
 | 837 |  | 
 | 838 | cmd_hash() { | 
| Sen Jiang | bf1266f | 2015-10-26 11:29:24 -0700 | [diff] [blame] | 839 |   "${GENERATOR}" \ | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 840 |       --in_file="${FLAGS_unsigned_payload}" \ | 
 | 841 |       --signature_size="${FLAGS_signature_size}" \ | 
 | 842 |       --out_hash_file="${FLAGS_payload_hash_file}" \ | 
 | 843 |       --out_metadata_hash_file="${FLAGS_metadata_hash_file}" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 844 |  | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 845 |   echo "Done generating hash." | 
 | 846 | } | 
 | 847 |  | 
 | 848 | validate_sign() { | 
 | 849 |   [[ -n "${FLAGS_signature_size}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 850 |     die "You must specify signature size with --signature_size SIZES" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 851 |  | 
 | 852 |   [[ -n "${FLAGS_unsigned_payload}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 853 |     die "You must specify the input unsigned payload with \ | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 854 | --unsigned_payload FILENAME" | 
 | 855 |  | 
 | 856 |   [[ -n "${FLAGS_payload}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 857 |     die "You must specify the output signed payload with --payload FILENAME" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 858 |  | 
 | 859 |   [[ -n "${FLAGS_payload_signature_file}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 860 |     die "You must specify the payload signature file with \ | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 861 | --payload_signature_file SIGNATURES" | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 862 |  | 
 | 863 |   [[ -n "${FLAGS_metadata_signature_file}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 864 |     die "You must specify the metadata signature file with \ | 
| Alex Deymo | 89ff9e3 | 2015-09-15 19:29:01 -0700 | [diff] [blame] | 865 | --metadata_signature_file SIGNATURES" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 866 | } | 
 | 867 |  | 
 | 868 | cmd_sign() { | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 869 |   GENERATOR_ARGS=( | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 870 |     --in_file="${FLAGS_unsigned_payload}" | 
 | 871 |     --signature_size="${FLAGS_signature_size}" | 
 | 872 |     --payload_signature_file="${FLAGS_payload_signature_file}" | 
 | 873 |     --metadata_signature_file="${FLAGS_metadata_signature_file}" | 
 | 874 |     --out_file="${FLAGS_payload}" | 
| Jason Kusuma | 9a4cae2 | 2015-10-08 18:17:57 -0700 | [diff] [blame] | 875 |   ) | 
 | 876 |  | 
 | 877 |   if [[ -n "${FLAGS_metadata_size_file}" ]]; then | 
 | 878 |     GENERATOR_ARGS+=( --out_metadata_size_file="${FLAGS_metadata_size_file}" ) | 
 | 879 |   fi | 
 | 880 |  | 
 | 881 |   "${GENERATOR}" "${GENERATOR_ARGS[@]}" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 882 |   echo "Done signing payload." | 
 | 883 | } | 
 | 884 |  | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 885 | validate_properties() { | 
 | 886 |   [[ -n "${FLAGS_payload}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 887 |     die "You must specify the payload file with --payload FILENAME" | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 888 |  | 
 | 889 |   [[ -n "${FLAGS_properties_file}" ]] || | 
| Sen Jiang | 53f04d7 | 2016-07-13 16:43:39 -0700 | [diff] [blame] | 890 |     die "You must specify a non empty --properties_file FILENAME" | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 891 | } | 
 | 892 |  | 
 | 893 | cmd_properties() { | 
 | 894 |   "${GENERATOR}" \ | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 895 |       --in_file="${FLAGS_payload}" \ | 
 | 896 |       --properties_file="${FLAGS_properties_file}" | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 897 | } | 
 | 898 |  | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 899 | validate_verify_and_check() { | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 900 |   [[ -n "${FLAGS_payload}" ]] || | 
 | 901 |     die "Error: you must specify an input filename with --payload FILENAME" | 
 | 902 |  | 
 | 903 |   [[ -n "${FLAGS_target_image}" ]] || | 
 | 904 |     die "Error: you must specify a target image with --target_image FILENAME" | 
 | 905 | } | 
 | 906 |  | 
 | 907 | cmd_verify() { | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 908 |   local payload_type=$(get_payload_type) | 
 | 909 |   extract_payload_images ${payload_type} | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 910 |  | 
 | 911 |   declare -A TMP_PARTITIONS | 
 | 912 |   for part in "${PARTITIONS_ORDER[@]}"; do | 
 | 913 |     local tmp_part=$(create_tempfile "tmp_part.bin.XXXXXX") | 
 | 914 |     echo "Creating temporary target partition ${tmp_part} for ${part}" | 
 | 915 |     CLEANUP_FILES+=("${tmp_part}") | 
 | 916 |     TMP_PARTITIONS[${part}]=${tmp_part} | 
 | 917 |     local FILESIZE=$(stat -c%s "${DST_PARTITIONS[${part}]}") | 
 | 918 |     echo "Truncating ${TMP_PARTITIONS[${part}]} to ${FILESIZE}" | 
 | 919 |     truncate_file "${TMP_PARTITIONS[${part}]}" "${FILESIZE}" | 
 | 920 |   done | 
 | 921 |  | 
 | 922 |   echo "Verifying ${payload_type} update." | 
 | 923 |   # Common payload args: | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 924 |   GENERATOR_ARGS=( --in_file="${FLAGS_payload}" ) | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 925 |  | 
 | 926 |   local part old_partitions="" new_partitions="" partition_names="" | 
 | 927 |   for part in "${PARTITIONS_ORDER[@]}"; do | 
 | 928 |     if [[ -n "${partition_names}" ]]; then | 
 | 929 |       partition_names+=":" | 
 | 930 |       new_partitions+=":" | 
 | 931 |       old_partitions+=":" | 
 | 932 |     fi | 
 | 933 |     partition_names+="${part}" | 
 | 934 |     new_partitions+="${TMP_PARTITIONS[${part}]}" | 
 | 935 |     old_partitions+="${SRC_PARTITIONS[${part}]:-}" | 
 | 936 |   done | 
 | 937 |  | 
 | 938 |   # Target image args: | 
 | 939 |   GENERATOR_ARGS+=( | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 940 |     --partition_names="${partition_names}" | 
 | 941 |     --new_partitions="${new_partitions}" | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 942 |   ) | 
 | 943 |  | 
 | 944 |   if [[ "${payload_type}" == "delta" ]]; then | 
 | 945 |     # Source image args: | 
 | 946 |     GENERATOR_ARGS+=( | 
| Tudor Brindus | 5ec5bd1 | 2018-07-11 11:02:44 -0700 | [diff] [blame] | 947 |       --old_partitions="${old_partitions}" | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 948 |     ) | 
 | 949 |   fi | 
 | 950 |  | 
| Amin Hassani | a566cb6 | 2017-08-23 12:36:55 -0700 | [diff] [blame] | 951 |   if [[ -n "${FORCE_MAJOR_VERSION}" ]]; then | 
 | 952 |     GENERATOR_ARGS+=( --major_version="${FORCE_MAJOR_VERSION}" ) | 
 | 953 |   fi | 
 | 954 |  | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 955 |   echo "Running delta_generator to verify ${payload_type} payload with args: \ | 
 | 956 | ${GENERATOR_ARGS[@]}" | 
| Sen Jiang | 6feb15c | 2018-08-31 15:45:17 -0700 | [diff] [blame] | 957 |   "${GENERATOR}" "${GENERATOR_ARGS[@]}" || true | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 958 |  | 
| Sen Jiang | 6feb15c | 2018-08-31 15:45:17 -0700 | [diff] [blame] | 959 |   echo "Done applying ${payload_type} update." | 
 | 960 |   echo "Checking the newly generated partitions against the target partitions" | 
 | 961 |   local need_pause=false | 
 | 962 |   for part in "${PARTITIONS_ORDER[@]}"; do | 
 | 963 |     local not_str="" | 
 | 964 |     if ! cmp "${TMP_PARTITIONS[${part}]}" "${DST_PARTITIONS[${part}]}"; then | 
 | 965 |       not_str="in" | 
 | 966 |       need_pause=true | 
 | 967 |     fi | 
 | 968 |     echo "The new partition (${part}) is ${not_str}valid." | 
 | 969 |   done | 
 | 970 |   # All images will be cleaned up when script exits, pause here to give a chance | 
 | 971 |   # to inspect the images. | 
 | 972 |   if [[ "$need_pause" == true ]]; then | 
 | 973 |     read -n1 -r -s -p "Paused to investigate invalid partitions, \ | 
 | 974 | press any key to exit." | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 975 |   fi | 
 | 976 | } | 
 | 977 |  | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 978 | cmd_check() { | 
 | 979 |   local payload_type=$(get_payload_type) | 
 | 980 |   extract_payload_images ${payload_type} | 
 | 981 |  | 
 | 982 |   local part dst_partitions="" src_partitions="" | 
 | 983 |   for part in "${PARTITIONS_ORDER[@]}"; do | 
 | 984 |     if [[ -n "${dst_partitions}" ]]; then | 
 | 985 |       dst_partitions+=" " | 
 | 986 |       src_partitions+=" " | 
 | 987 |     fi | 
 | 988 |     dst_partitions+="${DST_PARTITIONS[${part}]}" | 
 | 989 |     src_partitions+="${SRC_PARTITIONS[${part}]:-}" | 
 | 990 |   done | 
 | 991 |  | 
 | 992 |   # Common payload args: | 
 | 993 |   PAYCHECK_ARGS=( "${FLAGS_payload}" --type ${payload_type} \ | 
 | 994 |     --part_names ${PARTITIONS_ORDER[@]} \ | 
 | 995 |     --dst_part_paths ${dst_partitions} ) | 
 | 996 |  | 
 | 997 |   if [[ ! -z "${SRC_PARTITIONS[@]}" ]]; then | 
 | 998 |     PAYCHECK_ARGS+=( --src_part_paths ${src_partitions} ) | 
 | 999 |   fi | 
 | 1000 |  | 
 | 1001 |   echo "Checking ${payload_type} update." | 
 | 1002 |   check_update_payload ${PAYCHECK_ARGS[@]} --check | 
 | 1003 | } | 
 | 1004 |  | 
| Tianjie | e283ce4 | 2020-07-29 11:37:51 -0700 | [diff] [blame] | 1005 | # Check that the real generator exists: | 
| Yifan Hong | 3756c3e | 2020-07-24 20:25:51 -0700 | [diff] [blame] | 1006 | [[ -x "${GENERATOR}" ]] || GENERATOR="$(which delta_generator || true)" | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 1007 | [[ -x "${GENERATOR}" ]] || die "can't find delta_generator" | 
 | 1008 |  | 
 | 1009 | case "$COMMAND" in | 
 | 1010 |   generate) validate_generate | 
 | 1011 |             cmd_generate | 
 | 1012 |             ;; | 
 | 1013 |   hash) validate_hash | 
 | 1014 |         cmd_hash | 
 | 1015 |         ;; | 
 | 1016 |   sign) validate_sign | 
 | 1017 |         cmd_sign | 
 | 1018 |         ;; | 
| Alex Deymo | 98e691c | 2016-02-04 21:05:45 -0800 | [diff] [blame] | 1019 |   properties) validate_properties | 
 | 1020 |               cmd_properties | 
 | 1021 |               ;; | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 1022 |   verify) validate_verify_and_check | 
| Amin Hassani | 1352093 | 2017-07-26 11:26:05 -0700 | [diff] [blame] | 1023 |           cmd_verify | 
 | 1024 |           ;; | 
| Tudor Brindus | b432db8 | 2018-06-29 13:13:27 -0700 | [diff] [blame] | 1025 |   check) validate_verify_and_check | 
 | 1026 |          cmd_check | 
 | 1027 |          ;; | 
| Jason Kusuma | be998f4 | 2015-09-03 15:53:13 -0700 | [diff] [blame] | 1028 | esac |