Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 1 | #!/usr/bin/env python |
| 2 | # |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 3 | # Copyright (C) 2022 The Android Open Source Project |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 4 | # |
| 5 | # Licensed under the Apache License, Version 2.0 (the "License"); you may not |
| 6 | # use this file except in compliance with the License. You may obtain a copy of |
| 7 | # the License at |
| 8 | # |
| 9 | # http://www.apache.org/licenses/LICENSE-2.0 |
| 10 | # |
| 11 | # Unless required by applicable law or agreed to in writing, software |
| 12 | # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT |
| 13 | # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the |
| 14 | # License for the specific language governing permissions and limitations under |
| 15 | # the License. |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 16 | # |
| 17 | """This script merges two partial target files packages. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 18 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 19 | One input package contains framework files, and the other contains vendor files. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 20 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 21 | This script produces a complete, merged target files package: |
| 22 | - This package can be used to generate a flashable IMG package. |
| 23 | See --output-img. |
| 24 | - This package can be used to generate an OTA package. See --output-ota. |
| 25 | - The merged package is checked for compatibility between the two inputs. |
| 26 | |
| 27 | Usage: merge_target_files [args] |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 28 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 29 | --framework-target-files framework-target-files-zip-archive |
| 30 | The input target files package containing framework bits. This is a zip |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 31 | archive. |
| 32 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 33 | --framework-item-list framework-item-list-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 34 | The optional path to a newline-separated config file of items that |
| 35 | are extracted as-is from the framework target files package. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 36 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 37 | --framework-misc-info-keys framework-misc-info-keys-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 38 | The optional path to a newline-separated config file of keys to |
| 39 | extract from the framework META/misc_info.txt file. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 40 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 41 | --vendor-target-files vendor-target-files-zip-archive |
| 42 | The input target files package containing vendor bits. This is a zip |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 43 | archive. |
| 44 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 45 | --vendor-item-list vendor-item-list-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 46 | The optional path to a newline-separated config file of items that |
| 47 | are extracted as-is from the vendor target files package. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 48 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 49 | --output-target-files output-target-files-package |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 50 | If provided, the output merged target files package. Also a zip archive. |
| 51 | |
| 52 | --output-dir output-directory |
| 53 | If provided, the destination directory for saving merged files. Requires |
| 54 | the --output-item-list flag. |
| 55 | Can be provided alongside --output-target-files, or by itself. |
| 56 | |
| 57 | --output-item-list output-item-list-file. |
| 58 | The optional path to a newline-separated config file that specifies the |
| 59 | file patterns to copy into the --output-dir. Required if providing |
| 60 | the --output-dir flag. |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 61 | |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 62 | --output-ota output-ota-package |
| 63 | The output ota package. This is a zip archive. Use of this flag may |
| 64 | require passing the --path common flag; see common.py. |
| 65 | |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 66 | --output-img output-img-package |
| 67 | The output img package, suitable for use with 'fastboot update'. Use of |
| 68 | this flag may require passing the --path common flag; see common.py. |
| 69 | |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 70 | --output-super-empty output-super-empty-image |
| 71 | If provided, creates a super_empty.img file from the merged target |
| 72 | files package and saves it at this path. |
| 73 | |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 74 | --rebuild_recovery |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 75 | Copy the recovery image used by non-A/B devices, used when |
| 76 | regenerating vendor images with --rebuild-sepolicy. |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 77 | |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 78 | --allow-duplicate-apkapex-keys |
| 79 | If provided, duplicate APK/APEX keys are ignored and the value from the |
| 80 | framework is used. |
| 81 | |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 82 | --rebuild-sepolicy |
| 83 | If provided, rebuilds odm.img or vendor.img to include merged sepolicy |
| 84 | files. If odm is present then odm is preferred. |
| 85 | |
| 86 | --vendor-otatools otatools.zip |
| 87 | If provided, use this otatools.zip when recompiling the odm or vendor |
| 88 | image to include sepolicy. |
| 89 | |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 90 | --keep-tmp |
| 91 | Keep tempoary files for debugging purposes. |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 92 | |
| 93 | The following only apply when using the VSDK to perform dexopt on vendor apps: |
| 94 | |
| 95 | --framework-dexpreopt-config |
| 96 | If provided, the location of framwework's dexpreopt_config.zip. |
| 97 | |
| 98 | --framework-dexpreopt-tools |
| 99 | if provided, the location of framework's dexpreopt_tools.zip. |
| 100 | |
| 101 | --vendor-dexpreopt-config |
| 102 | If provided, the location of vendor's dexpreopt_config.zip. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 103 | """ |
| 104 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 105 | import logging |
| 106 | import os |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 107 | import shutil |
Bill Peckham | 540d91a | 2019-04-25 14:18:16 -0700 | [diff] [blame] | 108 | import subprocess |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 109 | import sys |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 110 | import zipfile |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 111 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 112 | import add_img_to_target_files |
Daniel Norman | db8cacc | 2021-04-09 15:34:43 -0700 | [diff] [blame] | 113 | import build_image |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 114 | import build_super_image |
| 115 | import common |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 116 | import img_from_target_files |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 117 | import merge_compatibility_checks |
| 118 | import merge_dexopt |
| 119 | import merge_meta |
| 120 | import merge_utils |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 121 | import ota_from_target_files |
Daniel Norman | db8cacc | 2021-04-09 15:34:43 -0700 | [diff] [blame] | 122 | |
Daniel Norman | a84d13b | 2022-02-17 14:16:40 -0800 | [diff] [blame] | 123 | from common import ExternalError |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 124 | |
| 125 | logger = logging.getLogger(__name__) |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 126 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 127 | OPTIONS = common.OPTIONS |
Bill Peckham | cb84817 | 2020-04-03 12:50:47 -0700 | [diff] [blame] | 128 | # Always turn on verbose logging. |
| 129 | OPTIONS.verbose = True |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 130 | OPTIONS.framework_target_files = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 131 | OPTIONS.framework_item_list = [] |
| 132 | OPTIONS.framework_misc_info_keys = [] |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 133 | OPTIONS.vendor_target_files = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 134 | OPTIONS.vendor_item_list = [] |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 135 | OPTIONS.output_target_files = None |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 136 | OPTIONS.output_dir = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 137 | OPTIONS.output_item_list = [] |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 138 | OPTIONS.output_ota = None |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 139 | OPTIONS.output_img = None |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 140 | OPTIONS.output_super_empty = None |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 141 | OPTIONS.rebuild_recovery = False |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 142 | # TODO(b/150582573): Remove this option. |
| 143 | OPTIONS.allow_duplicate_apkapex_keys = False |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 144 | OPTIONS.vendor_otatools = None |
| 145 | OPTIONS.rebuild_sepolicy = False |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 146 | OPTIONS.keep_tmp = False |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 147 | OPTIONS.framework_dexpreopt_config = None |
| 148 | OPTIONS.framework_dexpreopt_tools = None |
| 149 | OPTIONS.vendor_dexpreopt_config = None |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 150 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 151 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 152 | def create_merged_package(temp_dir): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 153 | """Merges two target files packages into one target files structure. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 154 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 155 | Returns: |
| 156 | Path to merged package under temp directory. |
| 157 | """ |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 158 | # Extract "as is" items from the input framework and vendor partial target |
| 159 | # files packages directly into the output temporary directory, since these items |
| 160 | # do not need special case processing. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 161 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 162 | output_target_files_temp_dir = os.path.join(temp_dir, 'output') |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 163 | merge_utils.ExtractItems( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 164 | input_zip=OPTIONS.framework_target_files, |
| 165 | output_dir=output_target_files_temp_dir, |
| 166 | extract_item_list=OPTIONS.framework_item_list) |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 167 | merge_utils.ExtractItems( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 168 | input_zip=OPTIONS.vendor_target_files, |
| 169 | output_dir=output_target_files_temp_dir, |
| 170 | extract_item_list=OPTIONS.vendor_item_list) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 171 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 172 | # Perform special case processing on META/* items. |
| 173 | # After this function completes successfully, all the files we need to create |
| 174 | # the output target files package are in place. |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 175 | merge_meta.MergeMetaFiles( |
| 176 | temp_dir=temp_dir, merged_dir=output_target_files_temp_dir) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 177 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 178 | merge_dexopt.MergeDexopt( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 179 | temp_dir=temp_dir, output_target_files_dir=output_target_files_temp_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 180 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 181 | return output_target_files_temp_dir |
| 182 | |
| 183 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 184 | def generate_missing_images(target_files_dir): |
| 185 | """Generate any missing images from target files.""" |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 186 | |
| 187 | # Regenerate IMAGES in the target directory. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 188 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 189 | add_img_args = [ |
| 190 | '--verbose', |
| 191 | '--add_missing', |
| 192 | ] |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 193 | if OPTIONS.rebuild_recovery: |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 194 | add_img_args.append('--rebuild_recovery') |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 195 | add_img_args.append(target_files_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 196 | |
| 197 | add_img_to_target_files.main(add_img_args) |
| 198 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 199 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 200 | def rebuild_image_with_sepolicy(target_files_dir): |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 201 | """Rebuilds odm.img or vendor.img to include merged sepolicy files. |
| 202 | |
| 203 | If odm is present then odm is preferred -- otherwise vendor is used. |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 204 | """ |
| 205 | partition = 'vendor' |
| 206 | if os.path.exists(os.path.join(target_files_dir, 'ODM')) or os.path.exists( |
| 207 | os.path.join(target_files_dir, 'IMAGES/odm.img')): |
| 208 | partition = 'odm' |
| 209 | partition_img = '{}.img'.format(partition) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 210 | partition_map = '{}.map'.format(partition) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 211 | |
| 212 | logger.info('Recompiling %s using the merged sepolicy files.', partition_img) |
| 213 | |
| 214 | # Copy the combined SEPolicy file and framework hashes to the image that is |
| 215 | # being rebuilt. |
| 216 | def copy_selinux_file(input_path, output_filename): |
Po Hu | 0e4403e | 2021-07-06 17:05:56 +0800 | [diff] [blame] | 217 | input_filename = os.path.join(target_files_dir, input_path) |
| 218 | if not os.path.exists(input_filename): |
| 219 | input_filename = input_filename.replace('SYSTEM_EXT/', 'SYSTEM/system_ext/') \ |
| 220 | .replace('PRODUCT/', 'SYSTEM/product/') |
| 221 | if not os.path.exists(input_filename): |
| 222 | logger.info('Skipping copy_selinux_file for %s', input_filename) |
| 223 | return |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 224 | shutil.copy( |
Po Hu | 0e4403e | 2021-07-06 17:05:56 +0800 | [diff] [blame] | 225 | input_filename, |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 226 | os.path.join(target_files_dir, partition.upper(), 'etc/selinux', |
| 227 | output_filename)) |
| 228 | |
| 229 | copy_selinux_file('META/combined_sepolicy', 'precompiled_sepolicy') |
| 230 | copy_selinux_file('SYSTEM/etc/selinux/plat_sepolicy_and_mapping.sha256', |
| 231 | 'precompiled_sepolicy.plat_sepolicy_and_mapping.sha256') |
| 232 | copy_selinux_file( |
| 233 | 'SYSTEM_EXT/etc/selinux/system_ext_sepolicy_and_mapping.sha256', |
| 234 | 'precompiled_sepolicy.system_ext_sepolicy_and_mapping.sha256') |
| 235 | copy_selinux_file('PRODUCT/etc/selinux/product_sepolicy_and_mapping.sha256', |
| 236 | 'precompiled_sepolicy.product_sepolicy_and_mapping.sha256') |
| 237 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 238 | if not OPTIONS.vendor_otatools: |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 239 | # Remove the partition from the merged target-files archive. It will be |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 240 | # rebuilt later automatically by generate_missing_images(). |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 241 | os.remove(os.path.join(target_files_dir, 'IMAGES', partition_img)) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 242 | return |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 243 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 244 | # TODO(b/192253131): Remove the need for vendor_otatools by fixing |
| 245 | # backwards-compatibility issues when compiling images across releases. |
| 246 | if not OPTIONS.vendor_target_files: |
| 247 | raise ValueError( |
| 248 | 'Expected vendor_target_files if vendor_otatools is not None.') |
| 249 | logger.info( |
| 250 | '%s recompilation will be performed using the vendor otatools.zip', |
| 251 | partition_img) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 252 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 253 | # Unzip the vendor build's otatools.zip and target-files archive. |
| 254 | vendor_otatools_dir = common.MakeTempDir( |
| 255 | prefix='merge_target_files_vendor_otatools_') |
| 256 | vendor_target_files_dir = common.MakeTempDir( |
| 257 | prefix='merge_target_files_vendor_target_files_') |
| 258 | common.UnzipToDir(OPTIONS.vendor_otatools, vendor_otatools_dir) |
| 259 | common.UnzipToDir(OPTIONS.vendor_target_files, vendor_target_files_dir) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 260 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 261 | # Copy the partition contents from the merged target-files archive to the |
| 262 | # vendor target-files archive. |
| 263 | shutil.rmtree(os.path.join(vendor_target_files_dir, partition.upper())) |
| 264 | shutil.copytree( |
| 265 | os.path.join(target_files_dir, partition.upper()), |
| 266 | os.path.join(vendor_target_files_dir, partition.upper()), |
| 267 | symlinks=True) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 268 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 269 | # Delete then rebuild the partition. |
| 270 | os.remove(os.path.join(vendor_target_files_dir, 'IMAGES', partition_img)) |
| 271 | rebuild_partition_command = [ |
| 272 | os.path.join(vendor_otatools_dir, 'bin', 'add_img_to_target_files'), |
| 273 | '--verbose', |
| 274 | '--add_missing', |
| 275 | ] |
| 276 | if OPTIONS.rebuild_recovery: |
| 277 | rebuild_partition_command.append('--rebuild_recovery') |
| 278 | rebuild_partition_command.append(vendor_target_files_dir) |
| 279 | logger.info('Recompiling %s: %s', partition_img, |
| 280 | ' '.join(rebuild_partition_command)) |
| 281 | common.RunAndCheckOutput(rebuild_partition_command, verbose=True) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 282 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 283 | # Move the newly-created image to the merged target files dir. |
| 284 | if not os.path.exists(os.path.join(target_files_dir, 'IMAGES')): |
| 285 | os.makedirs(os.path.join(target_files_dir, 'IMAGES')) |
| 286 | shutil.move( |
| 287 | os.path.join(vendor_target_files_dir, 'IMAGES', partition_img), |
| 288 | os.path.join(target_files_dir, 'IMAGES', partition_img)) |
| 289 | shutil.move( |
| 290 | os.path.join(vendor_target_files_dir, 'IMAGES', partition_map), |
| 291 | os.path.join(target_files_dir, 'IMAGES', partition_map)) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 292 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 293 | def copy_recovery_file(filename): |
| 294 | for subdir in ('VENDOR', 'SYSTEM/vendor'): |
| 295 | source = os.path.join(vendor_target_files_dir, subdir, filename) |
| 296 | if os.path.exists(source): |
| 297 | dest = os.path.join(target_files_dir, subdir, filename) |
| 298 | shutil.copy(source, dest) |
| 299 | return |
| 300 | logger.info('Skipping copy_recovery_file for %s, file not found', filename) |
| 301 | |
| 302 | if OPTIONS.rebuild_recovery: |
| 303 | copy_recovery_file('etc/recovery.img') |
| 304 | copy_recovery_file('bin/install-recovery.sh') |
| 305 | copy_recovery_file('recovery-from-boot.p') |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 306 | |
| 307 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 308 | def generate_super_empty_image(target_dir, output_super_empty): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 309 | """Generates super_empty image from target package. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 310 | |
| 311 | Args: |
| 312 | target_dir: Path to the target file package which contains misc_info.txt for |
| 313 | detailed information for super image. |
| 314 | output_super_empty: If provided, copies a super_empty.img file from the |
| 315 | target files package to this path. |
| 316 | """ |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 317 | # Create super_empty.img using the merged misc_info.txt. |
| 318 | |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 319 | misc_info_txt = os.path.join(target_dir, 'META', 'misc_info.txt') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 320 | |
Kiyoung Kim | ebe7c9c | 2019-06-25 17:09:55 +0900 | [diff] [blame] | 321 | use_dynamic_partitions = common.LoadDictionaryFromFile(misc_info_txt).get( |
| 322 | 'use_dynamic_partitions') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 323 | |
| 324 | if use_dynamic_partitions != 'true' and output_super_empty: |
| 325 | raise ValueError( |
| 326 | 'Building super_empty.img requires use_dynamic_partitions=true.') |
| 327 | elif use_dynamic_partitions == 'true': |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 328 | super_empty_img = os.path.join(target_dir, 'IMAGES', 'super_empty.img') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 329 | build_super_image_args = [ |
| 330 | misc_info_txt, |
| 331 | super_empty_img, |
| 332 | ] |
| 333 | build_super_image.main(build_super_image_args) |
| 334 | |
| 335 | # Copy super_empty.img to the user-provided output_super_empty location. |
| 336 | if output_super_empty: |
| 337 | shutil.copyfile(super_empty_img, output_super_empty) |
| 338 | |
Daniel Norman | b8a2f9d | 2019-04-24 12:55:51 -0700 | [diff] [blame] | 339 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 340 | def create_target_files_archive(output_zip, source_dir, temp_dir): |
| 341 | """Creates a target_files zip archive from the input source dir. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 342 | |
| 343 | Args: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 344 | output_zip: The name of the zip archive target files package. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 345 | source_dir: The target directory contains package to be archived. |
| 346 | temp_dir: Path to temporary directory for any intermediate files. |
| 347 | """ |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 348 | output_target_files_list = os.path.join(temp_dir, 'output.list') |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 349 | output_target_files_meta_dir = os.path.join(source_dir, 'META') |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 350 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 351 | def files_from_path(target_path, extra_args=None): |
| 352 | """Gets files under the given path and return a sorted list.""" |
| 353 | find_command = ['find', target_path] + (extra_args or []) |
| 354 | find_process = common.Run( |
| 355 | find_command, stdout=subprocess.PIPE, verbose=False) |
| 356 | return common.RunAndCheckOutput(['sort'], |
| 357 | stdin=find_process.stdout, |
| 358 | verbose=False) |
| 359 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 360 | # META content appears first in the zip. This is done by the |
| 361 | # standard build system for optimized extraction of those files, |
| 362 | # so we do the same step for merged target_files.zips here too. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 363 | meta_content = files_from_path(output_target_files_meta_dir) |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 364 | other_content = files_from_path( |
| 365 | source_dir, |
| 366 | ['-path', output_target_files_meta_dir, '-prune', '-o', '-print']) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 367 | |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 368 | with open(output_target_files_list, 'w') as f: |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 369 | f.write(meta_content) |
| 370 | f.write(other_content) |
| 371 | |
| 372 | command = [ |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 373 | 'soong_zip', |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 374 | '-d', |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 375 | '-o', |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 376 | os.path.abspath(output_zip), |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 377 | '-C', |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 378 | source_dir, |
Daniel Norman | eaf5c1d | 2021-02-09 11:01:42 -0800 | [diff] [blame] | 379 | '-r', |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 380 | output_target_files_list, |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 381 | ] |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 382 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 383 | logger.info('creating %s', output_zip) |
Daniel Norman | eaf5c1d | 2021-02-09 11:01:42 -0800 | [diff] [blame] | 384 | common.RunAndCheckOutput(command, verbose=True) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 385 | logger.info('finished creating %s', output_zip) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 386 | |
| 387 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 388 | def merge_target_files(temp_dir): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 389 | """Merges two target files packages together. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 390 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 391 | This function uses framework and vendor target files packages as input, |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 392 | performs various file extractions, special case processing, and finally |
| 393 | creates a merged zip archive as output. |
| 394 | |
| 395 | Args: |
| 396 | temp_dir: The name of a directory we use when we extract items from the |
| 397 | input target files packages, and also a scratch directory that we use for |
| 398 | temporary files. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 399 | """ |
| 400 | |
| 401 | logger.info('starting: merge framework %s and vendor %s into output %s', |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 402 | OPTIONS.framework_target_files, OPTIONS.vendor_target_files, |
| 403 | OPTIONS.output_target_files) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 404 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 405 | output_target_files_temp_dir = create_merged_package(temp_dir) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 406 | |
Daniel Norman | 21c34f7 | 2020-11-11 17:25:50 -0800 | [diff] [blame] | 407 | partition_map = common.PartitionMapFromTargetFiles( |
| 408 | output_target_files_temp_dir) |
| 409 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 410 | compatibility_errors = merge_compatibility_checks.CheckCompatibility( |
| 411 | target_files_dir=output_target_files_temp_dir, |
| 412 | partition_map=partition_map) |
| 413 | if compatibility_errors: |
| 414 | for error in compatibility_errors: |
| 415 | logger.error(error) |
| 416 | raise ExternalError( |
| 417 | 'Found incompatibilities in the merged target files package.') |
Daniel Norman | d335156 | 2020-10-29 12:33:11 -0700 | [diff] [blame] | 418 | |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 419 | # Include the compiled policy in an image if requested. |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 420 | if OPTIONS.rebuild_sepolicy: |
| 421 | rebuild_image_with_sepolicy(output_target_files_temp_dir) |
Daniel Norman | 48603ff | 2021-02-22 15:15:24 -0800 | [diff] [blame] | 422 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 423 | generate_missing_images(output_target_files_temp_dir) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 424 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 425 | generate_super_empty_image(output_target_files_temp_dir, |
| 426 | OPTIONS.output_super_empty) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 427 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 428 | # Finally, create the output target files zip archive and/or copy the |
| 429 | # output items to the output target files directory. |
| 430 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 431 | if OPTIONS.output_dir: |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 432 | merge_utils.CopyItems(output_target_files_temp_dir, OPTIONS.output_dir, |
| 433 | OPTIONS.output_item_list) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 434 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 435 | if not OPTIONS.output_target_files: |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 436 | return |
| 437 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 438 | create_target_files_archive(OPTIONS.output_target_files, |
| 439 | output_target_files_temp_dir, temp_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 440 | |
Daniel Norman | 74eb74b | 2019-09-18 14:01:48 -0700 | [diff] [blame] | 441 | # Create the IMG package from the merged target files package. |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 442 | if OPTIONS.output_img: |
| 443 | img_from_target_files.main( |
| 444 | [OPTIONS.output_target_files, OPTIONS.output_img]) |
Daniel Norman | 74eb74b | 2019-09-18 14:01:48 -0700 | [diff] [blame] | 445 | |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 446 | # Create the OTA package from the merged target files package. |
| 447 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 448 | if OPTIONS.output_ota: |
| 449 | ota_from_target_files.main( |
| 450 | [OPTIONS.output_target_files, OPTIONS.output_ota]) |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 451 | |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 452 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 453 | def main(): |
| 454 | """The main function. |
| 455 | |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 456 | Process command line arguments, then call merge_target_files to |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 457 | perform the heavy lifting. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 458 | """ |
| 459 | |
| 460 | common.InitLogging() |
| 461 | |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 462 | def option_handler(o, a): |
| 463 | if o == '--system-target-files': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 464 | logger.warning( |
| 465 | '--system-target-files has been renamed to --framework-target-files') |
| 466 | OPTIONS.framework_target_files = a |
| 467 | elif o == '--framework-target-files': |
| 468 | OPTIONS.framework_target_files = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 469 | elif o == '--system-item-list': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 470 | logger.warning( |
| 471 | '--system-item-list has been renamed to --framework-item-list') |
| 472 | OPTIONS.framework_item_list = a |
| 473 | elif o == '--framework-item-list': |
| 474 | OPTIONS.framework_item_list = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 475 | elif o == '--system-misc-info-keys': |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 476 | logger.warning('--system-misc-info-keys has been renamed to ' |
| 477 | '--framework-misc-info-keys') |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 478 | OPTIONS.framework_misc_info_keys = a |
| 479 | elif o == '--framework-misc-info-keys': |
| 480 | OPTIONS.framework_misc_info_keys = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 481 | elif o == '--other-target-files': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 482 | logger.warning( |
| 483 | '--other-target-files has been renamed to --vendor-target-files') |
| 484 | OPTIONS.vendor_target_files = a |
| 485 | elif o == '--vendor-target-files': |
| 486 | OPTIONS.vendor_target_files = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 487 | elif o == '--other-item-list': |
Daniel Norman | 2d7989a | 2021-04-05 17:40:47 +0000 | [diff] [blame] | 488 | logger.warning('--other-item-list has been renamed to --vendor-item-list') |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 489 | OPTIONS.vendor_item_list = a |
| 490 | elif o == '--vendor-item-list': |
| 491 | OPTIONS.vendor_item_list = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 492 | elif o == '--output-target-files': |
| 493 | OPTIONS.output_target_files = a |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 494 | elif o == '--output-dir': |
| 495 | OPTIONS.output_dir = a |
| 496 | elif o == '--output-item-list': |
| 497 | OPTIONS.output_item_list = a |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 498 | elif o == '--output-ota': |
| 499 | OPTIONS.output_ota = a |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 500 | elif o == '--output-img': |
| 501 | OPTIONS.output_img = a |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 502 | elif o == '--output-super-empty': |
| 503 | OPTIONS.output_super_empty = a |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 504 | elif o == '--rebuild_recovery' or o == '--rebuild-recovery': |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 505 | OPTIONS.rebuild_recovery = True |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 506 | elif o == '--allow-duplicate-apkapex-keys': |
| 507 | OPTIONS.allow_duplicate_apkapex_keys = True |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 508 | elif o == '--vendor-otatools': |
| 509 | OPTIONS.vendor_otatools = a |
| 510 | elif o == '--rebuild-sepolicy': |
| 511 | OPTIONS.rebuild_sepolicy = True |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 512 | elif o == '--keep-tmp': |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 513 | OPTIONS.keep_tmp = True |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 514 | elif o == '--framework-dexpreopt-config': |
| 515 | OPTIONS.framework_dexpreopt_config = a |
| 516 | elif o == '--framework-dexpreopt-tools': |
| 517 | OPTIONS.framework_dexpreopt_tools = a |
| 518 | elif o == '--vendor-dexpreopt-config': |
| 519 | OPTIONS.vendor_dexpreopt_config = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 520 | else: |
| 521 | return False |
| 522 | return True |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 523 | |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 524 | args = common.ParseOptions( |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 525 | sys.argv[1:], |
| 526 | __doc__, |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 527 | extra_long_opts=[ |
| 528 | 'system-target-files=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 529 | 'framework-target-files=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 530 | 'system-item-list=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 531 | 'framework-item-list=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 532 | 'system-misc-info-keys=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 533 | 'framework-misc-info-keys=', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 534 | 'other-target-files=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 535 | 'vendor-target-files=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 536 | 'other-item-list=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 537 | 'vendor-item-list=', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 538 | 'output-target-files=', |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 539 | 'output-dir=', |
| 540 | 'output-item-list=', |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 541 | 'output-ota=', |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 542 | 'output-img=', |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 543 | 'output-super-empty=', |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 544 | 'framework-dexpreopt-config=', |
| 545 | 'framework-dexpreopt-tools=', |
| 546 | 'vendor-dexpreopt-config=', |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 547 | 'rebuild_recovery', |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 548 | 'rebuild-recovery', |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 549 | 'allow-duplicate-apkapex-keys', |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 550 | 'vendor-otatools=', |
| 551 | 'rebuild-sepolicy', |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 552 | 'keep-tmp', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 553 | ], |
| 554 | extra_option_handler=option_handler) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 555 | |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 556 | # pylint: disable=too-many-boolean-expressions |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 557 | if (args or OPTIONS.framework_target_files is None or |
| 558 | OPTIONS.vendor_target_files is None or |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 559 | (OPTIONS.output_target_files is None and OPTIONS.output_dir is None) or |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 560 | (OPTIONS.output_dir is not None and not OPTIONS.output_item_list) or |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 561 | (OPTIONS.rebuild_recovery and not OPTIONS.rebuild_sepolicy)): |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 562 | common.Usage(__doc__) |
Bill Peckham | 889b0c6 | 2019-02-21 18:53:37 -0800 | [diff] [blame] | 563 | sys.exit(1) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 564 | |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 565 | with zipfile.ZipFile(OPTIONS.framework_target_files, allowZip64=True) as fz: |
| 566 | framework_namelist = fz.namelist() |
| 567 | with zipfile.ZipFile(OPTIONS.vendor_target_files, allowZip64=True) as vz: |
| 568 | vendor_namelist = vz.namelist() |
| 569 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 570 | if OPTIONS.framework_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 571 | OPTIONS.framework_item_list = common.LoadListFromFile( |
| 572 | OPTIONS.framework_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 573 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 574 | OPTIONS.framework_item_list = merge_utils.InferItemList( |
| 575 | input_namelist=framework_namelist, framework=True) |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 576 | OPTIONS.framework_partition_set = merge_utils.ItemListToPartitionSet( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 577 | OPTIONS.framework_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 578 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 579 | if OPTIONS.framework_misc_info_keys: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 580 | OPTIONS.framework_misc_info_keys = common.LoadListFromFile( |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 581 | OPTIONS.framework_misc_info_keys) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 582 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 583 | OPTIONS.framework_misc_info_keys = merge_utils.InferFrameworkMiscInfoKeys( |
| 584 | input_namelist=framework_namelist) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 585 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 586 | if OPTIONS.vendor_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 587 | OPTIONS.vendor_item_list = common.LoadListFromFile(OPTIONS.vendor_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 588 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame^] | 589 | OPTIONS.vendor_item_list = merge_utils.InferItemList( |
| 590 | input_namelist=vendor_namelist, framework=False) |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 591 | OPTIONS.vendor_partition_set = merge_utils.ItemListToPartitionSet( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 592 | OPTIONS.vendor_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 593 | |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 594 | if OPTIONS.output_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 595 | OPTIONS.output_item_list = common.LoadListFromFile(OPTIONS.output_item_list) |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 596 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 597 | if not merge_utils.ValidateConfigLists(): |
Daniel Norman | e596452 | 2019-03-19 10:32:03 -0700 | [diff] [blame] | 598 | sys.exit(1) |
| 599 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 600 | temp_dir = common.MakeTempDir(prefix='merge_target_files_') |
| 601 | try: |
| 602 | merge_target_files(temp_dir) |
| 603 | finally: |
| 604 | if OPTIONS.keep_tmp: |
| 605 | logger.info('Keeping temp_dir %s', temp_dir) |
| 606 | else: |
| 607 | common.Cleanup() |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 608 | |
| 609 | |
| 610 | if __name__ == '__main__': |
Bill Peckham | 889b0c6 | 2019-02-21 18:53:37 -0800 | [diff] [blame] | 611 | main() |