Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 1 | #!/usr/bin/env python |
| 2 | # |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 3 | # Copyright (C) 2022 The Android Open Source Project |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 4 | # |
| 5 | # Licensed under the Apache License, Version 2.0 (the "License"); you may not |
| 6 | # use this file except in compliance with the License. You may obtain a copy of |
| 7 | # the License at |
| 8 | # |
| 9 | # http://www.apache.org/licenses/LICENSE-2.0 |
| 10 | # |
| 11 | # Unless required by applicable law or agreed to in writing, software |
| 12 | # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT |
| 13 | # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the |
| 14 | # License for the specific language governing permissions and limitations under |
| 15 | # the License. |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 16 | # |
| 17 | """This script merges two partial target files packages. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 18 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 19 | One input package contains framework files, and the other contains vendor files. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 20 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 21 | This script produces a complete, merged target files package: |
| 22 | - This package can be used to generate a flashable IMG package. |
| 23 | See --output-img. |
| 24 | - This package can be used to generate an OTA package. See --output-ota. |
| 25 | - The merged package is checked for compatibility between the two inputs. |
| 26 | |
| 27 | Usage: merge_target_files [args] |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 28 | |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 29 | --framework-target-files framework-target-files-package |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 30 | The input target files package containing framework bits. This is a zip |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 31 | archive or a directory. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 32 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 33 | --framework-item-list framework-item-list-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 34 | The optional path to a newline-separated config file of items that |
| 35 | are extracted as-is from the framework target files package. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 36 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 37 | --framework-misc-info-keys framework-misc-info-keys-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 38 | The optional path to a newline-separated config file of keys to |
| 39 | extract from the framework META/misc_info.txt file. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 40 | |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 41 | --vendor-target-files vendor-target-files-package |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 42 | The input target files package containing vendor bits. This is a zip |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 43 | archive or a directory. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 44 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 45 | --vendor-item-list vendor-item-list-file |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 46 | The optional path to a newline-separated config file of items that |
| 47 | are extracted as-is from the vendor target files package. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 48 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 49 | --output-target-files output-target-files-package |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 50 | If provided, the output merged target files package. Also a zip archive. |
| 51 | |
| 52 | --output-dir output-directory |
| 53 | If provided, the destination directory for saving merged files. Requires |
| 54 | the --output-item-list flag. |
| 55 | Can be provided alongside --output-target-files, or by itself. |
| 56 | |
| 57 | --output-item-list output-item-list-file. |
| 58 | The optional path to a newline-separated config file that specifies the |
| 59 | file patterns to copy into the --output-dir. Required if providing |
| 60 | the --output-dir flag. |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 61 | |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 62 | --output-ota output-ota-package |
| 63 | The output ota package. This is a zip archive. Use of this flag may |
| 64 | require passing the --path common flag; see common.py. |
| 65 | |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 66 | --output-img output-img-package |
| 67 | The output img package, suitable for use with 'fastboot update'. Use of |
| 68 | this flag may require passing the --path common flag; see common.py. |
| 69 | |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 70 | --output-super-empty output-super-empty-image |
| 71 | If provided, creates a super_empty.img file from the merged target |
| 72 | files package and saves it at this path. |
| 73 | |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 74 | --rebuild_recovery |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 75 | Copy the recovery image used by non-A/B devices, used when |
| 76 | regenerating vendor images with --rebuild-sepolicy. |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 77 | |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 78 | --allow-duplicate-apkapex-keys |
| 79 | If provided, duplicate APK/APEX keys are ignored and the value from the |
| 80 | framework is used. |
| 81 | |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 82 | --rebuild-sepolicy |
| 83 | If provided, rebuilds odm.img or vendor.img to include merged sepolicy |
| 84 | files. If odm is present then odm is preferred. |
| 85 | |
| 86 | --vendor-otatools otatools.zip |
| 87 | If provided, use this otatools.zip when recompiling the odm or vendor |
| 88 | image to include sepolicy. |
| 89 | |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 90 | --keep-tmp |
| 91 | Keep tempoary files for debugging purposes. |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 92 | |
| 93 | The following only apply when using the VSDK to perform dexopt on vendor apps: |
| 94 | |
| 95 | --framework-dexpreopt-config |
| 96 | If provided, the location of framwework's dexpreopt_config.zip. |
| 97 | |
| 98 | --framework-dexpreopt-tools |
| 99 | if provided, the location of framework's dexpreopt_tools.zip. |
| 100 | |
| 101 | --vendor-dexpreopt-config |
| 102 | If provided, the location of vendor's dexpreopt_config.zip. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 103 | """ |
| 104 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 105 | import logging |
| 106 | import os |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 107 | import shutil |
Bill Peckham | 540d91a | 2019-04-25 14:18:16 -0700 | [diff] [blame] | 108 | import subprocess |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 109 | import sys |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 110 | import zipfile |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 111 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 112 | import add_img_to_target_files |
Daniel Norman | db8cacc | 2021-04-09 15:34:43 -0700 | [diff] [blame] | 113 | import build_image |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 114 | import build_super_image |
| 115 | import common |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 116 | import img_from_target_files |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 117 | import merge_compatibility_checks |
| 118 | import merge_dexopt |
| 119 | import merge_meta |
| 120 | import merge_utils |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 121 | import ota_from_target_files |
Daniel Norman | db8cacc | 2021-04-09 15:34:43 -0700 | [diff] [blame] | 122 | |
Daniel Norman | a84d13b | 2022-02-17 14:16:40 -0800 | [diff] [blame] | 123 | from common import ExternalError |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 124 | |
| 125 | logger = logging.getLogger(__name__) |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 126 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 127 | OPTIONS = common.OPTIONS |
Bill Peckham | cb84817 | 2020-04-03 12:50:47 -0700 | [diff] [blame] | 128 | # Always turn on verbose logging. |
| 129 | OPTIONS.verbose = True |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 130 | OPTIONS.framework_target_files = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 131 | OPTIONS.framework_item_list = [] |
| 132 | OPTIONS.framework_misc_info_keys = [] |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 133 | OPTIONS.vendor_target_files = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 134 | OPTIONS.vendor_item_list = [] |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 135 | OPTIONS.output_target_files = None |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 136 | OPTIONS.output_dir = None |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 137 | OPTIONS.output_item_list = [] |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 138 | OPTIONS.output_ota = None |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 139 | OPTIONS.output_img = None |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 140 | OPTIONS.output_super_empty = None |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 141 | OPTIONS.rebuild_recovery = False |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 142 | # TODO(b/150582573): Remove this option. |
| 143 | OPTIONS.allow_duplicate_apkapex_keys = False |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 144 | OPTIONS.vendor_otatools = None |
| 145 | OPTIONS.rebuild_sepolicy = False |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 146 | OPTIONS.keep_tmp = False |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 147 | OPTIONS.framework_dexpreopt_config = None |
| 148 | OPTIONS.framework_dexpreopt_tools = None |
| 149 | OPTIONS.vendor_dexpreopt_config = None |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 150 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 151 | |
jiangxu5 | 2bd4273 | 2022-04-11 16:02:48 +0800 | [diff] [blame] | 152 | def move_only_exists(source, destination): |
| 153 | """Judge whether the file exists and then move the file.""" |
| 154 | |
| 155 | if os.path.exists(source): |
| 156 | shutil.move(source, destination) |
| 157 | |
| 158 | |
Dennis Song | 16d6fe0 | 2023-02-23 23:37:42 +0800 | [diff] [blame] | 159 | def remove_file_if_exists(file_name): |
| 160 | """Remove the file if it exists and skip otherwise.""" |
| 161 | |
| 162 | try: |
| 163 | os.remove(file_name) |
| 164 | except FileNotFoundError: |
| 165 | pass |
| 166 | |
| 167 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 168 | def create_merged_package(temp_dir): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 169 | """Merges two target files packages into one target files structure. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 170 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 171 | Returns: |
| 172 | Path to merged package under temp directory. |
| 173 | """ |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 174 | # Extract "as is" items from the input framework and vendor partial target |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 175 | # files packages directly into the output temporary directory, since these |
| 176 | # items do not need special case processing. |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 177 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 178 | output_target_files_temp_dir = os.path.join(temp_dir, 'output') |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 179 | merge_utils.CollectTargetFiles( |
| 180 | input_zipfile_or_dir=OPTIONS.framework_target_files, |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 181 | output_dir=output_target_files_temp_dir, |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 182 | item_list=OPTIONS.framework_item_list) |
| 183 | merge_utils.CollectTargetFiles( |
| 184 | input_zipfile_or_dir=OPTIONS.vendor_target_files, |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 185 | output_dir=output_target_files_temp_dir, |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 186 | item_list=OPTIONS.vendor_item_list) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 187 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 188 | # Perform special case processing on META/* items. |
| 189 | # After this function completes successfully, all the files we need to create |
| 190 | # the output target files package are in place. |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 191 | merge_meta.MergeMetaFiles( |
| 192 | temp_dir=temp_dir, merged_dir=output_target_files_temp_dir) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 193 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 194 | merge_dexopt.MergeDexopt( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 195 | temp_dir=temp_dir, output_target_files_dir=output_target_files_temp_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 196 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 197 | return output_target_files_temp_dir |
| 198 | |
| 199 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 200 | def generate_missing_images(target_files_dir): |
| 201 | """Generate any missing images from target files.""" |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 202 | |
| 203 | # Regenerate IMAGES in the target directory. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 204 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 205 | add_img_args = [ |
| 206 | '--verbose', |
| 207 | '--add_missing', |
| 208 | ] |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 209 | if OPTIONS.rebuild_recovery: |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 210 | add_img_args.append('--rebuild_recovery') |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 211 | add_img_args.append(target_files_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 212 | |
| 213 | add_img_to_target_files.main(add_img_args) |
| 214 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 215 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 216 | def rebuild_image_with_sepolicy(target_files_dir): |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 217 | """Rebuilds odm.img or vendor.img to include merged sepolicy files. |
| 218 | |
| 219 | If odm is present then odm is preferred -- otherwise vendor is used. |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 220 | """ |
| 221 | partition = 'vendor' |
Dennis Song | 16d6fe0 | 2023-02-23 23:37:42 +0800 | [diff] [blame] | 222 | if os.path.exists(os.path.join(target_files_dir, 'ODM')): |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 223 | partition = 'odm' |
| 224 | partition_img = '{}.img'.format(partition) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 225 | partition_map = '{}.map'.format(partition) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 226 | |
| 227 | logger.info('Recompiling %s using the merged sepolicy files.', partition_img) |
| 228 | |
| 229 | # Copy the combined SEPolicy file and framework hashes to the image that is |
| 230 | # being rebuilt. |
| 231 | def copy_selinux_file(input_path, output_filename): |
Po Hu | 0e4403e | 2021-07-06 17:05:56 +0800 | [diff] [blame] | 232 | input_filename = os.path.join(target_files_dir, input_path) |
| 233 | if not os.path.exists(input_filename): |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 234 | input_filename = input_filename.replace('SYSTEM_EXT/', |
| 235 | 'SYSTEM/system_ext/') \ |
Po Hu | 0e4403e | 2021-07-06 17:05:56 +0800 | [diff] [blame] | 236 | .replace('PRODUCT/', 'SYSTEM/product/') |
| 237 | if not os.path.exists(input_filename): |
| 238 | logger.info('Skipping copy_selinux_file for %s', input_filename) |
| 239 | return |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 240 | shutil.copy( |
Po Hu | 0e4403e | 2021-07-06 17:05:56 +0800 | [diff] [blame] | 241 | input_filename, |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 242 | os.path.join(target_files_dir, partition.upper(), 'etc/selinux', |
| 243 | output_filename)) |
| 244 | |
| 245 | copy_selinux_file('META/combined_sepolicy', 'precompiled_sepolicy') |
| 246 | copy_selinux_file('SYSTEM/etc/selinux/plat_sepolicy_and_mapping.sha256', |
| 247 | 'precompiled_sepolicy.plat_sepolicy_and_mapping.sha256') |
| 248 | copy_selinux_file( |
| 249 | 'SYSTEM_EXT/etc/selinux/system_ext_sepolicy_and_mapping.sha256', |
| 250 | 'precompiled_sepolicy.system_ext_sepolicy_and_mapping.sha256') |
| 251 | copy_selinux_file('PRODUCT/etc/selinux/product_sepolicy_and_mapping.sha256', |
| 252 | 'precompiled_sepolicy.product_sepolicy_and_mapping.sha256') |
| 253 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 254 | if not OPTIONS.vendor_otatools: |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 255 | # Remove the partition from the merged target-files archive. It will be |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 256 | # rebuilt later automatically by generate_missing_images(). |
Dennis Song | 16d6fe0 | 2023-02-23 23:37:42 +0800 | [diff] [blame] | 257 | remove_file_if_exists( |
| 258 | os.path.join(target_files_dir, 'IMAGES', partition_img)) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 259 | return |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 260 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 261 | # TODO(b/192253131): Remove the need for vendor_otatools by fixing |
| 262 | # backwards-compatibility issues when compiling images across releases. |
| 263 | if not OPTIONS.vendor_target_files: |
| 264 | raise ValueError( |
| 265 | 'Expected vendor_target_files if vendor_otatools is not None.') |
| 266 | logger.info( |
| 267 | '%s recompilation will be performed using the vendor otatools.zip', |
| 268 | partition_img) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 269 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 270 | # Unzip the vendor build's otatools.zip and target-files archive. |
| 271 | vendor_otatools_dir = common.MakeTempDir( |
| 272 | prefix='merge_target_files_vendor_otatools_') |
| 273 | vendor_target_files_dir = common.MakeTempDir( |
| 274 | prefix='merge_target_files_vendor_target_files_') |
| 275 | common.UnzipToDir(OPTIONS.vendor_otatools, vendor_otatools_dir) |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 276 | merge_utils.CollectTargetFiles( |
| 277 | input_zipfile_or_dir=OPTIONS.vendor_target_files, |
| 278 | output_dir=vendor_target_files_dir, |
| 279 | item_list=OPTIONS.vendor_item_list) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 280 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 281 | # Copy the partition contents from the merged target-files archive to the |
| 282 | # vendor target-files archive. |
| 283 | shutil.rmtree(os.path.join(vendor_target_files_dir, partition.upper())) |
| 284 | shutil.copytree( |
| 285 | os.path.join(target_files_dir, partition.upper()), |
| 286 | os.path.join(vendor_target_files_dir, partition.upper()), |
| 287 | symlinks=True) |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 288 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 289 | # Delete then rebuild the partition. |
Dennis Song | 16d6fe0 | 2023-02-23 23:37:42 +0800 | [diff] [blame] | 290 | remove_file_if_exists( |
| 291 | os.path.join(vendor_target_files_dir, 'IMAGES', partition_img)) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 292 | rebuild_partition_command = [ |
| 293 | os.path.join(vendor_otatools_dir, 'bin', 'add_img_to_target_files'), |
| 294 | '--verbose', |
| 295 | '--add_missing', |
| 296 | ] |
| 297 | if OPTIONS.rebuild_recovery: |
| 298 | rebuild_partition_command.append('--rebuild_recovery') |
| 299 | rebuild_partition_command.append(vendor_target_files_dir) |
| 300 | logger.info('Recompiling %s: %s', partition_img, |
| 301 | ' '.join(rebuild_partition_command)) |
| 302 | common.RunAndCheckOutput(rebuild_partition_command, verbose=True) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 303 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 304 | # Move the newly-created image to the merged target files dir. |
| 305 | if not os.path.exists(os.path.join(target_files_dir, 'IMAGES')): |
| 306 | os.makedirs(os.path.join(target_files_dir, 'IMAGES')) |
| 307 | shutil.move( |
| 308 | os.path.join(vendor_target_files_dir, 'IMAGES', partition_img), |
| 309 | os.path.join(target_files_dir, 'IMAGES', partition_img)) |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 310 | move_only_exists( |
| 311 | os.path.join(vendor_target_files_dir, 'IMAGES', partition_map), |
| 312 | os.path.join(target_files_dir, 'IMAGES', partition_map)) |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 313 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 314 | def copy_recovery_file(filename): |
| 315 | for subdir in ('VENDOR', 'SYSTEM/vendor'): |
| 316 | source = os.path.join(vendor_target_files_dir, subdir, filename) |
| 317 | if os.path.exists(source): |
| 318 | dest = os.path.join(target_files_dir, subdir, filename) |
| 319 | shutil.copy(source, dest) |
| 320 | return |
| 321 | logger.info('Skipping copy_recovery_file for %s, file not found', filename) |
| 322 | |
| 323 | if OPTIONS.rebuild_recovery: |
| 324 | copy_recovery_file('etc/recovery.img') |
| 325 | copy_recovery_file('bin/install-recovery.sh') |
| 326 | copy_recovery_file('recovery-from-boot.p') |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 327 | |
| 328 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 329 | def generate_super_empty_image(target_dir, output_super_empty): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 330 | """Generates super_empty image from target package. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 331 | |
| 332 | Args: |
| 333 | target_dir: Path to the target file package which contains misc_info.txt for |
| 334 | detailed information for super image. |
| 335 | output_super_empty: If provided, copies a super_empty.img file from the |
| 336 | target files package to this path. |
| 337 | """ |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 338 | # Create super_empty.img using the merged misc_info.txt. |
| 339 | |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 340 | misc_info_txt = os.path.join(target_dir, 'META', 'misc_info.txt') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 341 | |
Kiyoung Kim | ebe7c9c | 2019-06-25 17:09:55 +0900 | [diff] [blame] | 342 | use_dynamic_partitions = common.LoadDictionaryFromFile(misc_info_txt).get( |
| 343 | 'use_dynamic_partitions') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 344 | |
| 345 | if use_dynamic_partitions != 'true' and output_super_empty: |
| 346 | raise ValueError( |
| 347 | 'Building super_empty.img requires use_dynamic_partitions=true.') |
| 348 | elif use_dynamic_partitions == 'true': |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 349 | super_empty_img = os.path.join(target_dir, 'IMAGES', 'super_empty.img') |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 350 | build_super_image_args = [ |
| 351 | misc_info_txt, |
| 352 | super_empty_img, |
| 353 | ] |
| 354 | build_super_image.main(build_super_image_args) |
| 355 | |
| 356 | # Copy super_empty.img to the user-provided output_super_empty location. |
| 357 | if output_super_empty: |
| 358 | shutil.copyfile(super_empty_img, output_super_empty) |
| 359 | |
Daniel Norman | b8a2f9d | 2019-04-24 12:55:51 -0700 | [diff] [blame] | 360 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 361 | def create_target_files_archive(output_zip, source_dir, temp_dir): |
| 362 | """Creates a target_files zip archive from the input source dir. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 363 | |
| 364 | Args: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 365 | output_zip: The name of the zip archive target files package. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 366 | source_dir: The target directory contains package to be archived. |
| 367 | temp_dir: Path to temporary directory for any intermediate files. |
| 368 | """ |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 369 | output_target_files_list = os.path.join(temp_dir, 'output.list') |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 370 | output_target_files_meta_dir = os.path.join(source_dir, 'META') |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 371 | |
Daniel Norman | dbbf5a3 | 2020-10-22 16:03:32 -0700 | [diff] [blame] | 372 | def files_from_path(target_path, extra_args=None): |
| 373 | """Gets files under the given path and return a sorted list.""" |
| 374 | find_command = ['find', target_path] + (extra_args or []) |
| 375 | find_process = common.Run( |
| 376 | find_command, stdout=subprocess.PIPE, verbose=False) |
| 377 | return common.RunAndCheckOutput(['sort'], |
| 378 | stdin=find_process.stdout, |
| 379 | verbose=False) |
| 380 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 381 | # META content appears first in the zip. This is done by the |
| 382 | # standard build system for optimized extraction of those files, |
| 383 | # so we do the same step for merged target_files.zips here too. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 384 | meta_content = files_from_path(output_target_files_meta_dir) |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 385 | other_content = files_from_path( |
| 386 | source_dir, |
| 387 | ['-path', output_target_files_meta_dir, '-prune', '-o', '-print']) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 388 | |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 389 | with open(output_target_files_list, 'w') as f: |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 390 | f.write(meta_content) |
| 391 | f.write(other_content) |
| 392 | |
| 393 | command = [ |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 394 | 'soong_zip', |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 395 | '-d', |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 396 | '-o', |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 397 | os.path.abspath(output_zip), |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 398 | '-C', |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 399 | source_dir, |
Daniel Norman | eaf5c1d | 2021-02-09 11:01:42 -0800 | [diff] [blame] | 400 | '-r', |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 401 | output_target_files_list, |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 402 | ] |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 403 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 404 | logger.info('creating %s', output_zip) |
Daniel Norman | eaf5c1d | 2021-02-09 11:01:42 -0800 | [diff] [blame] | 405 | common.RunAndCheckOutput(command, verbose=True) |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 406 | logger.info('finished creating %s', output_zip) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 407 | |
| 408 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 409 | def merge_target_files(temp_dir): |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 410 | """Merges two target files packages together. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 411 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 412 | This function uses framework and vendor target files packages as input, |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 413 | performs various file extractions, special case processing, and finally |
| 414 | creates a merged zip archive as output. |
| 415 | |
| 416 | Args: |
| 417 | temp_dir: The name of a directory we use when we extract items from the |
| 418 | input target files packages, and also a scratch directory that we use for |
| 419 | temporary files. |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 420 | """ |
| 421 | |
| 422 | logger.info('starting: merge framework %s and vendor %s into output %s', |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 423 | OPTIONS.framework_target_files, OPTIONS.vendor_target_files, |
| 424 | OPTIONS.output_target_files) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 425 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 426 | output_target_files_temp_dir = create_merged_package(temp_dir) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 427 | |
Daniel Norman | 21c34f7 | 2020-11-11 17:25:50 -0800 | [diff] [blame] | 428 | partition_map = common.PartitionMapFromTargetFiles( |
| 429 | output_target_files_temp_dir) |
| 430 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 431 | compatibility_errors = merge_compatibility_checks.CheckCompatibility( |
| 432 | target_files_dir=output_target_files_temp_dir, |
| 433 | partition_map=partition_map) |
| 434 | if compatibility_errors: |
| 435 | for error in compatibility_errors: |
| 436 | logger.error(error) |
| 437 | raise ExternalError( |
| 438 | 'Found incompatibilities in the merged target files package.') |
Daniel Norman | d335156 | 2020-10-29 12:33:11 -0700 | [diff] [blame] | 439 | |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 440 | # Include the compiled policy in an image if requested. |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 441 | if OPTIONS.rebuild_sepolicy: |
| 442 | rebuild_image_with_sepolicy(output_target_files_temp_dir) |
Daniel Norman | 48603ff | 2021-02-22 15:15:24 -0800 | [diff] [blame] | 443 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 444 | generate_missing_images(output_target_files_temp_dir) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 445 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 446 | generate_super_empty_image(output_target_files_temp_dir, |
| 447 | OPTIONS.output_super_empty) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 448 | |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 449 | # Finally, create the output target files zip archive and/or copy the |
| 450 | # output items to the output target files directory. |
| 451 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 452 | if OPTIONS.output_dir: |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 453 | merge_utils.CopyItems(output_target_files_temp_dir, OPTIONS.output_dir, |
| 454 | OPTIONS.output_item_list) |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 455 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 456 | if not OPTIONS.output_target_files: |
Kiyoung Kim | 7cbeda7 | 2019-06-28 13:26:04 +0900 | [diff] [blame] | 457 | return |
| 458 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 459 | create_target_files_archive(OPTIONS.output_target_files, |
| 460 | output_target_files_temp_dir, temp_dir) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 461 | |
Daniel Norman | 74eb74b | 2019-09-18 14:01:48 -0700 | [diff] [blame] | 462 | # Create the IMG package from the merged target files package. |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 463 | if OPTIONS.output_img: |
| 464 | img_from_target_files.main( |
| 465 | [OPTIONS.output_target_files, OPTIONS.output_img]) |
Daniel Norman | 74eb74b | 2019-09-18 14:01:48 -0700 | [diff] [blame] | 466 | |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 467 | # Create the OTA package from the merged target files package. |
| 468 | |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 469 | if OPTIONS.output_ota: |
| 470 | ota_from_target_files.main( |
| 471 | [OPTIONS.output_target_files, OPTIONS.output_ota]) |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 472 | |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 473 | |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 474 | def main(): |
| 475 | """The main function. |
| 476 | |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 477 | Process command line arguments, then call merge_target_files to |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 478 | perform the heavy lifting. |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 479 | """ |
| 480 | |
| 481 | common.InitLogging() |
| 482 | |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 483 | def option_handler(o, a): |
| 484 | if o == '--system-target-files': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 485 | logger.warning( |
| 486 | '--system-target-files has been renamed to --framework-target-files') |
| 487 | OPTIONS.framework_target_files = a |
| 488 | elif o == '--framework-target-files': |
| 489 | OPTIONS.framework_target_files = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 490 | elif o == '--system-item-list': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 491 | logger.warning( |
| 492 | '--system-item-list has been renamed to --framework-item-list') |
| 493 | OPTIONS.framework_item_list = a |
| 494 | elif o == '--framework-item-list': |
| 495 | OPTIONS.framework_item_list = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 496 | elif o == '--system-misc-info-keys': |
Daniel Norman | 4cc9df6 | 2019-07-18 10:11:07 -0700 | [diff] [blame] | 497 | logger.warning('--system-misc-info-keys has been renamed to ' |
| 498 | '--framework-misc-info-keys') |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 499 | OPTIONS.framework_misc_info_keys = a |
| 500 | elif o == '--framework-misc-info-keys': |
| 501 | OPTIONS.framework_misc_info_keys = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 502 | elif o == '--other-target-files': |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 503 | logger.warning( |
| 504 | '--other-target-files has been renamed to --vendor-target-files') |
| 505 | OPTIONS.vendor_target_files = a |
| 506 | elif o == '--vendor-target-files': |
| 507 | OPTIONS.vendor_target_files = a |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 508 | elif o == '--other-item-list': |
Daniel Norman | 2d7989a | 2021-04-05 17:40:47 +0000 | [diff] [blame] | 509 | logger.warning('--other-item-list has been renamed to --vendor-item-list') |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 510 | OPTIONS.vendor_item_list = a |
| 511 | elif o == '--vendor-item-list': |
| 512 | OPTIONS.vendor_item_list = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 513 | elif o == '--output-target-files': |
| 514 | OPTIONS.output_target_files = a |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 515 | elif o == '--output-dir': |
| 516 | OPTIONS.output_dir = a |
| 517 | elif o == '--output-item-list': |
| 518 | OPTIONS.output_item_list = a |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 519 | elif o == '--output-ota': |
| 520 | OPTIONS.output_ota = a |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 521 | elif o == '--output-img': |
| 522 | OPTIONS.output_img = a |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 523 | elif o == '--output-super-empty': |
| 524 | OPTIONS.output_super_empty = a |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 525 | elif o == '--rebuild_recovery' or o == '--rebuild-recovery': |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 526 | OPTIONS.rebuild_recovery = True |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 527 | elif o == '--allow-duplicate-apkapex-keys': |
| 528 | OPTIONS.allow_duplicate_apkapex_keys = True |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 529 | elif o == '--vendor-otatools': |
| 530 | OPTIONS.vendor_otatools = a |
| 531 | elif o == '--rebuild-sepolicy': |
| 532 | OPTIONS.rebuild_sepolicy = True |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 533 | elif o == '--keep-tmp': |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 534 | OPTIONS.keep_tmp = True |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 535 | elif o == '--framework-dexpreopt-config': |
| 536 | OPTIONS.framework_dexpreopt_config = a |
| 537 | elif o == '--framework-dexpreopt-tools': |
| 538 | OPTIONS.framework_dexpreopt_tools = a |
| 539 | elif o == '--vendor-dexpreopt-config': |
| 540 | OPTIONS.vendor_dexpreopt_config = a |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 541 | else: |
| 542 | return False |
| 543 | return True |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 544 | |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 545 | args = common.ParseOptions( |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 546 | sys.argv[1:], |
| 547 | __doc__, |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 548 | extra_long_opts=[ |
| 549 | 'system-target-files=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 550 | 'framework-target-files=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 551 | 'system-item-list=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 552 | 'framework-item-list=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 553 | 'system-misc-info-keys=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 554 | 'framework-misc-info-keys=', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 555 | 'other-target-files=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 556 | 'vendor-target-files=', |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 557 | 'other-item-list=', |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 558 | 'vendor-item-list=', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 559 | 'output-target-files=', |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 560 | 'output-dir=', |
| 561 | 'output-item-list=', |
Daniel Norman | 3b64ce1 | 2019-04-16 16:11:35 -0700 | [diff] [blame] | 562 | 'output-ota=', |
Daniel Norman | 1bd2a1d | 2019-04-18 12:32:18 -0700 | [diff] [blame] | 563 | 'output-img=', |
Daniel Norman | f031825 | 2019-04-15 11:34:56 -0700 | [diff] [blame] | 564 | 'output-super-empty=', |
Jose Galmes | 9c8f6eb | 2021-07-21 09:34:08 -0700 | [diff] [blame] | 565 | 'framework-dexpreopt-config=', |
| 566 | 'framework-dexpreopt-tools=', |
| 567 | 'vendor-dexpreopt-config=', |
Daniel Norman | a4911da | 2019-03-15 14:36:21 -0700 | [diff] [blame] | 568 | 'rebuild_recovery', |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 569 | 'rebuild-recovery', |
Daniel Norman | b0c7591 | 2020-09-24 14:30:21 -0700 | [diff] [blame] | 570 | 'allow-duplicate-apkapex-keys', |
Daniel Norman | 571e182 | 2021-06-25 17:18:25 -0700 | [diff] [blame] | 571 | 'vendor-otatools=', |
| 572 | 'rebuild-sepolicy', |
Bill Peckham | 364c1cc | 2019-03-29 18:27:23 -0700 | [diff] [blame] | 573 | 'keep-tmp', |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 574 | ], |
| 575 | extra_option_handler=option_handler) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 576 | |
Tao Bao | 2ad4b82 | 2019-06-27 16:52:12 -0700 | [diff] [blame] | 577 | # pylint: disable=too-many-boolean-expressions |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 578 | if (args or OPTIONS.framework_target_files is None or |
| 579 | OPTIONS.vendor_target_files is None or |
Daniel Norman | e5b134a | 2019-04-17 14:54:06 -0700 | [diff] [blame] | 580 | (OPTIONS.output_target_files is None and OPTIONS.output_dir is None) or |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 581 | (OPTIONS.output_dir is not None and not OPTIONS.output_item_list) or |
Po Hu | a6c5912 | 2022-02-16 08:41:29 +0000 | [diff] [blame] | 582 | (OPTIONS.rebuild_recovery and not OPTIONS.rebuild_sepolicy)): |
Bill Peckham | f753e15 | 2019-02-19 18:02:46 -0800 | [diff] [blame] | 583 | common.Usage(__doc__) |
Bill Peckham | 889b0c6 | 2019-02-21 18:53:37 -0800 | [diff] [blame] | 584 | sys.exit(1) |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 585 | |
Dennis Song | 5bfa43e | 2023-03-30 18:28:00 +0800 | [diff] [blame^] | 586 | framework_namelist = merge_utils.GetTargetFilesItems( |
| 587 | OPTIONS.framework_target_files) |
| 588 | vendor_namelist = merge_utils.GetTargetFilesItems( |
| 589 | OPTIONS.vendor_target_files) |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 590 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 591 | if OPTIONS.framework_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 592 | OPTIONS.framework_item_list = common.LoadListFromFile( |
| 593 | OPTIONS.framework_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 594 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 595 | OPTIONS.framework_item_list = merge_utils.InferItemList( |
| 596 | input_namelist=framework_namelist, framework=True) |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 597 | OPTIONS.framework_partition_set = merge_utils.ItemListToPartitionSet( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 598 | OPTIONS.framework_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 599 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 600 | if OPTIONS.framework_misc_info_keys: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 601 | OPTIONS.framework_misc_info_keys = common.LoadListFromFile( |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 602 | OPTIONS.framework_misc_info_keys) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 603 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 604 | OPTIONS.framework_misc_info_keys = merge_utils.InferFrameworkMiscInfoKeys( |
| 605 | input_namelist=framework_namelist) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 606 | |
Daniel Norman | d5d70ea | 2019-06-05 15:13:43 -0700 | [diff] [blame] | 607 | if OPTIONS.vendor_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 608 | OPTIONS.vendor_item_list = common.LoadListFromFile(OPTIONS.vendor_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 609 | else: |
Daniel Norman | 5f47677 | 2022-03-02 15:46:34 -0800 | [diff] [blame] | 610 | OPTIONS.vendor_item_list = merge_utils.InferItemList( |
| 611 | input_namelist=vendor_namelist, framework=False) |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 612 | OPTIONS.vendor_partition_set = merge_utils.ItemListToPartitionSet( |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 613 | OPTIONS.vendor_item_list) |
Daniel Norman | 2c99c5b | 2019-03-07 13:01:48 -0800 | [diff] [blame] | 614 | |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 615 | if OPTIONS.output_item_list: |
Daniel Norman | 0374741 | 2022-02-25 10:38:37 -0800 | [diff] [blame] | 616 | OPTIONS.output_item_list = common.LoadListFromFile(OPTIONS.output_item_list) |
Daniel Norman | fdb3881 | 2019-04-15 09:47:24 -0700 | [diff] [blame] | 617 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 618 | if not merge_utils.ValidateConfigLists(): |
Daniel Norman | e596452 | 2019-03-19 10:32:03 -0700 | [diff] [blame] | 619 | sys.exit(1) |
| 620 | |
Daniel Norman | 2465fc8 | 2022-03-02 12:01:20 -0800 | [diff] [blame] | 621 | temp_dir = common.MakeTempDir(prefix='merge_target_files_') |
| 622 | try: |
| 623 | merge_target_files(temp_dir) |
| 624 | finally: |
| 625 | if OPTIONS.keep_tmp: |
| 626 | logger.info('Keeping temp_dir %s', temp_dir) |
| 627 | else: |
| 628 | common.Cleanup() |
Bill Peckham | e9eb5f9 | 2019-02-01 15:52:10 -0800 | [diff] [blame] | 629 | |
| 630 | |
| 631 | if __name__ == '__main__': |
Bill Peckham | 889b0c6 | 2019-02-21 18:53:37 -0800 | [diff] [blame] | 632 | main() |