Reapply "Skip the test that loads the android.hidl.memory library"

This reverts commit aabe8d365eed5766ce0ff8c768df485f036953cc.

Test: atest libhidl_test
Bug: 205764958
Bug: 310700278
Bug: 310680652
Change-Id: Icbf6c0b0407101c802a2c82c5ddf0b75612d0776
1 file changed