Merge "Do not run edge extension benchmark if flag is off" into main