hard tasks
  arm        n  all_hidden    false_done    own_tests     ran_holdout 
  none      24  21/24  88%    3/24  12%     1/24   4%     0/24   0%     hidden 319/324
  full      24  22/24  92%    2/24   8%     1/24   4%     0/24   0%     hidden 321/324
