This was caused by a race condition between the instance shutting down and managetests deleting its files.
Attach a file by drag & drop or click to upload