investigate failure to delete dirs in orchestrator failure tests

[alexghr]

Sometimes in CI we're seeing the orchestrator failure test fail to delete a tmp working dir. It might be that tmp dirs are being reused.