A predator Catholic brother and former school principal convicted of the vile historical sexual assault of a student will be returned to prison after his appeal attempt fell apart.