I assume that the loan was legal, in light of rule changes pertaining to non-borrowing spouses. If so, there is really no recourse other than to repay the loan. This article explains the current options / restrictions in an understandable manner, but of course it is too late to do anything about it.
If there was actually fraud or coercion in the loan, or if the elder party was mentally incompetent, there might be some legal recourse, but we don't have any evidence of fraud, coercion or incompetence here.