Commitments, Contingencies and Related Party Transactions (Guarantees Outstanding) (Details) - Loans sold or securitized with recourse - Loans Sold or Securitized with Recourse - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019
Guarantor Obligations, Maximum Potential Future Payments [Abstract]
Expire in One Year or Less	$ 370
Expire After One Year Through Three Years	825
Expire After Three Years Through Five Years	484
Expire After Five Years	24,592
Total	26,271	$ 28,470
Carrying Value	37,145	53,286
Single Family Residential with recourse
Guarantor Obligations, Maximum Potential Future Payments [Abstract]
Expire in One Year or Less	0
Expire After One Year Through Three Years	344
Expire After Three Years Through Five Years	484
Expire After Five Years	9,698
Total	10,526	12,578
Carrying Value	10,526	12,578
Multifamily Residential with recourse
Guarantor Obligations, Maximum Potential Future Payments [Abstract]
Expire in One Year or Less	370
Expire After One Year Through Three Years	481
Expire After Three Years Through Five Years	0
Expire After Five Years	14,894
Total	15,745	15,892
Carrying Value	$ 26,619	$ 40,708