Debt - Narrative (Details)			3 Months Ended		12 Months Ended
	Jan. 21, 2022 USD ($)	Sep. 30, 2021	Jan. 13, 2022 USD ($)	Aug. 31, 2020 USD ($)	Dec. 31, 2021 USD ($)	Dec. 31, 2020 USD ($)	Dec. 31, 2019 USD ($)	Mar. 31, 2022 USD ($)	Sep. 30, 2020	Jun. 19, 2017 USD ($)
Debt Conversion [Line Items]
Loans pledged to the FHLB					$ 1,180,493,000	$ 943,376,000
Total borrowing capacity with the FHLB					597,915,000	702,540,000
Additional borrowing availability with the FHLB					505,045,000
Amortization of issuance costs on subordinated debt					93,000	$ 45,000	$ 0
Trust preferred securities, aggregate liquidation valuation amount					419,000
Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Debt instrument, face amount					9,279,000
Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Debt instrument, face amount					4,640,000
Line of Credit | Other Financial Institutions
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity					95,000,000
Amount drawn from line of credit					$ 0
London Interbank Offered Rate (LIBOR) | Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis		3.35%
Debt effective interest rate					3.48%	3.57%
London Interbank Offered Rate (LIBOR) | Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis		2.00%
Debt effective interest rate					2.16%	2.22%
Convertible Notes Payable | Convertible Debt
Debt Conversion [Line Items]
Debt instrument, face amount					$ 20,673,000
Convertible debt, conversion ratio					0.0156717
Debt instrument, interest rate					3.29%
Debt discount on the convertible notes					$ 1,231,000	$ 1,977,000				$ 4,682,000
Amortization of debt discount					746,000	752,000	761,000
Convertible Notes Payable | Convertible Debt | Subsequent Event
Debt Conversion [Line Items]
Amortization of debt discount	$ 382,000
Repayments of convertible debt	6,750,000
Costs related to the issuance of the subordinated notes	$ 1,231,000
Subordinated Notes Due July 1, 2030 | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount				$ 40,000,000
Debt instrument, interest rate				6.00%					6.00%
Costs related to the issuance of the subordinated notes				$ 933,000	795,000
Amortization of issuance costs on subordinated debt					93,000	45,000
Subordinated Notes Due July 1, 2030 | Subordinated Debt | Secured Overnight Financing Rate (SOFR) Overnight Index Swap Rate
Debt Conversion [Line Items]
Interest rate margin on variable rate basis				5.89%
Subordinated Notes Due January 15, 2032 | Subordinated Debt | Forecast
Debt Conversion [Line Items]
Costs related to the issuance of the subordinated notes								$ 534,000
Subordinated Notes Due January 15, 2032 | Subordinated Debt | Subsequent Event
Debt Conversion [Line Items]
Debt instrument, face amount			$ 25,000,000
Debt instrument, interest rate			3.375%
Costs related to the issuance of the subordinated notes			$ 534,000
Subordinated Notes Due January 15, 2032 | Subordinated Debt | Secured Overnight Financing Rate (SOFR) Overnight Index Swap Rate | Subsequent Event
Debt Conversion [Line Items]
Interest rate margin on variable rate basis			2.03%
Subordinated Debt related to Trust Preferred Securities | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount					13,919,000
Debt discount on the convertible notes					4,293,000
Amortization of debt discount					256,000	$ 258,000	$ 261,000
Costs related to the issuance of the subordinated notes					3,109,000
Federal Reserve Bank stock | Line of Credit
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity					$ 8,485,000
Federal Reserve Bank stock | Fed Funds target rate | Line of Credit
Debt Conversion [Line Items]
Interest rate margin on variable rate basis					0.50%