Debt - Narrative (Details)		3 Months Ended
	Jan. 13, 2022 USD ($)	Mar. 31, 2023 USD ($)	Mar. 31, 2022 USD ($)	Aug. 31, 2020 USD ($)	Dec. 31, 2022 USD ($)
Debt Conversion [Line Items]
Loans pledged to the FHLB		$ 1,677,445,000			$ 1,630,939,000
Total borrowing capacity with the FHLB		1,203,388,000			1,139,356,000
Additional borrowing availability with the FHLB		480,369,000
Trust preferred securities, aggregate liquidation valuation amount		419,000
Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Debt instrument, face amount		9,279,000
Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Debt instrument, face amount		4,640,000
Convertible Notes Payable | Convertible Debt
Debt Conversion [Line Items]
Debt instrument, face amount		$ 5,456,000
Debt instrument, interest rate		3.29%
Convertible debt, conversion ratio		0.0156717
Debt discount on the convertible notes		$ 63,000			$ 101,000
Amortization of debt discount		38,000	$ 526,000
Subordinated Notes Due July 1, 2030 | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount				$ 40,000,000
Debt instrument, interest rate				6.00%
Debt redemption period from issuance date				5 years
Costs related to the issuance of the subordinated notes				$ 933,000
Subordinated Notes Due January 15, 2032 | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount	$ 25,000,000
Debt instrument, interest rate	3.375%
Costs related to the issuance of the subordinated notes			$ 534,000
Subordinated Debt related to Trust Preferred Securities | Subordinated Debt
Debt Conversion [Line Items]
Debt instrument, face amount		13,919,000
Debt discount on the convertible notes		$ 4,293,000
Secured Overnight Financing Rate (SOFR) Overnight Index Swap Rate | Subordinated Notes Due July 1, 2030 | Subordinated Debt
Debt Conversion [Line Items]
Interest rate margin on variable rate basis				5.89%
Secured Overnight Financing Rate (SOFR) Overnight Index Swap Rate | Subordinated Notes Due January 15, 2032 | Subordinated Debt
Debt Conversion [Line Items]
Interest rate margin on variable rate basis	2.03%
London Interbank Offered Rate (LIBOR) | Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust I (NMBCT I)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis		3.35%
Rate		8.08%	3.57%
London Interbank Offered Rate (LIBOR) | Trust Preferred Securities Subject to Mandatory Redemption | New Mexico Banquest Capital Trust II (NMBCT II)
Debt Conversion [Line Items]
Interest rate margin on variable rate basis		2.00%
Rate		6.92%	2.48%
Line of Credit | Other Financial Institutions
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity		$ 330,000,000
Amount drawn from line of credit		0
Line of Credit | Federal Reserve Bank stock
Debt Conversion [Line Items]
Line of credit facility, maximum borrowing capacity		$ 5,989,000
Line of Credit | Federal Reserve Bank stock | Fed Funds target rate
Debt Conversion [Line Items]
Interest rate margin on variable rate basis		0.50%