Fair Value (Instruments) (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Carrying Value
Financial assets:
Cash and short-term investments	$ 194,626	$ 159,124
Securities available for sale	273,553	348,562
Loans held for sale	2,614	21,014
Loans held for investment	947,582	957,981
Agency accounts receivable	272	151
Accrued interest receivable	4,777	5,683
Nonmarketable equity investments	2,024	2,201
Investments in unconsolidated VIEs	2,992	3,136
Mortgage derivative assets	31	317
Financial liabilities:
Noninterest-bearing deposits	304,734	276,295
NOW, MMDA and savings deposits	724,879	755,675
Certificates of deposit	336,595	370,705
Short-term borrowings	1,994	3,720
Other borrowings	2,792	36,007
Junior subordinated debt	30,928	30,928
Agency accounts payable	1,103	612
Accrued interest payable	482	661
Mortgage derivative liabilities	46	126
Commitments to extend credit and letters of credit	(1)	(3)
Carrying Value | Interest rate swap
Financial liabilities:
Interest rate swap	(1,565)	(2,484)
Estimate of Fair Value
Financial assets:
Cash and short-term investments	194,626	159,124
Securities available for sale	273,553	348,562
Loans held for sale	2,614	21,398
Loans held for investment	845,749	860,071
Agency accounts receivable	272	151
Accrued interest receivable	4,777	5,683
Nonmarketable equity investments	2,024	2,201
Investments in unconsolidated VIEs	2,992	3,136
Mortgage derivative assets	31	317
Financial liabilities:
Noninterest-bearing deposits	304,734	276,295
NOW, MMDA and savings deposits	724,879	755,675
Certificates of deposit	341,206	377,459
Short-term borrowings	1,994	3,720
Other borrowings	2,792	37,441
Junior subordinated debt	26,428	25,795
Agency accounts payable	1,103	612
Accrued interest payable	482	661
Mortgage derivative liabilities	46	126
Commitments to extend credit and letters of credit	(328)	(346)
Estimate of Fair Value | Interest rate swap
Financial liabilities:
Interest rate swap	(1,565)	(2,484)
Estimate of Fair Value | Quoted Prices In Active Markets For Identical Assets (Level 1)
Financial assets:
Cash and short-term investments	194,626	159,124
Securities available for sale	0	0
Loans held for sale	0	0
Loans held for investment	0	0
Agency accounts receivable	272	151
Accrued interest receivable	5	7
Nonmarketable equity investments	0	0
Investments in unconsolidated VIEs	0	0
Mortgage derivative assets	0	0
Financial liabilities:
Noninterest-bearing deposits	304,734	276,295
NOW, MMDA and savings deposits	724,879	755,675
Certificates of deposit	0	0
Short-term borrowings	1,994	3,720
Other borrowings	0	0
Junior subordinated debt	0	0
Agency accounts payable	1,103	612
Accrued interest payable	34	23
Mortgage derivative liabilities	0	0
Commitments to extend credit and letters of credit	0	0
Estimate of Fair Value | Quoted Prices In Active Markets For Identical Assets (Level 1) | Interest rate swap
Financial liabilities:
Interest rate swap	0	0
Estimate of Fair Value | Significant Other Observable Inputs (Level 2)
Financial assets:
Cash and short-term investments	0	0
Securities available for sale	272,483	347,616
Loans held for sale	0	0
Loans held for investment	0	0
Agency accounts receivable	0	0
Accrued interest receivable	1,117	1,682
Nonmarketable equity investments	0	0
Investments in unconsolidated VIEs	0	0
Mortgage derivative assets	0	0
Financial liabilities:
Noninterest-bearing deposits	0	0
NOW, MMDA and savings deposits	0	0
Certificates of deposit	0	0
Short-term borrowings	0	0
Other borrowings	0	0
Junior subordinated debt	0	0
Agency accounts payable	0	0
Accrued interest payable	0	0
Mortgage derivative liabilities	0	0
Commitments to extend credit and letters of credit	0	0
Estimate of Fair Value | Significant Other Observable Inputs (Level 2) | Interest rate swap
Financial liabilities:
Interest rate swap	0	0
Estimate of Fair Value | Significant Unobservable Inputs (Level 3)
Financial assets:
Cash and short-term investments	0	0
Securities available for sale	1,070	946
Loans held for sale	2,614	21,398
Loans held for investment	845,749	860,071
Agency accounts receivable	0	0
Accrued interest receivable	3,655	3,994
Nonmarketable equity investments	2,024	2,201
Investments in unconsolidated VIEs	2,992	3,136
Mortgage derivative assets	31	317
Financial liabilities:
Noninterest-bearing deposits	0	0
NOW, MMDA and savings deposits	0	0
Certificates of deposit	341,206	377,459
Short-term borrowings	0	0
Other borrowings	2,792	37,441
Junior subordinated debt	26,428	25,795
Agency accounts payable	0	0
Accrued interest payable	448	638
Mortgage derivative liabilities	46	126
Commitments to extend credit and letters of credit	(328)	(346)
Estimate of Fair Value | Significant Unobservable Inputs (Level 3) | Interest rate swap
Financial liabilities:
Interest rate swap	$ (1,565)	$ (2,484)