Loans Held for Investment (LHFI) and Allowance for Loan Losses, LHFI (6) (Details) (USD $)	3 Months Ended
	Mar. 31, 2014 Scale Loan Factor Market	Mar. 31, 2013
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	$ 66,448,000
Provision for loan losses, LHFI	(805,000)	(2,968,000)
Balance at end of period	67,518,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Total	67,518,000
Number of loan types for commercial portfolio	9
Number of unique qualitative factors used to analyze consumer loans	5
Number of risk rate factors for commercial loans	450
Minimum score for qualitative risk factor	0
Maximum score for qualitative risk factor	100
One time additional provision due to revision of methodology	1,600,000
Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	66,448,000	78,738,000
Loans charged-off	(3,016,000)	(3,325,000)
Recoveries	4,891,000	4,455,000
Net recoveries (charge-offs)	1,875,000	1,130,000
Provision for loan losses, LHFI	(805,000)	(2,968,000)
Balance at end of period	67,518,000	76,900,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	5,541,000	11,013,000
Collectively	61,977,000	65,887,000
Total	67,518,000	76,900,000
Loans Secured by Real Estate [Member] | Construction Land Development and Other Land Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	13,165,000	21,838,000
Loans charged-off	(49,000)	(297,000)
Recoveries	2,615,000	0
Provision for loan losses, LHFI	(3,297,000)	(1,964,000)
Balance at end of period	12,434,000	19,577,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	674,000	3,514,000
Collectively	11,760,000	16,063,000
Total	12,434,000	19,577,000
Loans Secured by Real Estate [Member] | Secured by 1-4 Family Residential Properties [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	9,633,000	12,957,000
Loans charged-off	(1,282,000)	(209,000)
Recoveries	64,000	59,000
Provision for loan losses, LHFI	515,000	(1,083,000)
Balance at end of period	8,930,000	11,724,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	244,000	1,117,000
Collectively	8,686,000	10,607,000
Total	8,930,000	11,724,000
Loans Secured by Real Estate [Member] | Secured by Nonfarm, Nonresidential Properties [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	19,672,000	21,096,000
Loans charged-off	(47,000)	(168,000)
Recoveries	33,000	0
Provision for loan losses, LHFI	(859,000)	(896,000)
Balance at end of period	18,799,000	20,032,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	2,123,000	2,170,000
Collectively	16,676,000	17,862,000
Total	18,799,000	20,032,000
Loans Secured by Real Estate [Member] | Other Loans Secured by Real Estate [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	2,080,000	2,197,000
Loans charged-off	0	(910,000)
Recoveries	0	0
Provision for loan losses, LHFI	24,000	53,000
Balance at end of period	2,104,000	1,340,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	121,000	32,000
Collectively	1,983,000	1,308,000
Total	2,104,000	1,340,000
Commercial and Industrial Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	15,522,000	14,319,000
Loans charged-off	(121,000)	(40,000)
Recoveries	185,000	2,031,000
Provision for loan losses, LHFI	3,494,000	1,360,000
Balance at end of period	19,080,000	17,670,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	2,111,000	3,584,000
Collectively	16,969,000	14,086,000
Total	19,080,000	17,670,000
Consumer Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	2,405,000	3,087,000
Loans charged-off	(510,000)	(634,000)
Recoveries	1,068,000	1,451,000
Provision for loan losses, LHFI	(910,000)	(876,000)
Balance at end of period	2,053,000	3,028,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	1,000	2,000
Collectively	2,052,000	3,026,000
Total	2,053,000	3,028,000
Other Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period	3,971,000	3,244,000
Loans charged-off	(1,007,000)	(1,067,000)
Recoveries	926,000	914,000
Provision for loan losses, LHFI	228,000	438,000
Balance at end of period	4,118,000	3,529,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	267,000	594,000
Collectively	3,851,000	2,935,000
Total	$ 4,118,000	$ 3,529,000