Loans Held for Investment (LHFI) and Allowance for Loan Losses, LHFI (6) (Details) (USD $)	3 Months Ended		6 Months Ended		12 Months Ended
	Jun. 30, 2014 Loan Factor Market	Jun. 30, 2013	Jun. 30, 2014 Scale Loan Factor Market	Jun. 30, 2013	Dec. 31, 2013
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			$ 66,448,000
Provision for loan losses, LHFI	351,000	(4,846,000)	(454,000)	(7,814,000)
Balance at end of period	66,648,000		66,648,000		66,448,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Total	66,648,000		66,648,000		66,448,000
Number of loan types for commercial portfolio	9		9
Number of unique qualitative factors used to analyze consumer loans	5		5
Number of risk rate factors for commercial loans	450		450
Minimum score for qualitative risk factor			0
Maximum score for qualitative risk factor			100
Additional provision due to revision of methodology	1,400,000		1,400,000		1,600,000
Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			66,448,000	78,738,000	78,738,000
Loans charged-off			(6,836,000)	(6,356,000)
Recoveries			7,490,000	8,257,000
Net recoveries (charge-offs)			654,000	1,901,000
Provision for loan losses, LHFI			(454,000)	(7,814,000)
Balance at end of period	66,648,000	72,825,000	66,648,000	72,825,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	6,041,000	10,690,000	6,041,000	10,690,000
Collectively	60,607,000	62,135,000	60,607,000	62,135,000
Total	66,648,000	72,825,000	66,648,000	72,825,000
Loans Secured by Real Estate [Member] | Construction Land Development and Other Land Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			13,165,000	21,838,000	21,838,000
Loans charged-off			(76,000)	(412,000)
Recoveries			3,217,000	1,462,000
Provision for loan losses, LHFI			(5,271,000)	(6,424,000)
Balance at end of period	11,035,000	16,464,000	11,035,000	16,464,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	2,895,000	1,527,000	2,895,000	1,527,000
Collectively	8,140,000	14,937,000	8,140,000	14,937,000
Total	11,035,000	16,464,000	11,035,000	16,464,000
Loans Secured by Real Estate [Member] | Secured by 1-4 Family Residential Properties [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			9,633,000	12,957,000	12,957,000
Loans charged-off			(1,634,000)	(532,000)
Recoveries			255,000	213,000
Provision for loan losses, LHFI			2,200,000	(2,697,000)
Balance at end of period	10,454,000	9,941,000	10,454,000	9,941,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	308,000	583,000	308,000	583,000
Collectively	10,146,000	9,358,000	10,146,000	9,358,000
Total	10,454,000	9,941,000	10,454,000	9,941,000
Loans Secured by Real Estate [Member] | Secured by Nonfarm, Nonresidential Properties [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			19,672,000	21,096,000	21,096,000
Loans charged-off			(240,000)	(434,000)
Recoveries			94,000	26,000
Provision for loan losses, LHFI			(942,000)	(996,000)
Balance at end of period	18,584,000	19,692,000	18,584,000	19,692,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	1,642,000	1,936,000	1,642,000	1,936,000
Collectively	16,942,000	17,756,000	16,942,000	17,756,000
Total	18,584,000	19,692,000	18,584,000	19,692,000
Loans Secured by Real Estate [Member] | Other Loans Secured by Real Estate [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			2,080,000	2,197,000	2,197,000
Loans charged-off			(262,000)	(891,000)
Recoveries			0	30,000
Provision for loan losses, LHFI			645,000	240,000
Balance at end of period	2,463,000	1,576,000	2,463,000	1,576,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	53,000	38,000	53,000	38,000
Collectively	2,410,000	1,538,000	2,410,000	1,538,000
Total	2,463,000	1,576,000	2,463,000	1,576,000
Commercial and Industrial Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			15,522,000	14,319,000	14,319,000
Loans charged-off			(1,656,000)	(658,000)
Recoveries			286,000	2,135,000
Provision for loan losses, LHFI			2,788,000	1,755,000
Balance at end of period	16,940,000	17,551,000	16,940,000	17,551,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	884,000	6,273,000	884,000	6,273,000
Collectively	16,056,000	11,278,000	16,056,000	11,278,000
Total	16,940,000	17,551,000	16,940,000	17,551,000
Consumer Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			2,405,000	3,087,000	3,087,000
Loans charged-off			(883,000)	(1,139,000)
Recoveries			1,973,000	2,505,000
Provision for loan losses, LHFI			(1,161,000)	(1,602,000)
Balance at end of period	2,334,000	2,851,000	2,334,000	2,851,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	0	2,000	0	2,000
Collectively	2,334,000	2,849,000	2,334,000	2,849,000
Total	2,334,000	2,851,000	2,334,000	2,851,000
Other Loans [Member] | Allowance for Loan Loses, LHFI [Member]
Financing Receivable, Allowance for Credit Losses [Roll Forward]
Balance at beginning of period			3,971,000	3,244,000	3,244,000
Loans charged-off			(2,085,000)	(2,290,000)
Recoveries			1,665,000	1,886,000
Provision for loan losses, LHFI			1,287,000	1,910,000
Balance at end of period	4,838,000	4,750,000	4,838,000	4,750,000
Financing Receivable, Allowance for Credit Loss, Additional Information [Abstract]
Individually	259,000	331,000	259,000	331,000
Collectively	4,579,000	4,419,000	4,579,000	4,419,000
Total	$ 4,838,000	$ 4,750,000	$ 4,838,000	$ 4,750,000