Loans Held for Investment (Details 4) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013 item	Dec. 31, 2012
Loans Held for Investment
Number of areas where the entity's credit quality is maintained and credit risk managed	2
Number of Pass scale grades	6
Credit Risk Grades
Total Gross Loans	$ 1,243,252	$ 986,194
Business loans: Commercial and industrial
Credit Risk Grades
Total Gross Loans	187,035	115,354
Business loans: Commercial owner occupied
Credit Risk Grades
Total Gross Loans	221,089	150,934
Business loans: SBA
Credit Risk Grades
Total Gross Loans	10,659	6,882
Business loans: Warehouse facilities
Credit Risk Grades
Total Gross Loans	87,517	195,761
Real estate loans: Commercial non-owner occupied
Credit Risk Grades
Total Gross Loans	333,544	253,409
Real estate loans: Multi-family
Credit Risk Grades
Total Gross Loans	233,689	156,424
Real estate loans: One-to-four family
Credit Risk Grades
Total Gross Loans	145,235	97,463
Real estate loans: Construction
Credit Risk Grades
Total Gross Loans	13,040
Real estate loans: Land
Credit Risk Grades
Total Gross Loans	7,605	8,774
Other loans
Credit Risk Grades
Total Gross Loans	3,839	1,193
Pass
Credit Risk Grades
Total Gross Loans	1,221,125	940,393
Pass | Business loans: Commercial and industrial
Credit Risk Grades
Total Gross Loans	184,247	111,895
Pass | Business loans: Commercial owner occupied
Credit Risk Grades
Total Gross Loans	207,872	136,330
Pass | Business loans: SBA
Credit Risk Grades
Total Gross Loans	10,659	6,819
Pass | Business loans: Warehouse facilities
Credit Risk Grades
Total Gross Loans	87,517	195,761
Pass | Real estate loans: Commercial non-owner occupied
Credit Risk Grades
Total Gross Loans	329,538	240,585
Pass | Real estate loans: Multi-family
Credit Risk Grades
Total Gross Loans	232,661	143,003
Pass | Real estate loans: One-to-four family
Credit Risk Grades
Total Gross Loans	144,152	96,061
Pass | Real estate loans: Construction
Credit Risk Grades
Total Gross Loans	13,040
Pass | Real estate loans: Land
Credit Risk Grades
Total Gross Loans	7,605	8,762
Pass | Other loans
Credit Risk Grades
Total Gross Loans	3,834	1,177
Special Mention
Credit Risk Grades
Total Gross Loans	2,092	15,036
Special Mention | Business loans: Commercial and industrial
Credit Risk Grades
Total Gross Loans	12	92
Special Mention | Business loans: Commercial owner occupied
Credit Risk Grades
Total Gross Loans	1,217	2,674
Special Mention | Real estate loans: Commercial non-owner occupied
Credit Risk Grades
Total Gross Loans	352	687
Special Mention | Real estate loans: Multi-family
Credit Risk Grades
Total Gross Loans	511	11,583
Substandard
Credit Risk Grades
Total Gross Loans	20,035	30,765
Substandard | Business loans: Commercial and industrial
Credit Risk Grades
Total Gross Loans	2,776	3,367
Substandard | Business loans: Commercial owner occupied
Credit Risk Grades
Total Gross Loans	12,000	11,930
Substandard | Business loans: SBA
Credit Risk Grades
Total Gross Loans		63
Substandard | Real estate loans: Commercial non-owner occupied
Credit Risk Grades
Total Gross Loans	3,654	12,137
Substandard | Real estate loans: Multi-family
Credit Risk Grades
Total Gross Loans	517	1,838
Substandard | Real estate loans: One-to-four family
Credit Risk Grades
Total Gross Loans	1,083	1,402
Substandard | Real estate loans: Land
Credit Risk Grades
Total Gross Loans		12
Substandard | Other loans
Credit Risk Grades
Total Gross Loans	$ 5	$ 16