Loans Held for Investment (Details 5) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Other information concerning the credit quality
Current	$ 1,241,140	$ 985,303
30-59 Days Past Due	969	106
60-89 Days Past Due		303
90+ Days Past Due	1,143	482
Total	1,243,252	986,194
Non-Accruing	2,251	2,205
Business loans: Commercial and industrial
Other information concerning the credit quality
Current	187,035	115,078
60-89 Days Past Due		58
90+ Days Past Due		218
Total	187,035	115,354
Non-Accruing		347
Business loans: Commercial owner occupied
Other information concerning the credit quality
Current	219,875	150,689
30-59 Days Past Due	768
60-89 Days Past Due		245
90+ Days Past Due	446
Total	221,089	150,934
Non-Accruing	747	14
Business loans: SBA
Other information concerning the credit quality
Current	10,645	6,697
90+ Days Past Due	14	185
Total	10,659	6,882
Non-Accruing	14	259
Business loans: Warehouse facilities
Other information concerning the credit quality
Current	87,517	195,761
Total	87,517	195,761
Real estate loans: Commercial non-owner occupied
Other information concerning the credit quality
Current	332,984	253,409
90+ Days Past Due	560
Total	333,544	253,409
Non-Accruing	983	670
Real estate loans: Multi-family
Other information concerning the credit quality
Current	233,689	156,424
Total	233,689	156,424
Non-Accruing		266
Real estate loans: One-to-four family
Other information concerning the credit quality
Current	145,041	97,283
30-59 Days Past Due	71	101
90+ Days Past Due	123	79
Total	145,235	97,463
Non-Accruing	507	522
Real estate loans: Construction
Other information concerning the credit quality
Current	13,040
Total	13,040
Real estate loans: Land
Other information concerning the credit quality
Current	7,605	8,774
Total	7,605	8,774
Non-Accruing		127
Other loans
Other information concerning the credit quality
Current	3,709	1,188
30-59 Days Past Due	130	5
Total	$ 3,839	$ 1,193