Financial Instruments - Carrying Amount and Fair Value of Assets and Liabilities (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012	Dec. 31, 2011
Level 1
Financial assets:
Cash and cash equivalents	$ 138,396	$ 92,918
Investment securities	133	1,084
Loans and loans held-for-sale, net	0	0
Accrued interest receivable	0	0
Federal Home Loan Bank stock	4,154	6,130
Financial liabilities:
Demand deposits, NOW, savings and money market accounts	0	0
Time deposits	0	0
Borrowed funds	0	0
Accrued interest payable	0	0
Level 1 | Forward Sales Commitments
Financial assets:
Derivative assets		0
Financial liabilities:
Derivative liabilities	0
Level 1 | Interest Rate Swap Agreements
Financial assets:
Derivative assets	0	0
Financial liabilities:
Derivative liabilities	0	0
Level 1 | Interest Rate Lock Commitments
Financial assets:
Derivative assets	0
Financial liabilities:
Derivative liabilities	0	0
Level 2
Financial assets:
Cash and cash equivalents	0	0
Investment securities	342,987	329,338
Loans and loans held-for-sale, net	0	0
Accrued interest receivable	1,760	6,745
Federal Home Loan Bank stock	0	0
Financial liabilities:
Demand deposits, NOW, savings and money market accounts	898,372	855,455
Time deposits	742,552	885,903
Borrowed funds	105,926	106,923
Accrued interest payable	1,629	2,619
Level 2 | Forward Sales Commitments
Financial assets:
Derivative assets		57
Financial liabilities:
Derivative liabilities	481
Level 2 | Interest Rate Swap Agreements
Financial assets:
Derivative assets	0	0
Financial liabilities:
Derivative liabilities	0	0
Level 2 | Interest Rate Lock Commitments
Financial liabilities:
Derivative liabilities	0	0
Level 3
Financial assets:
Cash and cash equivalents	0	0
Investment securities	0	0
Loans and loans held-for-sale, net	1,187,663	1,365,586
Accrued interest receivable	4,616	0
Federal Home Loan Bank stock	0	0
Financial liabilities:
Demand deposits, NOW, savings and money market accounts	0	0
Time deposits	0	0
Borrowed funds	0	0
Accrued interest payable	0	0
Level 3 | Forward Sales Commitments
Financial assets:
Derivative assets		0
Financial liabilities:
Derivative liabilities	0
Level 3 | Interest Rate Swap Agreements
Financial assets:
Derivative assets	196	216
Financial liabilities:
Derivative liabilities	196	216
Level 3 | Interest Rate Lock Commitments
Financial assets:
Derivative assets	873
Financial liabilities:
Derivative liabilities	0	130
Carrying Amount
Financial assets:
Cash and cash equivalents	138,396	92,918
Investment securities	343,120	330,422
Loans and loans held-for-sale, net	1,312,034	1,437,610
Accrued interest receivable	6,376	6,745
Federal Home Loan Bank stock	4,154	6,130
Financial liabilities:
Demand deposits, NOW, savings and money market accounts	898,372	855,455
Time deposits	733,290	875,886
Borrowed funds	105,136	105,539
Accrued interest payable	1,629	2,619
Carrying Amount | Forward Sales Commitments
Financial assets:
Derivative assets		57
Financial liabilities:
Derivative liabilities	481
Carrying Amount | Interest Rate Swap Agreements
Financial assets:
Derivative assets	196	216
Financial liabilities:
Derivative liabilities	196	216
Carrying Amount | Interest Rate Lock Commitments
Financial assets:
Derivative assets	873
Financial liabilities:
Derivative liabilities	0	130
Estimated Fair Value
Financial assets:
Cash and cash equivalents	138,396	92,918
Investment securities	343,120	330,422
Loans and loans held-for-sale, net	1,187,663	1,365,586
Accrued interest receivable	6,376	6,745
Federal Home Loan Bank stock	4,154	6,130
Financial liabilities:
Demand deposits, NOW, savings and money market accounts	898,372	855,455
Time deposits	742,552	885,903
Borrowed funds	105,926	106,923
Accrued interest payable	1,629	2,619
Estimated Fair Value | Forward Sales Commitments
Financial assets:
Derivative assets		57
Financial liabilities:
Derivative liabilities	481
Estimated Fair Value | Interest Rate Swap Agreements
Financial assets:
Derivative assets	196	216
Financial liabilities:
Derivative liabilities	196	216
Estimated Fair Value | Interest Rate Lock Commitments
Financial assets:
Derivative assets	873
Financial liabilities:
Derivative liabilities	$ 0	$ 130