Regulatory Matters and Significant Risks or Uncertainties (Details) (USD $)	3 Months Ended		12 Months Ended	3 Months Ended		3 Months Ended			3 Months Ended
	Mar. 31, 2014 Quarter Building Branch	Mar. 31, 2013	Dec. 31, 2013	Mar. 31, 2014 Series A Preferred Stock [Member]	Mar. 31, 2014 Federal Reserve Discount Window [Member]	Mar. 31, 2014 Nonperforming Financing Receivable [Member]	Mar. 31, 2013 Nonperforming Financing Receivable [Member]	Dec. 31, 2013 Nonperforming Financing Receivable [Member]	Mar. 31, 2014 Royal Bank [Member]	Dec. 31, 2011 Royal Bank [Member]
Federal Deposit Insurance Corporation and Department of Banking Orders [Abstract]
Minimum Tier one leverage ratio required (in hundredths)	8.00%									8.00%
Minimum total capital to risk weighted assets ratio required (in hundredths)	12.00%									12.00%
Tier I capital (to average assets, leverage) (in hundredths)	9.36%								9.36%
Total capital (to risk-weighted assets) (in hundredths)	16.17%								16.17%
Significant Losses [Abstract]
Period of continued significant losses in calendar years	5 years
Net income	$ 1,498,000	$ 118,000							$ 1,559,000
Growth in net interest income	754,000
Decline in salaries and benefits	409,000
Decline in provision for loan and lease losses	388,000
Decline in credit related expenses	280,000
Decline in gains on the sale of entity owned real estate	676,000
Increase in marketing and advertising expenses	71,000
Increase in occupancy and equipment expenses	60,000
Financing Receivable, Recorded Investment [Line Items]
Net classified loans and foreclosed property	52,800,000		61,400,000
Delinquent loans held for investment						2,500,000		2,600,000
Non performing loans, charge offs	1,185,000	1,985,000	3,893,000			1,200,000	2,000,000
Short-term Debt [Line Items]
Available borrowing capacity at the federal home loan bank	182,500,000
Unpledged agency securities were available to be pledged as collateral					7,800,000
Borrowings	102,800,000		107,900,000
Line of credit maximum borrowing capacity	10,000,000
Line of credit outstanding amount	0
Liquidity to deposits ratio (in hundredths)	73.30%
Percentage of policy target (in hundredths)	12.00%
Liquidity to total liabilities ratio (in hundredths)	57.60%
Percentage of total liability ratio, policy target (in hundredths)	10.00%
Unfunded pension plan obligations	14,400,000		14,500,000
Class of Stock [Line Items]
Series A Preferred stock on which quarterly dividend suspended	30,098,000		29,950,000	30,400,000
Trust preferred securities with suspend interest payments	25,774,000		25,774,000
Preferred stock dividend in arrears				$ 8,200,000
Capital Adequacy [Abstract]
Number of previous quarters for which Call Report was filed	14
Minimum Tier one leverage ratio required (in hundredths)	8.00%									8.00%
Minimum total capital to risk weighted assets ratio required (in hundredths)	12.00%									12.00%
Tier I capital (to average assets, leverage) (in hundredths)	9.36%								9.36%
Total capital (to risk-weighted assets) (in hundredths)	16.17%								16.17%
Company Plans and Strategy [Abstract]
Reduction in workforce (in hundredths)	22.00%
Number of branches consolidated under rationalization	2
Number of buildings sold under rationalization	4
Number of branches being relocated	2