Income Taxes - Net Operating Loss Carryforwards (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013
Operating Loss Carryforwards
Loss Carryforwards	$ 66,974
Yadkin Valley Federal Tax
Operating Loss Carryforwards
Loss Carryforwards	35,582
Yadkin Valley State Tax
Operating Loss Carryforwards
Loss Carryforwards	28,623
Cardinal State Bank acquisition
Operating Loss Carryforwards
Loss Carryforwards	2,424
American Community Bank acquisition
Operating Loss Carryforwards
Loss Carryforwards	$ 345