Income Taxes - Net Operating Loss Carryforwards (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014
Operating Loss Carryforwards
Loss Carryforwards	$ 60,464
Yadkin Valley Federal Tax
Operating Loss Carryforwards
Loss Carryforwards	32,868
Yadkin Valley State Tax
Operating Loss Carryforwards
Loss Carryforwards	24,827
Cardinal State Bank
Operating Loss Carryforwards
Loss Carryforwards	2,424
American Community Bank
Operating Loss Carryforwards
Loss Carryforwards	$ 345