Income Taxes - Net Operating Loss Carryforwards (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014
Operating Loss Carryforwards
Loss Carryforwards	$ 45,724
Yadkin Valley Federal Tax
Operating Loss Carryforwards
Loss Carryforwards	25,968
Yadkin Valley State Tax
Operating Loss Carryforwards
Loss Carryforwards	16,987
Cardinal State Bank
Operating Loss Carryforwards
Loss Carryforwards	2,424
American Community Bank
Operating Loss Carryforwards
Loss Carryforwards	$ 345