FHLB Advances and Junior Subordinated Debentures (Details 2) (USD $)			12 Months Ended					3 Months Ended
	Mar. 31, 2014	Dec. 31, 2013	Dec. 31, 2007 Junior subordinated debentures	Mar. 31, 2014 Junior subordinated debentures	Dec. 31, 2013 Junior subordinated debentures	Dec. 31, 2005 Junior subordinated debentures	Dec. 31, 2012 Junior subordinated debentures Wilshire Statutory Trust I	Mar. 31, 2014 Junior subordinated debentures Wilshire Statutory Trust II	Mar. 31, 2014 Junior subordinated debentures Wilshire Statutory Trust III	Mar. 31, 2014 Junior subordinated debentures Wilshire Statutory Trust IV	Mar. 31, 2014 Junior subordinated debentures Saehan Capital Trust I	Nov. 20, 2013 Junior subordinated debentures Saehan Capital Trust I	Mar. 31, 2007 Junior subordinated debentures Saehan Capital Trust I
Junior subordinated debentures
Junior subordinated debentures	$ 71,610,000	$ 71,550,000		$ 71,610,000	$ 71,600,000			$ 20,619,000	$ 15,464,000	$ 25,774,000	$ 9,753,000	$ 9,693,000
Junior subordinated debentures issued						77,300,000							20,600,000
Amount of trust preferred securities issued			75,000,000
Junior subordinated debentures redeemed							15,500,000
Discount on junior subordinated debenture acquired												10,900,000
Interest Rate base								3 Month LIBOR	3 Month LIBOR	3 Month LIBOR	3 Month LIBOR
Interest Rate margin (as a percent)								1.79%	1.40%	1.38%	1.62%
Current Rate (as a percent)								2.036%	1.646%	1.626%	1.866%
Right to redeem debentures								$ 20,600,000	$ 15,500,000	$ 25,800,000	$ 20,600,000