Fair Value Measurements - Carrying Amounts and Estimated Fair Values of Financial Instruments (Details) - USD ($) $ in Thousands	Jun. 30, 2020	Dec. 31, 2019	Jun. 30, 2019
Assets:
Restricted cash	$ 6,735	$ 6,087	$ 1,542
Loans held for investment, net	1,861,819	1,863,360
Loans held for investment, at fair value	2,956	2,960
Real estate owned, net	15,648	13,068
Liabilities:
Secured financing, net	74,571	145,599
Warehouse repurchase facilities, net	160,796	421,548
Securitizations, net	1,599,719	1,438,629	$ 1,261,456
Carrying Value
Assets:
Cash	9,803	21,465
Restricted cash	6,735	6,087
Loans held for sale, net	212,344	214,467
Loans held for investment, net	1,861,819	1,863,360
Loans held for investment, at fair value	2,956	2,960
Accrued interest receivables	17,793	13,295
Interest-only strips	845	894
Real estate owned, net		13,068
Liabilities:
Secured financing, net	74,571	145,599
Warehouse repurchase facilities, net	160,796	421,548
Securitizations, net	1,599,719	1,438,629
Accrued interest payable	7,777	7,190
Estimated Fair Value
Assets:
Cash	9,803	21,465
Restricted cash	6,735	6,087
Loans held for sale, net	212,344	222,260
Loans held for investment, net	1,767,635	1,913,481
Loans held for investment, at fair value	2,956	2,960
Accrued interest receivables	17,793	13,295
Interest-only strips	845	894
Real estate owned, net		13,068
Liabilities:
Secured financing, net	75,010	153,000
Warehouse repurchase facilities, net	160,796	421,548
Securitizations, net	1,617,114	1,486,990
Accrued interest payable	7,777	7,190
Level 1 \| Estimated Fair Value
Assets:
Cash	9,803	21,465
Restricted cash	6,735	6,087
Accrued interest receivables	17,793	13,295
Liabilities:
Accrued interest payable	7,777	7,190
Level 2 \| Estimated Fair Value
Liabilities:
Warehouse repurchase facilities, net	160,796	421,548
Level 3 \| Estimated Fair Value
Assets:
Loans held for sale, net	212,344	222,260
Loans held for investment, net	1,767,635	1,913,481
Loans held for investment, at fair value	2,956	2,960
Interest-only strips	845	894
Real estate owned, net		13,068
Liabilities:
Secured financing, net	75,010	153,000
Securitizations, net	$ 1,617,114	$ 1,486,990

Fair value portion of accrued expenses.

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02.20)
-URI http://asc.fasb.org/extlink&oid=120391452&loc=d3e13212-122682

+ Details

Name:	us-gaap_AccruedLiabilitiesFairValueDisclosure
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Fair value portion of currency on hand as well as demand deposits with banks or financial institutions. Includes other kinds of accounts that have the general characteristics of demand deposits. Also includes short-term, highly liquid investments that are both readily convertible to known amounts of cash and so near their maturity that they present insignificant risk of changes in value because of changes in interest rates.

+ References

No definition available.

+ Details

Name:	us-gaap_CashAndCashEquivalentsFairValueDisclosure
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- References

No definition available.

+ Details

Name:	us-gaap_FinancialInstrumentsFinancialAssetsBalanceSheetGroupingsAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- References

No definition available.

+ Details

Name:	us-gaap_FinancialInstrumentsFinancialLiabilitiesBalanceSheetGroupingsAbstract
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Fair value portion of loans held-for-sale including, but not limited to, mortgage loans and finance receivables.

+ References

No definition available.

+ Details

Name:	us-gaap_LoansHeldForSaleFairValueDisclosure
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Carrying amount as of the balance sheet date of land and buildings obtained through foreclosure proceedings or defeasance in full or partial satisfaction of a debt arrangement.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 11
-URI http://asc.fasb.org/extlink&oid=121611835&loc=d3e5162-111524

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 45
-Paragraph 3
-URI http://asc.fasb.org/extlink&oid=121593590&loc=d3e4437-111522

+ Details

Name:	us-gaap_RealEstateAcquiredThroughForeclosure
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of cash and cash equivalents restricted as to withdrawal or usage. Cash includes, but is not limited to, currency on hand, demand deposits with banks or financial institutions, and other accounts with general characteristics of demand deposits. Cash equivalents include, but are not limited to, short-term, highly liquid investments that are both readily convertible to known amounts of cash and so near their maturity that they present insignificant risk of changes in value because of changes in interest rates.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 944
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.7-03(a)(2))
-URI http://asc.fasb.org/extlink&oid=120400017&loc=d3e572229-122910

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02(1))
-URI http://asc.fasb.org/extlink&oid=120391452&loc=d3e13212-122682

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 230
-SubTopic 10
-Section 50
-Paragraph 8
-URI http://asc.fasb.org/extlink&oid=121583591&loc=SL98516268-108586

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 210
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-03(1)(a))
-URI http://asc.fasb.org/extlink&oid=120398452&loc=d3e534808-122878

Reference 5: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 230
-SubTopic 10
-Section 45
-Paragraph 4
-URI http://asc.fasb.org/extlink&oid=121586364&loc=d3e3044-108585

+ Details

Name:	us-gaap_RestrictedCashAndCashEquivalents
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Fair value portion of interest continued to be held by a transferor after transferring financial assets to a third party.

+ References

No definition available.

+ Details

Name:	us-gaap_RetainedInterestFairValueDisclosure
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount, after the effects of master netting arrangements, of securities loaned to entities in exchange for collateral. Includes liabilities not subject to a master netting arrangement and not elected to be offset.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 30
-Section 50
-Paragraph 1A
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=109249958&loc=SL6224234-111729

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 55
-Paragraph 10
-URI http://asc.fasb.org/extlink&oid=99393222&loc=SL20226008-175313

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 20
-Section 50
-Paragraph 3
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=51824906&loc=SL20225862-175312

+ Details

Name:	us-gaap_SecuritiesLoaned
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Accrued interest and other receivables.

+ References

No definition available.

+ Details

Name:	vel_AccruedInterestAndOtherReceivables
Namespace Prefix:	vel_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Loans held for investment, at fair value.

+ References

No definition available.

+ Details

Name:	vel_LoansHeldForInvestmentAtFairValue
Namespace Prefix:	vel_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Loans held for investment, net.

+ References

No definition available.

+ Details

Name:	vel_LoansHeldForInvestmentNet
Namespace Prefix:	vel_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Securitizations, net.

+ References

No definition available.

+ Details

Name:	vel_SecuritizationsNet
Namespace Prefix:	vel_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Warehouse repurchase facilities, net.

+ References

No definition available.

+ Details

Name:	vel_WarehouseRepurchaseFacilitiesNet
Namespace Prefix:	vel_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Details

Name:	us-gaap_FairValueByMeasurementBasisAxis=us-gaap_CarryingReportedAmountFairValueDisclosureMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FairValueByMeasurementBasisAxis=us-gaap_EstimateOfFairValueFairValueDisclosureMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FairValueByFairValueHierarchyLevelAxis=us-gaap_FairValueInputsLevel1Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FairValueByFairValueHierarchyLevelAxis=us-gaap_FairValueInputsLevel2Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FairValueByFairValueHierarchyLevelAxis=us-gaap_FairValueInputsLevel3Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: