Loans Held for Investment and Loans Held for Investment at Fair Value - Schedule of Nonaccrual With No Allowance for Loan Loss and Total Nonaccrual of Loans Held for Investment (Details) - USD ($)	12 Months Ended
Dec. 31, 2019	Jun. 30, 2020
Financing Receivable Nonaccrual Status [Line Items]
Nonaccrual With No Allowance for Loan Loss		$ 259,931,000
Total Nonaccrual	$ 125,819,000	270,772,000
Financing receivable, 90 days or more past due, still accruing	0	123,988,000
Troubled Debt Restructuring included in nonaccrual loans:	$ 179,000
Percentage of the originated loans held for investment	6.70%
Unpaid principal balance	$ 124,050,000
Recorded investment	125,998,000
Recorded investment of impaired loans requiring a specific allowance	12,286,000
Specific allowance	$ 913,000
Specific allowance as a percentage of recorded investment of impaired loans requiring a specific allowance	7.40%
Recorded investment of impaired loans not requiring a specific allowance	$ 113,712,000
Percentage of recorded investment of impaired loans not requiring a specific allowance	90.20%
Recorded investment of TDRs with a specific allowance	$ 179,000
Specific allowance	$ 25,000
Commercial - Purchase
Financing Receivable Nonaccrual Status [Line Items]
Nonaccrual With No Allowance for Loan Loss		19,269,000
Total Nonaccrual		20,615,000
Financing receivable, 90 days or more past due, still accruing		18,798,000
Commercial - Refinance
Financing Receivable Nonaccrual Status [Line Items]
Nonaccrual With No Allowance for Loan Loss		109,897,000
Total Nonaccrual		113,350,000
Financing receivable, 90 days or more past due, still accruing		54,323,000
Residential 1-4 Unit - Purchase
Financing Receivable Nonaccrual Status [Line Items]
Nonaccrual With No Allowance for Loan Loss		21,760,000
Total Nonaccrual		22,017,000
Financing receivable, 90 days or more past due, still accruing		14,603,000
Residential 1-4 Unit - Refinance
Financing Receivable Nonaccrual Status [Line Items]
Nonaccrual With No Allowance for Loan Loss		109,005,000
Total Nonaccrual		114,790,000
Financing receivable, 90 days or more past due, still accruing		$ 36,264,000

Amount, before troubled debt restructuring, of financing receivable to be modified.

Name:	us-gaap_FinancingReceivableModificationsPreModificationRecordedInvestment2
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Amount of financing receivable modified as troubled debt restructuring.

+ References

Reference 1: http://www.xbrl.org/2009/role/commonPracticeRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 33
-URI http://asc.fasb.org/extlink&oid=121611835&loc=SL6953676-111524

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 40
-Section 50
-Paragraph 4
-URI http://asc.fasb.org/extlink&oid=121585226&loc=d3e18845-111554

+ Details

Name:	us-gaap_FinancingReceivableModificationsRecordedInvestment
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of financing receivable on nonaccrual status with no allowance for credit loss.

+ References

+ Details

Name:	us-gaap_FinancingReceivableNonaccrualNoAllowance
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_FinancingReceivableNonaccrualStatusLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Definition

Amount of financing receivable 90 days or more past due and still accruing.

+ References

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 16
-Subparagraph (c)
-URI http://asc.fasb.org/extlink&oid=121599337&loc=SL82919258-210447

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 7
-Subparagraph (d)
-URI http://asc.fasb.org/extlink&oid=121611835&loc=d3e5111-111524

Reference 3: http://www.xbrl.org/2003/role/exampleRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 55
-Paragraph 80
-URI http://asc.fasb.org/extlink&oid=121647567&loc=SL82922355-210448

+ Details

Name:	us-gaap_FinancingReceivableRecordedInvestment90DaysPastDueAndStillAccruing
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of financing receivable on nonaccrual status.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 7
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=121611835&loc=d3e5111-111524

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 326
-SubTopic 20
-Section 50
-Paragraph 16
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=121599337&loc=SL82919258-210447

+ Details

Name:	us-gaap_FinancingReceivableRecordedInvestmentNonaccrualStatus
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Reflects the amount of the write-down related to a troubled debt restructuring.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 40
-Section 50
-Paragraph 4
-URI http://asc.fasb.org/extlink&oid=121585226&loc=d3e18845-111554

+ Details

Name:	us-gaap_FinancingReceivablesImpairedTroubledDebtRestructuringWriteDown
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

Amount of investment of impaired financing receivables with related allowance for credit losses and without a related allowance for credit losses.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 14A
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=121611835&loc=SL6953550-111524

+ Details

Name:	us-gaap_ImpairedFinancingReceivableRecordedInvestment
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of allowance for credit losses related to recorded investment.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 15
-Subparagraph (a)(3)
-URI http://asc.fasb.org/extlink&oid=121611835&loc=d3e5212-111524

+ Details

Name:	us-gaap_ImpairedFinancingReceivableRelatedAllowance
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Amount of unpaid principal balance of impaired financing receivables with related allowance for credit losses and without related allowance for credit losses.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 310
-SubTopic 10
-Section 50
-Paragraph 15
-Subparagraph (a)(4)
-URI http://asc.fasb.org/extlink&oid=121611835&loc=d3e5212-111524

+ Details

Name:	us-gaap_ImpairedFinancingReceivableUnpaidPrincipalBalance
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of investment in impaired financing receivables for which there is no related allowance for credit losses.

+ References

+ Details

Name:	us-gaap_ImpairedFinancingReceivableWithNoRelatedAllowanceRecordedInvestment
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Amount of investment in impaired financing receivables for which there is a related allowance for credit losses.

+ References

+ Details

Name:	us-gaap_ImpairedFinancingReceivableWithRelatedAllowanceRecordedInvestment
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Percentage of the originated loans held for investment.

+ References

No definition available.

+ Details

Name:	vel_PercentageOfOriginatedLoansHeldForInvestment
Namespace Prefix:	vel_
Data Type:	num:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Percentage of recorded investment of impaired loans not requiring a specific allowance.

+ References

No definition available.

+ Details

Name:	vel_PercentageOfRecordedInvestmentOfImpairedLoansNotRecurringSpecificAllowance
Namespace Prefix:	vel_
Data Type:	num:percentItemType
Balance Type:	na
Period Type:	instant

- Definition

Specific allowance as a percentage of recorded investment of impaired loans requiring a specific allowance.

+ References

No definition available.

+ Details

Name:	vel_SpecificAllowanceAsPercentageOfRecordedInvestmentOfImpairedLoansRequiringSpecificAllowance
Namespace Prefix:	vel_
Data Type:	num:percentItemType
Balance Type:	na
Period Type:	instant

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=vel_CommercialPurchasePortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=vel_CommercialRefinancePortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=vel_ResidentialOneToFourUnitPurchasePortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_FinancingReceivablePortfolioSegmentAxis=vel_ResidentialOneToFourUnitRefinancePortfolioSegmentMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: