Document and Entity Information Document Information [Table] Document Information [Line Items] Document Type Document Period End Date Entity Registrant Name Entity Well-known Seasoned Issuer Entity Voluntary Filers Title of 12(b) Security Trading Symbol Security Exchange Name Entity Current Reporting Status Entity Interactive Data Current Entity Filer Category Entity Small Business Entity Emerging Growth Company ICFR Auditor Attestation Flag Entity Shell Company Entity Public Float Entity Common Stock, Shares Outstanding Current Fiscal Year End Date Document Fiscal Year Focus Document Fiscal Period Focus Entity Central Index Key Amendment Flag CONSOLIDATED BALANCE SHEETS Statement [Table] Class of Stock [Axis] Class Of Stock [Domain] Class of Stock [Domain] Series A Preferred Stock [Member] Series A-1 junior participating preferred stock Series B Preferred Stock [Member] Series B 9.375% redeemable preferred stock Series C Preferred Stock [Member] Series C 9.125% redeemable preferred stock Statement [Line Items] Statement Assets [Abstract] ASSETS Cash and Cash Equivalents, at Carrying Value Cash and cash equivalents Restricted cash and cash equivalents, current Restricted cash Loans Receivable Held-for-sale, Net, Not Part of Disposal Group Aggregate unpaid principal balance of loans secured by properties Mortgage loans held-for-sale Total mortgage loans held-for-sale Servicing Asset at Fair Value, Amount Fair value of MSRs at end of period Balance at beginning of year Mortgage servicing rights This element represents the total trust assets including investment securities available-for-sale, securitized mortgage collateral, derivative assets, and real estate owned. Securitized Mortgage Trust Assets Securitized mortgage trust assets Total securitized mortgage trust assets Trust assets Other Assets. Other assets Total other assets Assets Total assets Liabilities [Abstract] LIABILITIES Warehouse Agreement Borrowings Warehouse borrowings Balance Outstanding Mortgage Servicing Right Financing Facility Mortgage Servicing Right Financing Facility MSR advance financings PTAP funds outstanding Convertible Notes Payable Convertible notes, net Other Long-term Debt Long-term debt This element represents the trust liabilities including securitized mortgage borrowings and derivative liabilities. Securitized Mortgage Trust Liabilities Securitized mortgage trust liabilities Other Liabilities Other liabilities Liabilities Total liabilities Commitments and Contingencies. Commitments and contingencies (See Note 11) Stockholders' Equity, Including Portion Attributable to Noncontrolling Interest [Abstract] STOCKHOLDERS’ EQUITY Preferred Stock, Value, Issued Preferred stock Common Stock, Value, Issued Common stock, $0.01 par value; 200,000,000 shares authorized; 21,238,191 and 21,255,426 shares issued and outstanding as of December 31, 2020 and December 31, 2019, respectively Additional Paid in Capital Additional paid-in capital Accumulated Other Comprehensive Income (Loss), Net of Tax Accumulated other comprehensive earnings, net of tax Accumulated other comprehensive earnings Retained Earnings (Accumulated Deficit) [Abstract] Total accumulated deficit: Cumulative Dividends Declared. Cumulative dividends declared Retained Earnings, Unappropriated Accumulated deficit Retained earnings Total accumulated deficit Stockholders' Equity Attributable to Parent Balance Balance Total stockholders’ equity Liabilities and Equity Total liabilities and stockholders’ equity Preferred Stock, Par or Stated Value Per Share Preferred stock, par value (in dollars per share) Preferred Stock, Dividend Rate, Percentage Preferred stock, dividend rate (as a percent) Preferred Stock, Liquidation Preference, Value Preferred stock, liquidation value (in dollars) Outstanding liquidation preference Preferred Stock, Shares Authorized Preferred stock, shares authorized Preferred Stock, Shares Issued Preferred stock, shares issued Preferred Stock, Shares Outstanding Preferred stock, shares outstanding Common Stock, Par or Stated Value Per Share Common stock, par value (in dollars per share) Common Stock, Shares Authorized Common stock, shares authorized Common Stock, Shares, Issued Common stock, shares issued Common Stock, Shares, Outstanding Common stock, shares outstanding CONSOLIDATED STATEMENTS OF OPERATIONS AND COMPREHENSIVE EARNINGS (LOSS) Revenues [Abstract] Revenues: Gain (Loss) on Sales of Loans, Net Gain (loss) on sale of loans, net The total amount of contractually specified servicing fees, late fees, and ancillary fees net of servicing costs that are earned for each period for which results of operations are presented. Servicing Income, Net Servicing (expenses) fees, net Servicing (expenses) fees, net Revenue from Contract with Customer, Including Assessed Tax Real estate services fees, net Amount of gain (loss) on mortgage servicing rights, net of change in fair value during the period. Mortgage Servicing Rights Gain Loss Net Loss on mortgage servicing rights, net Loss on mortgage servicing rights, net Represents other forms of revenue earned or loss, excluding interest, which is not otherwise specified in the taxonomy. Non Interest Income Other Operating Income Loss Other Other revenue Revenues Total revenues, net Operating Expenses [Abstract] Expenses: Labor and Related Expense Personnel expense General and Administrative Expense General, administrative and other Marketing Expense Business promotion Operating Expenses Total expenses Operating Income (Loss) Operating earnings (loss) Nonoperating Income (Expense) [Abstract] Other income (expense): Interest and Dividend Income, Operating Interest income Interest Expense, amount Interest expense This element represents change in fair value of long-term debt during the reporting period. Increase (Decrease) in Fair Value of Long Term Debt Change in fair value of long-term debt Change in fair value of long-term debt This element represents change in fair value of trust assets including gain or loss on real estate owned due to increases or decreases in the fair value of investment securities-for-sale, securitized mortgage collateral and securitized mortgage borrowings during the reporting period. Trust Assets, Net Change in Fair Value Including Real Estate Owned, Gain (Loss) Change in fair value of net trust assets, including trust REO losses Change in fair value of net trust assets, including trust REO gains Nonoperating Income (Expense) Total other income (expense), net Income (Loss) from Continuing Operations before Equity Method Investments, Income Taxes, Extraordinary Items, Noncontrolling Interest Net earnings (loss) before income taxes Income Tax Expense (Benefit) Total income tax (benefit) expense Income tax expense (benefit) Net Income (Loss) Attributable to Parent Net earnings (loss) Net earnings (loss) Other comprehensive (loss) earnings: Other comprehensive earnings (loss): Amount, after tax, before reclassification adjustment, of unrealized gain (loss) from increase (decrease) in instrument-specific credit risk of long-term debt measured under fair value option. Other Comprehensive Income (Loss), Credit Risk of Long-term Debt, Fair Value Option, Unrealized Gain (Loss) Arising During Period After Tax Change in fair value of instrument specific credit risk of long-term debt Other Comprehensive Income (Loss), Net of Tax Total comprehensive earnings (loss) Reconciliation of Loss Per Common Share Net earnings (loss) per common share: Earnings Per Share, Basic Basic (in dollars per share) Earnings Per Share, Diluted Diluted (in dollars per share) CONSOLIDATED STATEMENTS OF CHANGES IN STOCKHOLDERS’ EQUITY Equity Components [Axis] Equity Component [Domain] Equity Component [Domain] Parent [Member] Total IMH Stockholders' Equity Preferred Stock [Member] Preferred Stock Common Stock [Member] Common Stock Additional Paid In Capital [Member] Additional Paid-In Capital The amount of cumulative dividends declared. Cumulative Dividends Declared [Member] Cumulative Dividends Declared Retained Earnings [Member] Accumulated Deficit Increase (Decrease) in Stockholders' Equity [Roll Forward] Increase (Decrease) in Stockholders' Equity Shares, Outstanding Balance (in shares) Balance (in shares) Stock Issued During Period, Value, Restricted Stock Award, Forfeitures Retirement of restricted stock Stock Issued During Period, Shares, Restricted Stock Award, Forfeited Retirement of restricted stock (in shares) Stock Issued During Period, Value, Stock Options Exercised Proceeds from exercise of stock options Share-based Compensation Arrangement by Share-based Payment Award, Options, Exercises in Period Options exercised (in shares) Proceeds from exercise of stock options (in shares) Stock Issued During Period, Value, Restricted Stock Award, Gross Issuance of restricted stock Stock Issued During Period, Shares, Restricted Stock Award, Gross Issuance of restricted stock (in shares) Adjustments to Additional Paid in Capital, Share-based Compensation, Requisite Service Period Recognition Stock based compensation Adjustments to Additional Paid in Capital, Warrant Issued Issuance of warrants in connection with debt financing Other Comprehensive Income (Loss), Financial Liability, Fair Value Option, Unrealized Gain (Loss) Arising During Period, after Tax Other comprehensive (loss) earnings The adjustment to retained earnings resulting from the consolidation of corporate-owned life insurance trusts. Consolidation of Corporate-owned life Insurance Consolidation of corporate-owned life insurance trusts Consolidation of corporate-owned life insurance trusts CONSOLIDATED STATEMENTS OF CASH FLOWS Net Cash Provided by (Used in) Operating Activities [Abstract] CASH FLOWS FROM OPERATING ACTIVITIES: Net Income (Loss), Including Portion Attributable to Noncontrolling Interest Net loss Amount of gain (loss) on sale or disposal of mortgage servicing rights (MSRs). Gain (Loss) on Sale of Mortgage Servicing Rights (Loss) gain on sale of mortgage servicing rights Gain (loss) on sale of mortgage servicing rights Mortgage Servicing Rights (MSR) Impairment (Recovery) Change in fair value of mortgage servicing rights Change in fair value of mortgage servicing rights Gain (Loss) on Sales of Mortgage Backed Securities (MBS) Gain on sale of mortgage-backed securities Gain (Loss) on Sale of Mortgage Loans Gain on sale of mortgage loans (Loss) gain on sale of loans, net The increase (decrease) during the reporting period in the fair value of mortgage loans or securitized loans that are held with the intention to sell in the near future. Increase (Decrease) in Fair Value of Mortgage Loans Held-for-sale Change in fair value of mortgage loans held-for-sale Represents the change in fair value of derivatives lending, net during the reporting period. Increase (Decrease) in Fair Value of Derivatives Lending Net Change in fair value of derivatives lending, net The amount of increase (decrease) during the period relating to provision for repurchases. Increase (Decrease) In Provision For Repurchases Change in provision for repurchases Change in provision for repurchases The gains (losses) included in earnings that represent the difference between the sale price and the carrying value of loans made to finance real estate acquisitions. This element refers to the gain (loss) and not to the cash proceeds of the sale. This element is a noncash adjustment to net income when calculating net cash generated by operating activities using the indirect method. Gain (Loss) on Sale of Mortgage Loans Held-for-sale Origination of mortgage loans held-for-sale Proceeds from Sale of Mortgage Loans Held-for-sale Sale and principal reduction on mortgage loans held-for-sale This element represents gains (losses) from real estate owned at the time of sale or losses from further write-downs. Gain Loss from Real Estate Owned (Gain) loss from trust REO Gains from REO This element represents change in fair value of trust assets excluding real estate owned due to decreases in the fair value of investment securities-for-sale and of securitized mortgage collateral during the reporting period. Increase (Decrease) in Fair Value of Net Trust Assets Excluding Real Estate Owned Change in fair value of net trust assets, excluding trust REO This element represents the accretion to recognize interest income and interest expense using effective yields based on estimated fair values for trust assets and trust liabilities. Accretion of Interest Income and Expense Accretion of interest income and expense The aggregate expense charged against earnings to allocate the cost of intangible assets (nonphysical assets not used in production) and other assets in a systematic and rational manner to the periods expected to benefit from such assets. As a noncash expense, this element is added back to net income when calculating cash provided by or used in operations using the indirect method. Amortization of Intangible and Other Assets Amortization of intangible and other assets Represents the write-off of amounts previously capitalized as debt issuance cost in an extinguishment of debt and noncash expense included in interest expense to amortize debt discount and premium associated with the related debt instruments. Amortization of Debt Issuance Cost and Debt Discount Premium Amortization of debt issuance costs and discount on note payable Share-based Compensation Stock-based compensation The amount of accretion of interest expense on corporate debt. Accretion Of Interest Expense On Corporate Debt Accretion of interest expense on corporate debt Increase (Decrease) in Other Operating Assets Net change in other assets Increase (Decrease) in Other Operating Liabilities Net change in other liabilities Net Cash Provided by (Used in) Operating Activities Net cash provided by (used in) operating activities Net Cash Provided by (Used in) Investing Activities [Abstract] CASH FLOWS FROM INVESTING ACTIVITIES: This element represents net change during the reporting period in securitized mortgage collateral. Net Change in Securitized Mortgage Collateral Net change in securitized mortgage collateral Proceeds from Sale of Mortgage Servicing Rights (MSR) Proceeds from the sale of mortgage servicing rights The cash outflow on payments to acquire investments in corporate owned life insurance. Payments To Acquire Investments In Corporate Owned Life Insurance Investments in corporate-owned life insurance Payments for (Proceeds from) Productive Assets Purchase of premises and equipment Payments to Acquire Mortgage-backed Securities (MBS), Available-for-sale Purchase of mortgage-backed securities Proceeds from Sale of Mortgage-backed Securities (MBS), Available-for-sale Proceeds from the sale of mortgage-backed securities Proceeds from Sale of Other Real Estate Proceeds from the sale of trust REO Net Cash Provided by (Used in) Investing Activities Net cash provided by investing activities Net Cash Provided by (Used in) Financing Activities [Abstract] CASH FLOWS FROM FINANCING ACTIVITIES: The cash outflow from repayment of mortgage servicing rights financing. Repayment Of MSR Financing Repayment of MSR financing The cash inflow from borrowings under mortgage servicing rights financing. Borrowings Under MSR Financing Borrowings under MSR financing The cash outflow for a borrowing of warehouse having initial term of repayment within one year or the normal operating cycle, if longer. Repayment Of Warehouse Borrowings Repayment of warehouse borrowings The cash inflow from a borrowing of warehouse having initial term of repayment within one year or the normal operating cycle, if longer. Borrowings Under Warehouse Agreement Borrowings under warehouse agreements Proceeds from (Repayments of) Secured Debt Repayment of securitized mortgage borrowings Repayments of Convertible Debt Repayment of convertible notes The amount of net change in liabilities related to corporate owned life insurance. Net Change In Liabilities Related To Corporate Owned Life Insurance Net change in liabilities related to corporate owned life insurance Finance Lease, Principal Payments Principal payments on capital lease The cash outflow relating to payment for retirement of restricted stock. Payments For Retirement Of Restricted Stock Retirement of restricted stock Proceeds from Issuance of Shares under Incentive and Share-based Compensation Plans, Excluding Stock Options Issuance of restricted stock Proceeds from Stock Options Exercised Proceeds from exercise of stock options Net Cash Provided by (Used in) Financing Activities Net cash (used in) provided by financing activities Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents, Period Increase (Decrease), Including Exchange Rate Effect Net change in cash, cash equivalents and restricted cash Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents Cash, cash equivalents and restricted cash at end of period Cash, cash equivalents and restricted cash at beginning of year Supplemental Cash Flow Elements [Abstract] SUPPLEMENTARY INFORMATION: Interest Paid Interest paid Income Taxes Paid, Net Taxes (paid) refunded, net Supplemental Cash Flow Information [Abstract] NON-CASH TRANSACTIONS: Real Estate Owned, Transfer from Real Estate Owned Transfer of securitized mortgage collateral from trust REO This element represents mortgage servicing rights retained from loan sales and issuance of mortgage backed securities during the reporting period in a noncash transaction. Mortgage Servicing Rights Retained from Loan Sales and Issuance of Mortgage Backed Securities Mortgage servicing rights retained from issuance of mortgage backed securities and loan sales Recognition of cash surrender value of corporate-owned life insurance in noncash investing or financing activities. Recognition of Corporate-owned Life Insurance Cash Surrender Value Recognition of corporate-owned life insurance cash surrender value (included in Other assets) Recognition of corporate-owned life insurance trusts in noncash investing and financing activities. Recognition of Corporate-owned Life Insurance Trusts Recognition of corporate owned life insurance trusts (included in Other liabilities) The fair value of warrants issued in noncash financing activities. Warrants Issued Issuance of warrants Amount of lessee's right to use underlying asset under operating lease. Initial Recognition Of Operating Lease Right Of Use Assets Recognition of operating lease right of use assets (net of $3.8 million of deferred rent) Present value of lessee's discounted obligation for lease payments from operating lease. Initial Recognition Of Operating Lease Liabilities Recognition of operating lease liabilities Deferred Rent Credit, Noncurrent Deferred rent liability Summary of Business and Financial Statement Presentation including Significant Accounting Policies Organization, Consolidation, Basis of Presentation, Business Description and Accounting Policies [Text Block] Summary of Business and Financial Statement Presentation including Significant Accounting Policies Mortgage Loans Held-for-Sale The entire disclosure for unpaid principal balance of mortgage loans held-for-sale during the accounting period. Mortgage Loans Held For Sale Disclosure [Text Block] Mortgage Loans Held-for-Sale Mortgage Servicing Rights Represents the entire disclosure of mortgage servicing rights (recognized as an asset) during the reporting period. Mortgage Servicing Rights Disclosure [Text Block] Mortgage Servicing Rights Other Assets Other Assets Disclosure [Text Block] Other Assets Debt Schedule of Long-term Debt Instruments [Table] Debt Instrument [Line Items] Long-term Debt Convertible Notes Debt Disclosure [Text Block] Debt Securitized Mortgage Trusts Disclosure for information pertaining to securitized mortgage trusts. Securitized Mortgage Trusts Disclosure [Text Block] Securitized Mortgage Trusts Derivative Instruments Derivative Instruments Derivative Instruments and Hedging Activities Disclosure [Text Block] Derivative Instruments Redeemable Preferred Stock