Get a divorce as a father before your kids are out of school and you have no choice but to start over like you're 25 when you're 50. Many of us have nothing left but the clothes on our back at a time we should be starting to look forward to retiring.
Or, just never be able to buy a house, period, until you are in your 50s. Living in Southern California for most of the last 20 years on one income makes it hard to even get started. We might finally buy a house when we turn 50, if we are lucky. I guess we will just hope to pay it off before we die so our kids have a place to live when we are gone.