But you're not factoring in rent. If you aren't financing a house, where are you living while you save up for the house? You're already making those payments every month, but in one scenario it's money you're throwing away and never getting back. In my scenario it's equity in a home I'll own.
Also, if you haven't paid collision in over 40 years, that means you've had way more years to save. Of course you should be completely debt free by then.
But comparing yourself to somebody just entering the work force or that still has 40 years to retirement isn't the same thing. In your example, somebody in their early 20's would be paying rent for 15-20 years before you could buy a house cash. That's literally over $120k in rent money you paid because you didn't want to finance a house. That makes absolutely no sense from a financial standpoint.
It used to be very common to have room mates. I did for years and saved on rent. Renting your own place is a luxury that robs you every month
Thinking outside the box is no longer an American trait
There are other ways to find housing than rent
There are situations where you can live rent free or be paid to live somewhere , but those opportunities will not look for you.