Many factors make it hard to buy a home today, but the one that makes “the biggest difference” in today’s market is the housing shortage, Drew Scott, co-host of HGTV’s “Property Brothers,” said at CNBC’s Your Money event Thursday.

“I don’t think people realize this shortage of housing that we have affects everything — from the unhoused problem to the cost of housing,” said his brother Jonathan Scott, the other co-host of the home renovation and design television series.

The median sales price of U.S. homes was $412,300 in the second quarter of 2024, according to the U.S. Census via the Federal Reserve. That is down from $426,800 in the first quarter and from the peak high of $442,600 in the fourth quarter of 2022, the Fed reported. 

More from Your Money:

Here’s a look at more stories on how to manage, grow and protect your money for the years ahead.

6 strategies to help mitigate rising car and home insurance costsYour money and the election: How to frame decision-making amid uncertaintyMiddle-class Americans want to know how the wealthy make money

“Give it another 20 years and literally no young person will be able to afford to purchase a home, period,” Jonathan Scott told CNBC.

Why there’s a housing shortage

As of mid-2023, there’s a housing shortage of 4 million homes, according to the National Association of Realtors. Construction of new homes has been slow in recent years, and more buyers are competing for available homes, pushing up prices.

While there have been recent signs of improvement for the housing supply, it’s not enough to solve the underlying constraint in the U.S. housing market.