Why solstice starts season?

Wouldn’t it make more sense for the solstice to be the halfway point of the season beginning to ending?

The shortest day of the year is the winteriest day and yet the day before it is technically still autumn.
This has always bugged me so maybe someone provide some rationale for the current way we define the seasons