In sports, early specialization appears to matter. Tiger Woods was less than 2 years old when his father began teaching him to play golf. He was on television by age 3. By the age of 5, he was in Golf Digest. Later, he became the youngest U.S. Junior Amateur champion. The youngest Masters champion. You get the point.
Since elite performers in any field tend to spend significantly more time on deliberate, focused, consistent practice than non-elite performers, the sooner you start, the better.
Among athletes who go on to become elite, early sampling across sports and delayed specialization is by far the most common path to the top.
Read more here