[从 X 至 Y] = [from X to Y] (describes a continuous time)
[X 至 Y] = [ between X and Y] (describes a range of time)
Example:
"He visited me from Mondays to Saturday" means he visited me every day from Mondays to Saturday
"He visited me between Mondays and Saturday" means he visited me some days between Mondays and Saturday
五月底 (至) 六月初
- (between) the end of May (and) the beginning of June
- the end of May (to) the beginning of June -- [presume (从) is implied]
~
(从)五月底 (至) 六月初 = (from) the end of May (to) the beginning of
June
至 and 到 are interchangeable in this sentence
Since 五月底 至 六月初 can be interpreted as (从)五月底 (至) 六月初 with 从 omitted, it would be more precise to say "在五月底 和 六月初 之間" if you meant to say "between the end of May and the beginning of June"
One more example:
网上订的那东西,(在)五月至六月(之間)到达 (O) -[presume 在 and 之間 are omitted]
网上订的那东西, (从)五月至六月到达 (X) -[cannot presume 从 is omitted, an item cannot arrive every day]