Yes, the callers have been a problem for a long time now. Even the last few years that the show was on terrestrial radio it started to be dominated by boring "regulars" who would call in with nothing to say, and, more importantly, who Tom would always be indulgent towards and never mean to. Tom being mean to callers was a critical part of the show in the mid-00s/late-00s. When was the last time he actually GOMP'd somebody, does he even do that anymore?
And without the show in terrestrial radio you'll never get another Spike. They tried to do something like that with Avalanche Bob, but those calls were dreadful because they were way too manufactured.