3 more years ! (& maybe more than 3)
We may benefit from some clarity here.
a) For starters, the legal U.S. convention of "settled law", a logical outgrowth of stare decisis (to stand by things decided).
Roe v. Wade was considered "settled law" until the Republican judicial SCOTUS cabal reversed itself.
So while "settled law" may be the standard, there are exceptions.
b) You may be EXACTLY right that a driver's license is a privilege today. I suspect it may even have been considered more so when there were fewer than a dozen issued nationwide.
BUT !
The ability to operate an automobile on public roadway might be argued to be a privilege by some, others may more persuasively observe it is a necessity on large portions of the territorial United States.
I checked for "banned criminal organizations" and on page one I got this hit:
https://www.ice.gov/about-ice/hsi/investigate/transnational-gangs
Savor the irony. ICE not only lists criminal organizations, but may soon belong on its own list.
Interesting question. I don't know enough about law to answer comprehensively.
But if President Trump conquers Greenland, and Canada, & Panama, and then gets the United States of America listed internationally as a criminal organization, we may become closer to a more obvious answer.