Data itself is not copyrightable.
For instance, demographic counts, weather measurements, phone numbers, chemical structures, currency values, facts about individuals and events, and similar types of factual information may be used without permission.
From this, it seems like any type of publicly available data can be used to create visualizations, even without asking for permission. Is that true?
Your list of items is generally facts which may be used without anything attached, but some facts are different:
phone numbers
Phone numbers are PII - personally identifying information - and you are possibly limited in what you may do with such PII. It also doesn't matter where you are, but where the data subject is to get you in trouble:
If the Data subject even is in the EU, you might be banned from processing the PII without permission of the data subject or be in violation of gdpr.
You are correct that facts in general are not protected by copyright, and most raw data are facts.
However, a collection of data may be protected by copyright as to its selection and organization. A use which copies such selection might possibly be copyright infringement.
If data constitutes a trade secret it may be protected as such, and "improper" access might be unlawful. This would not apply to publicly available data or collections of data.
If, to access a data set, one must sign or agree to a contract, that contract may limit the use of such data. Again, this would not apply to most publicly available data.
