I am looking at selling jewelry that was inspired by specific songs and am wondering if I can cite or link to their work legally on my product page.
As is typical with legal matters, "it depends". It is not copyright infringement to mention the name of an artist or work of art. It may be infringement of trademark, or of the right of publicity. For example, Apple Computers has trademarked the name "Apple" in the domain of computers, so you cannot call your computer company "Apple Computers", without their permission.
You also cannot advertise in a way that implies that Taylor Swift endorsed your product, without her permission – this is the "right of publicity" (the name may differ, e.g. "passing off" depending on jurisdiction). The situation in the US is highly variable, since it depends on state law. The legal inclinations of the particular artist may be irrelevant, since they often have legal arrangements with publishers, and if you are going to get sued, it might be the publisher that sues you. Hiring an attorney to evaluate the specifics of your idea is the only reasonable approach to the matter.