Probably Not so long as you are not hosting anything other than a link. (This is a secondary source)
Even if academics and technology enthusiasts prefer an absolute right to link on the Internet, the business world has an interest in regulating what information is shared.66 Businesses will protest free linking to their materials if it interferes with their sales or marketing messages.67 If a website operator *1090 desires to restrict certain content from being linked to or integrated in another site, the operator can require a password to view the site or can technically disable outside sites from in-line linking to images or media hosted by the site.68
You may have an issue with ToS 4. D. if you have ads on your webpage. Service here is defined as "by using or visiting the YouTube website or any YouTube products, software, data feeds, and services provided to you on, from, or through the YouTube website "
But it does seem to allow you to use an embedded player in your site if you wanted. ToS 4. F.