So, someone has been accusing me of pedophilia since I have an attraction to young animals. I know that it's pedophilia if the person is attracted to young human children, but does it count as pedophilia if the person is attracted to animals instead of humans?
No. According to the Section 18 of the U.S. Code, § 2251:
(a) Any person who employs, uses, persuades, induces, entices, or coerces any minor to engage in, or who has a minor assist any other person to engage in, or who transports any minor in or affecting interstate or foreign commerce, or in any Territory or Possession of the United States, with the intent that such minor engage in, any sexually explicit conduct for the purpose of producing any visual depiction of such conduct or for the purpose of transmitting a live visual depiction of such conduct,shall be punished as provided under subsection (e) [...]
and a minor is defined (Section 18 of the U.S. Code, § 2256) as "any person under the age of eighteen years".
As such, you cannot be considered a pedophile. However, if you have sexual intercourses with animals, depending on the State laws on the matter, you might be charged with bestiality or similar offences.