Are legal remedies available?
---> No. Saying these words does not constitute any tort that can claim remedies. However, if he says “Battery” or “Assault me with bodily harm” and you have done nothing, and so how, your landlord terminated the contract with you, it is possible for you to sue him for defamation and claim damages? Yet, in most cases, they won't work as you must prove financial loss due to this.
Am I entitiled to self-defense?
For a proper self-defense in your case, you must reasonably believe that:
- You are facing an unjust threat from him; and
- You have used a level of force against him which is reasonable in that circumstances.
So, we can start looking into your case.
First, you have been posed a threat. By hitting you, you have reasonable grounds to state that you are under a threat (he may do actually bodily harm to you). So, the first element is constructed.
Second, hitting you is unjustified. Unless he can show that hitting you is to prevent you from suffering other harm (like there is a fire that you don't notice), then hitting you wouldn't be a justified act. You can use a reasonable force that is needed.
Third, that use of force is necessary. It varies as if you can leave or solve this problem without using force. If he often threatens you but won't do any harm to you, and in time he has not shown any signs that he will be hitting you, using force to “prevent” such act is not necessary. So, remember to think carefully before you do any defence, especially as you said you have some anger with him. He can use this to prove your defence is unnecessary.
Forth, the use of force must be reasonable. If he simply hit you and you punched him hard, causing him to pass out, it doesn't look like a proper defence, but rather trying to kill him. If you punch him a little but slightly, and he stopped his act, it would be a proper self-defence. You cannot kill him for hitting you with his hand, it is not reasonable.
Fifth, you must show you are defending yourself. If you rely on your anger with him and punched him without being threatened, it will not be a self-defence. You should wait till he is showing signs to hit you or actually hit you to defend yourself. Don't let your mind drive your act.
Mostly, after police arrived, they will leave if no crime is committed. Also, don't bring self-defence into a fight, it will bring you into trouble.
You can also possibly sue the landlord for negligence. He should have the duty to keep all tenants safe, and if he turned a blind eye on him, he is breaching his duty and so negligence can constitute. You can claim legal remedies for that.
I hope it helps you.