But I didn't personally do anything to upset him .. And I already apologised and he continued to carry it on a day later and was rude about it...

I am fine apologising but I don't feel it's reasonable to let him "get away" with being rude and aggressive and dragging it on for another day despite me apologising already...