Should i stay in this relationship? please help?

Okay so i have been seeing this man for about six months now..i stayed over his house for two days and while i was there something really upset me...i was at his house and he told me he had to go out for little to pick up something that he will be back i said ok ill take a nap..so he comes back a hour later and he had his coat off and he told me he is really drunk but he never left the house because his coat was off..so then he said to me im bout to leave right now can i borrow your metro card i said ok..so then he was gone again for 40 minutes..i let that go because he came back with flowers and food and i thought it was sweet...then we was talking and laughing having a goodtime..so then he said he cant wait to evon come...evon is his mother friend she is very pretty and not old she lives right next door..so i said why you cant wait..then he changed and said babe i cant wait till devon come over to bring the game...he was a little drunk...so i let that slide..so he wanted to have but he wasnt erecting and really i was really hot because the house was hot..so he says go take a little shower so you can cool down..i said ok it seemed like he wanted to get rid of me...so went in the shower.he comes in and says he is going to evon house for a litttle while..i said no because im in the shower and im scared to be in the house by myself while in the shower can you at least wait until im done..he kept insisting he had to tell her he will be back and that ill be okay but then he gave in and waited till i got out....so i get out the shower and i say you can go now to her house..so he left a hour and 30 mins p by till he gets back..and he looks even more drunk!! my point is if he was just drinking why couldnt he invite me next door and why are you drinking with this woman when your mother is not over there! I dont know if im wrong please someone give me advice.. Should i stay in this relationship im so sad thank you