Disappearing boyfriend saids Im childish?

My so called boyfriend has disappeared twice in the last month and a half. Our arguments are over his lack of employment. Its been eight months and he still makes little or no attempt to gain employment. He sometimes does odd jobs and I see none of that. I dont need his money, its the effort I looking for. I do not allow him to live with me due to his lack of employment. In the past one and a half months he disappeared on me twice for two weeks at a time. Within this time frame I made plans to go away with my childrens father. We are sharing hotel cost. I was a little sad about my boyfriends disapperance and decieded I should go out of town for a few days to gain a decent perspective in this relationship and the misery its been causing me. My boyfriend shows back up and doesnt want me to go. I told him tough! He said Im being childish and playing a tic for a tac but I feel he deseves whatever he get for taking the relationship for granted. Especially for such a long period of time. My question is this...should I have dumped him in the first place? Since Im still hanging out with him, should I cancel the trip? I still like being with him, I just dont take the relationship serious anymore. Why is he so pissed off and cant see my point?