Weight loss....Blah

So I have been working out 4 times a week since February and have lost a total of 4 freaking pounds! Ugh.  Really?? What is the point?? I am still hanging in there and will continue to work out.  I have been doing lots of weights and cardio and so I feel like I am gaining more muscle, but I want to lose weight! I looked up my height and weight and I should weight about 143 pounds (fyi I weigh in at 146) but anything up to 164 is still ok.  I should be proud that I am right where I was pre-baby.  That in itself is an accomplishment considering the day I gave birth I topped the scale at 181...yikes!!! My goal is 135, so I need that 10 pounds to come off! Harder said than done.  I am not a fan of extreme dieting, I would rather work out and eat what I wanted.  Now granted sometimes I eat ice cream after I work out....but I worked out so it is ok right??!! I am not giving up my food, all in moderation! I would def like to be at 135 when baby #2 is on its way, so hey I have 3 years to lose 10 pounds!! I better be able to do that! I see all these skinny bitches women that pop out babies and they are back to their like size 2 by the time they leave the hospital! I have never been small or petite.  I have big hips and now they are even bigger after Logan.  All I can do is keep trying and be happy where I am.  Just needed a place to vent :)