Does. fasting and exercise slowdown weight loss?

I have been intermittent fasting (skipping breakfast) and eating 2 small meals a day for wks now and my weight loss is very slow. One night I had a little extra to eat and the next day my weight dropped. Could I possibly be eating too few calories and my body is holding on to weight? Also I am not sleeping at night d/t hunger. Not eating after 7pm. Any suggestions please? Thanks