Yes, that's because all of the fuel gets burnt in a far smaller space. The yellow flame contains fuel that isn't burnt immediately, hence the larger flame. They both give out the same amount of energy, just the yellow flame is spread out over a wider area.