Cleaning the slots on the burner did nothing. I replaced the brass nozzle to no avail. Finally replacing the burner fixed the issue and now the flame is nice and even. Still I do not see any visual issue with old burner, but it is clearly the culprit.