Modification of emulsion polymerization by multiple addition of modifier