With regard to procurement legislation, is it legally permissible for a utility to insist that replies are in the English language?

Yes, this is perfectly acceptable under current legislation.