I have the same question. I don't see any setting pertaining to updates or even how to tell what version the Valheim server is currently running in the Web Console.
Tried the info command from the 'live server console' page but no commands seem to do anything.