How do I Update the Application. Shall I Remove the Previous Version?

No, there is no need for that. The app will be automatically updated every other week or so. If auto-download is disabled on your device, please go to the store and check for updates manually.