To disable creation of the backup files (*.bak) while editing in EditPlus, follow this step:

Go to Tools -> Preferences -> ‘Files’ category and turn off ‘Create backup file when saving’ option.