Also if you want to do it manually go to the main menu and there should be a selection that says delete file usually under continue game. Select that and you can delete it that way too.
/\ Starting at gen V there's no "New Game" option anymore if your game already has a save file. Also, in gen IV, although you can choose "New Game", the game won't save as long as there is another save file.