You can clear your Recent Files in Windows 10 by going into your "Change folder and search options" menu.
You can easily delete a notebook in OneNote when you no longer need it by accessing File Explorer and removing it there.