If you want to turn off the Recent Documents feature in Ubuntu, all you have to do is create a .gtkrc file in your home directory.

Then add gtk-recent-files-max-age=0 to this file.

This is documented here.
This will also work in any other linux distribution running Gnome.
Enjoy!