This already happens when the duplicate is deleted. If the duplicate is deleted, the question redirects to the thing it is a duplicate of.
I just deleted this post:
http://askubuntu.com/questions/20667/upgrade-ubuntu-10-04-to-11-04https://askubuntu.com/questions/20667/upgrade-ubuntu-10-04-to-11-04
Try it yourself; as a non-mod, non-10k user -- you will get redirected to the duplicate now. (If you are a mod or 10k user there, try in Incognito Mode so you aren't logged in.)
However, there is a catch-22 with this approach: if the duplicate is deleted, how will Google et al know to index the alternative title?
To solve this while allowing all the relevant search terms, you have to combine the "best" of both posts. It's unavoidable; I can't think of any other way. So:
Delete the dupe.
Then edit the remaining question, making sure that the relevant title and relevant body words from the deleted dupe are present on the remaining question. In other words, combine them!