Prune ghosting list

[spdomin]

In all cases, we ghost based on the coarse search and then use this list as the set of ghosted objects. However, after the coarse search, there is a fine search which can rule out former candidates. For memory's sake, we should try and prune this custom ghosting list.