Fix in-place building of model wheels (#2352)

Fix in-place building of model wheels (#2352) #6865