Make sure segment's offset is not null when refreshing cache

Make sure segment's offset is not null when refreshing cache #1126