If both teams agree that there was no chance of somebody catching the disc the turnover can stand. If the attack believes they could have made a play on the disc I guess the disc should come back to the thrower.
Small note: This is assuming the spectator actively sought the disc. If they are hit by the disc without their involvement this would be a turnover.