Is breeding a double merle dog to a non-merle dog safe assuming the double merle has no defects?

My concern would be that it is very difficult if not virtually impossible to know if the "non-merle" dog has absolutely no merling background in its genes. For that reason, I personally would not breed a double merle dog.