I've done it in the past and it's helped me keep track of what we discussed so I can use as a reference when asking questions. I don't think it's a distraction I actually think interviewers see it as a plus.