RE: [gnso-dt-wg] Collecting Facts/and then analyzing them
- To: <gnso-dt-wg@xxxxxxxxx>
- Subject: RE: [gnso-dt-wg] Collecting Facts/and then analyzing them
- From: "Marilyn Cade" <marilynscade@xxxxxxxxxxx>
- Date: Tue, 31 Jul 2007 09:08:37 -0400
Apologies for posting again, but I wanted to ask an important question of
the group, and the ICANN staff. As you are designing survey
questions/questionnaire(s), how are you designing the analyses phase of the
I co-chaired the initial WHOIS Task Force at ICANN; we did an extensive
study, with just over 3000 returns. In designing a survey, it is very
important to understand how the data will be analyzed, and by whom, and by
what process. The survey instrument used for that survey was both
statistical, and analytical in nature, but had a free form answer as well.
We learned a great deal from the survey, and obtained some excellent
insights into the views of different participants about their concerns about
WHOIS. Glen and Tony Harris in particular will remember the extensive hours
of analysis, discussion, debate, to examine the over 3000 returned
We developed a standardized set of criteria by which we would try to group
the responses, and the TF members spent weeks undertaking reading and
sorting responses into 'categories'. We were helped considerably by Thomas
Roessler, Katie McGee, Tim Denton, and one or two other key members who
devoted extensive time to helping to undertake statistical analysis and ways
to present the data findings as well.
I have done many polls, many surveys, and many questionnaires--well, okay,
retained experts to do the above. While there is some expertise in the ad
hoc group, probably important to consider whether enough discussion has
occurred about how the results will be analyzed, and by whom.
Very important to design the analysis process -- NOT the outcome -- BUT the
process, before distributing the surveys. That both means to whom the
responses come in, but how the data will be treated. Is any of it
confidential? If so, why? Will all surveys be published? If not, what
happens to them? Who analyzes them? what process is there, if they are
confidential, for checking the validity of the analyses, and so on.
Perhaps some of the lessons learned from the experience of that survey might
be useful in this upcoming process.
From: owner-gnso-dt-wg@xxxxxxxxx [mailto:owner-gnso-dt-wg@xxxxxxxxx] On
Behalf Of Bruce Tonkin
Sent: Tuesday, July 31, 2007 12:11 AM
Subject: RE: [gnso-dt-wg] Collecting Facts
> Bruce, thanks. I have discussed with Olof and he will engage ICANN
> Staff in hopes of gathering data along these lines. Others
> on the list
> have already begun some work in regards to your scenarios #2
> and #3, at
> least, but you lay out very specific data that seem achievable and
> certainly would be useful.
Note that I suggest data be collected in such a way as that it is
statistically significant - rather than a series of individual cases.
Ie I am sure there are examples where a name used for tasting violates a
trademark - the question is how often. Likewise there would certainly
be examples where a registrant cannot obtain their desired name as the
name is currently being tasted and subsequently deleted several days
The benefit of examples is that it gives you a pattern that you can then
use to do statistical analysis. It is the next step that is usually not
taken in the GNSO policy debates. We have seen this in the WHOIS debate
where both sides of the debate provide examples, but there has been
little (apart from the work done by SSAC) statistical analysis to
identify the size of the problem.