Submit Hint Search The Forums LinksStatsPollsHeadlinesRSS
14,000 hints and counting!


Misleading | 25 comments | Create New Account
Click here to return to the 'Misleading' hint
The following comments are owned by whoever posted them. This site is not responsible for what they say.
Misleading
Authored by: boredzo on Feb 03, '06 12:43:51PM

the set of answers is rather non-informative, in my opinion. I have 24 feeds, but this poll puts me in the same group as the one-feed people. doesn't seem like you learn that much from such a poll.

my suggestion (though it may be too late now) is to break up the smaller answers, and consolidate the larger ones into ‘More than 150’ or ‘More than 100’.



[ Reply to This | # ]
Misleading
Authored by: robg on Feb 03, '06 01:11:31PM

I have done that in the past, but then I received complaints that the results weren't equally-sized buckets. Either way, it seems, I lose :).

I went with equal buckets just to make the results comparable. I could have used smaller buckets, but there's a limit on poll length, so the max would have dropped notably.

I tried for a balance between bucket size and max feeds, as I know there are a lot of heavily-subscribed users out there.

-rob.



[ Reply to This | # ]
Misleading
Authored by: nanotechmama on Feb 03, '06 04:32:44PM

What do you do for people that are subscribed to many feeds only because Safari comes with so many? That's how I got mine. RSS feeds I've actually subscribed to myself total only three though. Maybe you weren't concerned with that level of detail.

Anneliese



[ Reply to This | # ]
Polling isn't easy and requires careful consideration
Authored by: roncross@cox.net on Feb 04, '06 03:08:22PM

I guess we are gaining a better appreciate for people who have to do this kind of thing full time. That's a good thing because it makes us all think of how we gather and use information in our lives on a daily basis.

There are several considerations in polling. The first is the distribution that you are dealing with. Most of the answers to the poll is considered attribute or countable data (1,2,3, etc...) which means that it is highly unlikely that you will ever have a normally distributed population. This type of data is generally skewed most of the time. So the interval should be selected based on the distribution, however, this is difficult to do since the distribution changes as more people vote. Perhaps the thing to do is to readjust the intervals at various times in the polling to better reflect the results of the voters. Of course, you don't have this capability now, but if you are going to continue to poll, you might want to think about this for the future.

The second consideration is sample size. How many people on average take your polls? I noticed that you have performed a lot of polls so you have some idea of the average number of people that will take a poll at any given time. Based on this information and the predicted distribution, it is easier to estimate intervals and provide better results from polling. With an average number of voters over 1000 and using countable data, you really need finer intervals or you need to readjust the intervals at various points in the polling.

For example, it is clear that values above 200 really don't matter. This means that you can break down the intervals from 0 to 200 in the following way.

0 - special case
1-13, 14-26,27-39,40-52,53-65,66-78,79-91, 92-104, 105-117, 118-130, .... 196-208,
> 208 - this is where it starts to not matter much.

Unfortunately, the way the polling is set up on this site and the limitations of the software, you are unable to do what I am recommending. You might want to consider the way in which your statistics are gathered. One idea would be to let people put in actual values and let the software bin the results based off actual values, particularly if the data is countable or continuous.


The third consideration is the questions being asked. From what I see in terms of how the binning works on this site, questions that are categorical will yield better results than questions that involve countable data. In other words, the voting and statistics are more favorable for categorical responses such as {yes, no} or {imac, ibook, powerbook, emac, mini, etc...}.

So yes, you can please most people if the response is categorical, you are less likely to please if the data is countable. You will please no one if the data is continuous such as the number of seconds a browsers loads to the nearest 100th of a second.

thx
RLC

---
rlc



[ Reply to This | # ]
Polling isn't easy and requires careful consideration
Authored by: robg on Feb 05, '06 03:06:25PM

Ron:

Mostly the polls here are just fun things that ask questions I think might be interesting. That's the sum amount of science that goes into it :).

I agree with your analysis, though, if we were going to get more serious about polling. I have prepared a few polls for Macworld in the past, and we used a complete standalone polling app, which is much better suited to the task than the simple "only multiple choice" polling feature built into Geeklog.

regards;
-rob.



[ Reply to This | # ]