Survey of International Science Fiction and Fantasy Fans About The Hugo Awards and the Puppies Controversy

Mini Hugo rocket carried into space and photgraphed by astronaut Kjell Lindgren in 2015.

Mini Hugo rocket carried into space and photgraphed by astronaut Kjell Lindgren in 2015.

By Shaun Duke and Aaron Beveridge:

Introduction

In April 2015, conversations with several non-U.S. fans about the then-developing controversy surrounding the 2015 Hugo Awards motivated the work that follows. Though no digital archeology of that conversation remains, a passing remark that the Sad/Rabid Puppies controversy is a product of the American culture wars sparked the work that follows. Unfortunately, the Hugos remain subject to the whims of American politics, whatever they might be at a given time. This prompted the initial question as to whether or not many non-U.S. fans held this same view of the Hugo Awards. Shortly after that conversation, a survey was created to ask that very question.

The initial aim of the survey was to determine how non-U.S. fans discovered the Hugo Awards, whether they considered the awards an American affair, and what they thought of the Sad/Rabid Puppies controversy. We began the survey with two assumptions based on the conversations that inspired this survey: (1) that non-U.S. fans largely viewed the Hugos as an American award which often excluded non-U.S. works by default; and (2) that non-U.S. fans were largely unfavorable to the Sad/Rabid Puppies controversy. Additionally, we used the survey as an opportunity to learn more about how non-U.S. fans learned about and engaged with the Hugos.

The following sections provide some background information, our methodology, and details about the results of the survey. This project summarizes and investigates the perception of non-U.S. fans. Certainly, it by no means captures a fully-representative global opinion of the effects that American politics have on the Hugos, but we were able to gather enough international survey responses to feel that our results add to the ongoing conversation. As with any opinion survey, the responses are merely that:  the gathered opinions of the individuals that decided to respond to the survey.[1]

The Controversy

The Sad Puppies is a slate voting campaign begun in 2013 designed to counter the perceived dominance of left-leaning science fiction and fantasy literature — what conservatives in the movement initially called “message fiction.” As the movement progressed, the supporters and writers of these works of “message fiction,” particularly those most opposed to the Sad Puppies movement, were referred to as the snobbish literati and, more recently, “Social Justice Warriors” (borrowing a term more broadly associated with the Gamergate movement); detractors have accused the Sad Puppies of being racists and sexists (Wallace).  Members of both sides have argued that the other is, in effect, actively destroying the science fiction and fantasy community, either through regressive politics and selfishness or through oppressive political correctness.

While there are many motivations behind these campaigns and their detractors, the veracity of which is not the purview of this report, the act of slate voting to “hack” the Hugo Awards took the campaigns from the fringes of science fiction discourse to the forefront of the awards discussion. The greatest Puppies controversy emerged in 2015, in which a new group called the Rabid Puppies (a more reactionary slate voting group than their Sad Puppies counterparts), organized a larger following to effectively dominate the 2015 Hugo Awards nominee ballots.  The final ballot — after several nominees recused themselves from consideration — contained 59 nominees from Sad and Rabid Puppies out of 85 total nominee slots.  The campaigns were less successful when final votes were cast.  In the end, no Sad or Rabid Puppies selection won an award, with all categories containing only slate items resulting in no awards being given.

In 2016, the Rabid Puppies had a similar influence on the awards, with 64 of their 81 selections making the final ballot; however, unlike in 2015, the Rabid Puppies slate for the 2016 Hugo Awards ballot consisted of many works chosen to deliberately counter the “No Award” process by essentially forcing the “sf/f left” to either “No Award” works they otherwise would support OR compromise their anti-slate values in order to support those same works.  Voters responded to this latest variation of the Kobayashi Maru[2] by rejecting “Trojan Horse” options[3] and handing awards to an overwhelming number of women and people of color.

Though the Sad Puppies were active in 2016, the shift from a slate to a longer, categorized recommendation list that favored a more diverse group of works and creators has made their present efforts less controversial than in previous years.

Methodology

The survey was conducted between April 22nd, 2015 and July 5th, 2015 using Google Forms with a combination of long answer and yes/no questions.  To find participants, the survey was disseminated through Twitter, Facebook, Google+, and, in rarer instances, email.  Participants were not asked for their names or identifying markers to protect their identities and to facilitate honest responses.

The original questions were as follows:

  1. What is your country of origin? (One-word Answer)
  2. How did you hear about the Hugo Awards? (Short Answer)
  3. Do you nominate/vote for the Hugo Awards? (Multiple Choice: Yes/No/Sometimes)
  4. Do you think the Hugo Award is primarily an American award? (Multiple Choice: Yes/No/Mostly)
  5. If you answered “yes” to the previous question, please explain your position here. (Long Answer)
  6. Do works nominated for the Hugo Awards reflect sf/f as you see it? (Long Answer)
  7. Do you think the makeup of the Hugo Awards voters reflects sf/f fandom as you see it? (Long Answer)
  8. Do you think others in your area share your opinion? Feel free to elaborate if necessary. (Long Answer)
  9. How do you view the current controversy regarding the Sad Puppies / Rabid Puppies and slate-based voting? Do SP/RP proponents (or opponents) represent fandom as you see it? (Long Answer)
  10. Do you feel drawn to certain Hugo categories more than others? If so, please explain. (Long Answer)
  11. Are there SF/F awards that you find more relevant? (Short Answer)
  12. Is there anything else you would like to add? Feel free to use this space for additional thoughts! (Short Answer)

We might have anticipated that the answers to some of these questions would prove redundant or repetitive.  In some cases, more participants answered one related question or another.  Inevitably, we chose to reduce the questions used for our data set; this removed redundancy and focused the survey on the original intent:  to understand how non-U.S. fans engage with the Hugo Awards and its current controversy.  In the end, we narrowed the questions down to the following categories, which will be explored in the following section:

  1. Participant Countries
  2. Are the Hugos an American Award?
  3. How did the participants her about the Hugos?
  4. Did the participant vote for the Hugos?
  5. What is the participant’s opinion about the Sad / Rabid Puppies and Slate Voting?

The next step involved coding the answers for category 5.  In order to do so, we applied the following rubric to the answers:

  • Undecided: the participant offers no opinion on the subject.
  • No Answer: self-explanatory
  • Agree: unequivocal agreement; the participant states “yes” with no reservations, offers absolute support of the Sad / Rabid Puppies side, and/or uses extreme language to describe the anti-Sad / Rabid Puppies or related groups.
  • Mostly Agree: nuanced agreement; the participant may sincerely agree with slates or the Sad / Rabid Puppies, but they offer concessions concerning the other side’s position or qualifications in their language.
  • Mostly Disagree: nuanced disagreement; the participant may sincerely disagree with slates or the Sad / Rabid Puppies, but they offer concessions concerning the other side’s position or qualifications in their language.
  • Disagree: unequivocal disagreement; the participant states “no” with no reservations, offers no statements of understanding concerning the opposite side, and/or uses extreme language to describe the Sad / Rabid Puppies.

We individually coded the entire dataset for category #5 and ranked each answer according to the above rubric, and then we compared our individual rankings to determine any areas of disagreement. Where disagreements existed, we chose the more conservative (less extreme) of the two options.

Once completed, we compiled all of the data into graphs and charts, which can be found in the following section.

Our method presented several limitations for the breadth and specificity of the data:

  1. The survey was conducted in English. As such, the majority of the participants came from countries in which English is regularly spoken — specifically, North America, Europe, Australia and New Zealand.  Roughly 90.6% of our participants came from these regions and 9.4% came from other areas.  It is possible that the Hugo Awards have had minimal penetration into the non-English-speaking world due to its association with the United States and with English-language works — the success of The Three-Body Problem by Liu Cixin and “Folding Beijing” by Hao Jingfang notwithstanding.
  2. Some of the questions on the survey resulted, as indicated above, in repeated answers or in participants simply pointing to another question to find their answer. As such, we chose to remove some questions from the final data set to limit redundancy and to provide focus.
  3. The survey resulted in responses from approximately 393 people and should not be viewed as anything but the opinions of 393 people. It is likely impossible to determine the size of the population of non-U.S. science fiction and fantasy fans in the world or to adequately conduct a study whose sample size could account for the variations of such a population.

Despite the limitations of our survey, the results offer some insight into the science fiction community outside of the United States.

Results

The following sections detail our findings for each of the five categories.

Category #1:  Participant Countries

countryTable [4]

Unsurprisingly, the majority of the participants came from countries with strong or dominant English-speaking populations, including Australia (15.7%), New Zealand (3.8%), Canada (14.2%), the United Kingdom (comprising England, Scotland, Wales, and Northern Ireland)(29%), Ireland (2.3%), France (1.7%), and others.  Europe dominates with 56.5% of the responses originating from the continent.

Unfortunately, countries outside of Europe, North America, Australia, and New Zealand are noticeably sparse.  Though we did receive some responses from surprising places — Zambia (0.02%), Trinidad and Tobago (0.02%), and Malaysia (0.05%), for example — our survey regrettably missed the sizable science fiction and fantasy community in China, Japan, and South Korea, among other places.  This is almost certainly due to the language of our survey (English) and to our own failure to do more to reach into those communities.  In the future, we hope surveys like this will be translated for non-English audiences and that more will be done to reach out to fandoms outside of the English-speaking world.

The participant countries list also contains a nation that one would rightfully assume doesn’t belong:  the United States of America.  Our survey didn’t account for individuals from the United States who have since taken up residence elsewhere OR individuals from outside the United States who have taken residence within the states.  Though they accounted for only 1.2% of the responses, we chose to keep them in the survey as a reminder of avenues that we might explore in the future.

Category #2:  Are the Hugos an American Award?

amTable

We anticipated that the answers to this question would lean toward our own initial assumptions, in part because the conversations that led to the survey took a similar position. Unsurprisingly, then, the majority of participants either emphatically declared Yes (49.6%) or Mostly (31.8%), with a smaller percentage (17%) stating either that the awards are not an American award or that they shouldn’t be perceived that way.

Many of the respondents argued that the awards were a reflection of the most dominant group within the larger field; the United States was typically identified as dominant within the sf/f field at large for what should be obvious reasons (the size of its publishing industry and fandom and the global influence of U.S. culture).  Some respondents were quick to note that just because the awards are American in nature, either due to its history or the culture that influences it, that doesn’t necessarily mean they are a reflection of American culture as a whole.  Indeed, many of the responses to our survey seemed to recognize the fractionality of American fandom in the basic sense of being loosely split across region, topic, age group, etc.

How respondents felt about the Hugo Awards “being American” varied between resigned to the current state of the awards and optimistic about a more international future.  Those who were more resigned tended to agree that the awards have favored American fiction due to history.  One respondent offered three reasons for this:

1) Locals make up a large proportion of each Worldcon. Most Worldcons are held in the US, therefore a large proportion of the Voting group is always American

2) Up until the 21st Century voting was mostly in person (yes, paper ballot was possible but the majority of ballots were not paper). e-voting mean that non-attendees can vote easily now. And as most Worldcons were in the US, pre-21st Century voters were therefore mostly American[5]

3) American fiction is known well in the rest of the world, but non-American literature is not known well in America. Therefore, the way the nomination system works, American works get on the ballot more often

[Mr. Glyer notes that statement 2) may confuse Site Selection voting with Hugo Awards voting. As far as we are aware, Hugo Awards voting has always involved mail-in ballots.]

The more optimistic side of this conversation noted that the greater influence of the Internet on engagement could potentially make the awards more inclusive, though such responses were occasionally tempered by the acknowledgement that the awards would probably always maintain an American focus for the exact reason listed in the first point above:  Worldcons are typically held in the United States.

For those who listed “Mostly” as their answer, the United Kingdom, Canada, and Australia were often listed as being secondary focuses for the Hugo Awards.  However, for a small minority of respondents, the notion that the awards might be international at all was met with either severe skepticism or outright rejection.

Category #3:  How did you hear about the Hugos?

hearTable2

For the most part, the answers were expected, with the majority of participants (63.3%) stating that they learned about the Hugos from traditional sources such as book covers, magazines, the Internet, conventions, marketing, blogs, and the news.  There is certainly overlap in the various categories, as some who answered “store” may have seen a Hugo Awards sticker on a book; however, we chose not to interpret words for the participants, opting instead to place such items as “store” and “university” in their own categories.

Category #4:  Have you voted for the Hugos?

voteTable

We were surprised to find that the majority of participants (47.3%) have never voted for the Hugos or consider themselves not to be voters because they rarely vote.  In retrospect, we probably shouldn’t have found this alarming given that only 6 (30%) of the Worldcons in the last 20 years have occurred outside of North America the U.S..  Of those 6, only 2 have been held in a country whose primary language is not English (Nippon, Japan in 2007 and Montreal, Quebec, Canada in 2009).  In total, only 18 (24.3%) of the 75 concluded or upcoming Worldcons have been or will be held outside the U.S.; 2017 will see Worldcon hosted in Finland for the first time (“The Long List”).

Combined with the responses to Category #2, it is clear that the perceptions of the Hugos as an American award influences the voting activity of the participants, with only 18.8% declaring that they are regular voters.  This is also supported by the fact that the majority of Worldcon attendees and supporters hail from the United States (see the chart below).  In the last four Worldcons, Americans were the overwhelmingly dominant demographic in three, each convention hosted in the United States; at LonCon3, whose membership naturally skewed towards the United Kingdom, Americans were the second largest demographic next to members from the host country (44.9%).  The data — and the history of the convention in the United States — reflect the notion that the location of a Worldcon heavily influences the degree to which non-U.S. fans participate, as to be expected given that the majority of non-U.S. survey participants see the Hugo Awards and Worldcons in general to be rooted in American fandom (as clearly shown in Category #2).  To our knowledge, however, no data is currently available for the voting demographics for every Hugo Award.

Convention U.S. Attending / Supporting Non-U.S. Attending / Supporting Source
ChiCon 7

Worldcon 70

2012

84.9% 15.1% (ChiCon 7 Progress Report #4)
LoneStarCon3

Worldcon 71

2013

88.7% 11.3% (LoneStarCon3 Progress Report #4)
LonCon3

Worldcon 72

2014

44.1% 55.9% (LonCon3 Membership Demographics)
Sasquan

Worldcon 73

2015

82.4% 17.6% (Sasquan Member Numbers)

 

Category #5:  What is your opinion of the Sad Puppies / Rabid Puppies and Slate Voting

pupTable

If 47.3% of participants do not vote in the Hugo Awards, it is not surprising that a sizable portion of them either had not decided what they thought about the Sad Puppies/Rabid Puppies controversy or had no opinion whatsoever (25.7%).  However, of those who had formed an opinion, almost all of them (72.3% in total and 97.3% of those who had an opinion) were neither favorable to the Sad Puppies nor the Rabid Puppies, with most vehemently disagreeing with the entire affair (38.7% of the total respondents and 52% of those who had an opinion).

Participants were not particularly shy about their opinions either.  Some of the most vocal detractors associated or compared the Sad or Rabid Puppies to neo-fascism, the Tea Party, Mens Rights Activists, and Gamergate.  These sorts of terms coincided with concerns about the damage the SP/RP event would have on the Hugo Awards and SF/F fandom in general.  For example, one respondent argued that

It has caused irreparable damage to the reputation and good names of the Hugo and of SFF fandom, which is almost entirely the fault of established fan-run management of the community. In less than a decade, the Hugo has gone from a calling card to Hollywood for SFF creators, to a flame war with white supremacists and Tea Party goons. You could see – from space, ironically – that this was going to happen and yet the mostly white and mostly American SFF fandom sat on its hands and hoped the problem would go away. Just as American fandom sat on its hands and hoped Marion Zimmer Bradley’s child abuse wasn’t real (her photo was still up at the London world con as a “professional SF writer). Yes, the puppies represent traditional SFF fandom just as Fox News playing in a MacDonald’s in Indiana represents the American midwest. Most people stopping by a MacDonald’s probabaly don’t agree with Bill O’Reilly but they do nothing to stop his toxic opinions from spreading in public space.

Part of this perspective was common among those who most vehemently opposed the SP/RP project:  namely, that the movement is both irrational and regressively conservative.  However, the above respondent is unusual in that they also place the blame partly on the feet of American SFF and fandom.

Most respondents, however, took the perspective, as the following respondent did, that SP/RP proponents viewed the world in “black and white” and “presumed themselves to be the ‘good guys’ and so [looked] around for enemies.”  Respondents in the two negative categories also cited “diversity” as a primary concern; quite a few held a similar position as the following:  “I think the Puppies represent an older demographic that’s threatened by the growing diversity of the genre — or, I should say, the growing visibility of diversity that has always been there.”  Diversity, of course, was a major issue in the conversation surrounding the events of 2015.

Not all respondents were entirely uncharitable to the SP/RP project.  Even those who largely viewed the movement as negative occasionally expressed an understanding of the movement’s intent or, more likely, an acknowledgement that the SP/RP proponents “[meant] to do a good thing by expanding the voter base [to] a slightly under-represented group (fans of military sf, Baen, Analog, etc.).”  However, these same respondents also rejected the methods used by the leaders of the SP/RP group (i.e., slate voting).  In a lot of cases, these slightly more favorable respondents differentiated between understanding or acknowledging the Sad Puppies and unambiguously rejecting the Rabid Puppies.

There were also a handful of respondents who took a positive view of the Sad Puppies in particular.  In almost all of these cases, the response specifically cited “ending political correctness” as the reason; for several respondents from the United Kingdom, the Jonathan Ross controversy in 2014 was the primary example of “political correctness” run amok.

Conclusions

The majority of non-U.S. participants agreed that the Hugo Awards are definitively an American award; they also overwhelmingly rejected the rhetoric and agenda of the Sad and Rabid Puppies, often emphatically so.

However, there are several unanswered questions which might be answered by a future survey.  First, we wonder how non-American fans living within the United States and American fans living outside of the United States view the ownership of the Hugo Awards and its controversies.  Second, we think a future survey should ask the participants who never voted or only occasionally voted what motivated their decisions to abstain entirely or participate only sporadically; this might help us better understand unseen divisions within international science fiction fandom. Finally, we think it crucial to reach out to communities that were not present in our survey.  In the map below, the black areas represent areas from which we received no responses:

country-map

 

As we suggested earlier in the essay — and as the map makes clear — we were unable to reach communities in these areas for a variety of reasons, including language and the limitations of our outreach methods. We hope to conduct a much more extensive survey in the next year in order to fill some of these gaps.

Special thanks goes to all those who helped create and disseminate the survey, including Ian Sales, Maureen Kincaid Speller, and many others.

Biographies

Shaun Duke is a PhD student at the University of Florida studying science fiction, postcolonialism, Caribbean literature, and the rhetorics of fandom.  His non-fiction work has appeared in Science Fiction Film and Television, Extrapolation, The Journal on the Fantastic in the Arts, Like Clockwork (forthcoming from the University of Minnesota Press in December 2016), and Strange Horizons.  Shaun also hosts the Hugo Award-nominated podcast, The Skiffy and Fanty Show, among others, and co-edited Speculative Fiction 2014: The Year’s Best Online Reviews, Essays, and Commentary (The Booksmugglers Publishing) with Renee Williams.  You can find out more about Shaun’s podcasts, writing, etc. at http://www.shaunduke.net/

Aaron Beveridge is a doctoral student in the University of Florida’s Department of English. His research intersects writing studies and data science paradigms — focusing on programming, data mining, and data-visualization as they motivate the ongoing expansion of research methods in rhetoric, writing, and the digital humanities. Grounded primarily in the study of networked writing and trend circulation, his research interests also include technical communication, the rhetoric of science, media ecology, and maker culture. Visit Aaron’s personal website: here.

Sources

ChiCon 7 Progress Report #4. Chicago: ChiCon 7, 2012. Print.

“LonCon3 Member Demographics.” Member Demographics. LonCon3, July 2014. Web. 29 June 2016. <http://www.loncon3.org/demographics.php>.

LoneStarCon 3 Progress Report #4. San Antonio: LoneStarCon 3, 2014. Print.

“The Long List of World Science Fiction Conventions (Worldcons).” The Long List of Worldcons. WSFS Long List Committee, n.d. Web. 29 June 2016. <http://www.smofinfo.com/LL/TheLongList.html>.

“Sasquan Member Numbers.” Sasquan — 2015 Worldcon. Sasquan, 30 June 2015. Web. 29 June 2016. <http://sasquan.org/member-numbers/>.

Wallace, Amy. “Who Won Science Fiction’s Hugo Awards, and Why It Matters.” Wired.com. Conde Nast Digital, 23 Aug. 2015. Web. 02 Feb. 2016. <http://www.wired.com/2015/08/won-science-fictions-hugo-awards-matters/>.

Footnotes

[1] This survey is an informal, non-academic survey.

[2] Technically, this situation is closer to a Cornelian Dilemma than the infamous Star Trek test of character.

[3] “Trojan Horse” votes refers to items places on the final ballot by voting campaigns that are designed to force competing camps of voters to choose between choosing what they love or maintaining their anti-slate principles to vote “No Award” a second time around. For the most part, voters seemed to reject this dilemma. One interpretation holds that voters voted on merit, an argument made in defense of the Hugo voting process on numerous occasions; it is also likely that some voters were able to identify deserving nominees in the list.

[4] The following countries had one respondent each and were not listed in the countries chart:  Austria, China, Hungary, Iceland, Luxembourg, Nigeria, Pakistan, Panama, The Philippines, Thailand, Trinidad and Tobago, Ukraine, Venezuela, and Zambia.

[5] Mr. Glyer notes that this statement may confuse Site Selection voting with Hugo Awards voting. As far as we are aware, Hugo Awards voting has always involved mail-in ballots.

37 thoughts on “Survey of International Science Fiction and Fantasy Fans About The Hugo Awards and the Puppies Controversy

  1. The respondent is seriously confused; in-person voting has never been possible for the Hugos because of the complexity of tallying. (One of the amusing discoveries in a recent cleanup of the NESFA clubhouse was the punchcards that served as ballots in 1971.) The big shift (more recent than the arrival of the millennium) has been from paper ballots to electronic ballots, which I understand have been >90% of the total ballots in the past few years.

    And the first table, which should be countries of the respondents, is instead a copy of the third table (how people heard about the Hugos). After waiting xs hours for lunch and then finding that yes-I-have-to-sit-a-jury-trial, I can use a drink..

  2. Chip Hitchcock: The respondent is seriously confused; in-person voting has never been possible for the Hugos because of the complexity of tallying.

    Yes, I pointed that out. There is a footnote acknowledging my correction. Personally, I think amending the text would have been more effective.

  3. Chip Hitchcock: Thanks to you I also discovered I left out a graphic. Let the appertainment begin!

  4. I suspect “in-person” voting refers to attending members, even if they voted by mail/electronically. Either that or the respondent has Hugo voting confused with the business meeting.

  5. Mike Glyer: In retrospect, I agree. If you’d like to put the amendment immediately beneath the incorrect text using brackets, I think that would be appropriate. I forgot that footnotes are perhaps not the most effective medium for a blog format.

  6. Methodology states: “To find participants, the survey was disseminated through Twitter, Facebook, Google+, and, in rarer instances, email.”

    Which is essentially meaningless.

    How specifically were respondents generated through each of these methods: Twitter, Facebook, Google+ and Email?

    Stating that the survey just reflects the opinions of nothing “but the opinions of 393 people” still tells the reader little. What group of people were solicited for their opinions using these medium? How did the respondents find out about the survey?

    For example: did the respondents come from specific individual’s twitter, facebook, gooogle+ and email followers or lists? Did they come from specific board postings? What??

    Any survey needs to describe how the respondents were selected so the reader will know what the survey means.

    [I am on many editorial review boards for journals and also review for conferences. Not describing how the respondents were surveyed is a common problem authors have when reporting their results. This is easily fixed].

  7. airboy:

    I hope this answers your question. We basically used social media to share the survey among people we knew who had “hands” in international sf/f communities or we shared on social media in the general sense. Most participants self-selected themselves (i.e., they saw a link or were directed to it by someone else, and they opted to take the survey); a small minority were people I (or Aaron) directly asked to participate (people I personally knew).

    So, this shouldn’t be taken as an academic survey (we didn’t have IRB approval for this because we didn’t ask for it), but more an informal “people came of their own free will” survey.

    I think in the future we will need to include a question that helps us to better answer this question (i.e., “How did you hear about this”). Frankly, we did some things that we wouldn’t do again because they didn’t work the way we intended, including the questions we asked, how we put together the plan for sharing it, etc. I want to do a related survey possibly later this year or next year and correct some of the issues we came up against.

    I also appreciate ANY criticism of the methods we used, the format, the questions, etc. This is the first attempt at a “real survey” (albeit an informal one), so critique will ultimately help us do better next time.

  8. Two nits to pick:

    Chicon should not have a second capital letter in it.

    The statement: “We were surprised to find that the majority of participants (47.3%) have never voted for the Hugos or consider themselves not to be voters because they rarely vote.” is incorrect since a majority is 50.1%, 47.3% would be a plurality.

  9. only 6 (30%) of the Worldcons in the last 20 years have occurred outside of North America. Of those 6, only 2 have been held in a country whose primary language is not English (Nippon, Japan in 2007 and Montreal, Quebec, Canada in 2009)

    Leaving aside the question of whether Canada’s primary language is or is not English (it’s not the primary language in Quebec, but Quebec isn’t a country), I’m pretty sure Montreal is part of North America and therefore not one of “those 6” Worldcons to be held outside the continent.

  10. survey: only 6 (30%) of the Worldcons in the last 20 years have occurred outside of North America. Of those 6, only 2 have been held in a country whose primary language is not English (Nippon, Japan in 2007 and Montreal, Quebec, Canada in 2009). In total, only 18 (24.3%) of the 75 concluded or upcoming Worldcons have been or will be held outside the U.S.

    At the time of the survey, only 5 in the last 20 years had been held outside North America:
    2014 – London, England, UK
    2010 – Melbourne, Australia
    2007 – Yokohama, Japan
    2005 – Glasgow, Scotland, UK
    1999 – Melbourne, Australia
    6, if you make it 21 years:
    1995 – Glasgow, Scotland, UK

    I know everyone outside North America likes to conflate the U.S. with Canada, but I think that’s unfair, and I’m pretty sure that the Canadian fans would not appreciate their cons being regarded as “American cons”. (Would fans from Finland, France, Denmark, Germany, etc. appreciate being told that all the UK cons are “the same as being in their country”? Would Worldcon 75 appreciate having their con called a “UK con”? I think not.)

    If you consider that Canada is not the U.S., then that makes 9 Worldcons (40.9%) in the last 22 years not being held in the U.S.:
    2009 – Montréal, Québec, Canada
    2002 – Toronto, Ontario, Canada
    1994 – Winnipeg, Manitoba, Canada

    20 (26.7%) (I’m not sure why the post says 18) of the 76 concluded or upcoming Worldcons have been or will be held outside the U.S. Yes, that’s not good, but 9 out of the last 22 (or 10 out of 24, with upcoming) shows that a real effort has been made to put more of the “world” into Worldcon.

    Thanks for doing the survey and posting the results, Shaun. I look forward to any further work you might do in this space. 🙂

  11. Shaun Duke:
    Your paper states that there is an ideological conflict. If your sources for discovering subjects has an ideological slant, then your survey will over-sample that slant.

    Let me provide an example.
    If I wanted to have one slant I could send the survey notification out to:
    770
    http://www.tor.com forums
    scalzi blog
    past Hugo attendees outside the USA.

    If I wanted a different slant I could send the survey notification to:
    madgenius club
    monsterhunternation
    baen forums
    attendees of LibertyCon outside the USA.

    If I was seeking a neutral forum you could consider:
    1] the amazon data collection (paid) with qualifiers that they read x number of SF books in the past year and were outside the USA (MTurk).
    2] Attendees of various large US and non-US cons
    3] Sending notifications to a wide variety of SF author blogs who were affiliated with a wide variety of publishers.

    Your problem is the Hugo controversy is such a small issue that the general public, the general reading public, and the general SF reading public will not have heard about it. I attended cons for a decade in the 1980s and early 1990s, bought tons of SF and did not know the Hugo was a reader award which required a participation fee until just a couple of years ago when Sad Puppies 3 hit.

    If you wanted the viewpoints of people from different ideological slants, I would purposely sample those from the different factions and also sample from those who were as neutral (but knowledgeable) as I could apart from the factions.

    If you are looking for eventual journal publication, you have to think through the ideological slant of your potential reviewers. In English and Mass-Comm, most of the faculty are pretty hard left in the USA. But you still have to consider if the reviewer is knowledgeable enough (and can put their ideology aside) to consider the relevant sampling frame.

    But people who review survey research will generally want to know the sample methodology in detail and also consider if the sample is valid for whatever research question you are posing. For example, if your research question was how do international attendees of SF literary cons view the Puppy Controversy – then asking for participants at various Hugo oriented forums would work well.

    I know something about MassComm reviewers only because I’ve had co-authors in the most business oriented part of MassComm departments. I know a lot about business journal reviewers.

    Hope this helps & good luck!

  12. airboy: repeated posts of pedantry

    Which part of “The survey… should not be viewed as anything but the opinions of 393 people.” did you not understand?

    Messrs Duke and Beveridge are well aware of what constitutes a statistically-meaningful survey (hence, their repeated disclaimers that this is not one), and do not need to be schooled by you.

    ETA: I missed Shaun’s request for suggestions the first time through, so my apologies, airboy; he did ask for your input.

  13. @airboy

    If I wanted a different slant I could send the survey notification to:
    madgenius club
    monsterhunternation
    baen forums
    attendees of LibertyCon outside the USA.

    How many commenters at Baen’s bar, the Mad Genius Club and Monster Hunter Nation come from outside the US? How many non-Americans opt to go to LibertyCon, an obscure regional con in a US city not easily accessible from abroad (Chattanooga doesn’t have an international airport. You’d have to fly to Atlanta or New Orleans). Even if several of the Mad Genius bloggers are immigrants, their posts are aimed at the US and their audience is American. Plus, as many of us have said, Baen books are not easy to find outside the US, unless you specifically order them from Amazon. Personally, I had no idea who Larry Correia even was, when he was nominated for the Campbell in 2012 and neither did any other international fan I know. Some of his books have been translated into German by now (with covers that are far better than anything Baen ever came up with), but he’s far from well known.

    Face it, the puppies are a US phenomenon fighting a US only culture war that has been foisted on international SFF fans.

    Never mind that Shaun and Aaron explicitly stated that the survey was in no way representative.

  14. Cora: How many commenters at Baen’s bar, the Mad Genius Club and Monster Hunter Nation come from outside the US? How many non-Americans opt to go to LibertyCon

    Exactly. I think a better source to approach would be non-U.S. fan sites like Rising Shadows.

    The fact that in order to get “balanced ideology” among respondents, you’d have to get U.S. surveytakers from sites such as airboy suggests, pretty much makes the point about the Puppies’ ideology being an American culture war phenomenon, rather than an international issue.

  15. Interesting! Thanks for sharing your research! Sounds like this was more of a feasibility/pilot study; hope you do more in this area!

  16. In terms of footnotes, I think that by far the best approach is the one used at fivethirtyeight.com: the note is a superscripted number that is a hyperlink. Click on the number, and the text moves apart, opening up white space in which the footnote text (styled differently to the main body text) now appears. The number becomes an x. Click on the x, and the article reverts back to the way it was.

    I don’t know what CSS wizardry is needed to do that, but I wish everyone used it.

  17. Baen will only be found in the specialized SF bookstores in Sweden (of which there are three in the whole country).

    All puppy authors were total unknowns for me before 2015 with the exception of John C Wright and Jim Butcher (if he can be counted as a puppy).

    It is a no-brainer that the Sad Puppies is an extremely american phenonena. Not that we don’t have cultural warsbin Europe and not that they aren’t partially linked, but the way the puppies expressed themselves were so uniquely american conservative that it poured out from their ears.

  18. For those rightly pointing out that the paragraph mentioning Montreal is incorrect, it should read as follows:

    “In retrospect, we probably shouldn’t have found this alarming given that only 6 (30%) of the Worldcons in the last 20 years have occurred outside of the United States. Of those 6, only 2 have been held in a country, state, or province whose primary language is not English (Nippon, Japan in 2007 and Montreal, Quebec, Canada in 2009). In total, only 18 (24.3%) of the 75 concluded or upcoming Worldcons have been or will be held outside the U.S.; 2017 will see Worldcon hosted in Finland for the first time (“The Long List”).”

    Honest mistake on my part. I should have caught it before I submitted it to Mr. Glyer. Thanks to those who caught it and corrected it in the comments.

    There are likely some quibbles to be had with that section anyway. Some places where English is the primary language may still have large populations who regularly speak a different language.

    I do agree that things are getting better, though for my taste, I would prefer Worldcons did more moving around 😛

  19. airboy, I attended cons for a decade in the 1980s and early 1990s, bought tons of SF and did not know the Hugo was a reader award which required a participation fee until just a couple of years ago when Sad Puppies 3 hit.

    The Hugos don’t require a “participation fee”. The Hugos are an award given by the membership of a specific convention. Saying that they require a “participation fee” implies that there’s a separate charge to nominate and vote for the Hugos. There isn’t. That’s like saying there’s a comics-page fee with the daily newspaper. Guess what? The comics page (if there is one) is INCLUDED with the newspaper. There’s no separate fee. You don’t pay extra for a daily newspaper with the comics page; they don’t offer “with” or “without” comics alternatives at the newsstand.

    The right to participate in Hugo selection is one of the many things that comes with Worldcon memberships.

  20. So this seems like a slightly relevant thread to post some news about Hugo-related academic work.

    The paper on E Pluribus Hugo by Bruce Schneier and I had made it through peer review when the journal that had accepted it (Voting Matters) suddenly lost its funding and retroactively folded. We were trying to pressure the editor who had accepted it to help us find another place for it, but it looks as if that’s not happening. We’re still planning to publish it in another journal, but sadly we’ll probably have to repeat the whole peer review process. However, it is our belief that the paper is still eligible to be nominated for Best Related Work.

    Title: A Proportional Voting System for Awards Nominations
    Resistant to Voting Blocs
    Author/Editor: Jameson Quinn and Bruce Schneier
    Publisher/Where Published: https://www.schneier.com/academic/paperfiles/Proportional_Voting_System.pdf

    (We don’t expect to actually win a Hugo, but we would be gratified to be on the ballot.)

    (Mike: if you saw fit to include this news, perhaps without the self-promotion at the end, in a pixel scroll, that would be fine.)

  21. The difference between a Fan and a Puppy-Fan:

    Airboy views various fan gathering places as belonging to one political camp or another.

    I look at ALL of those sites as places fandom goes; some have fans whose politics I disagree with.

    The insistence on making boxes and imposing political-belief-system litmus tests on fans is entirely non-fannish and an entirely puppy thing. So long as they insist on trying to divide fandom into us vs them camps, they will remain on the outside looking in.

    ***

    Thanks for the survey Messrs. Duke & Beveridge: you clearly and accurately identified the scope, limitations and issues. I think it a good start.

    ***

    Reticent as I am to criticize Mr. Scalzi, I do remember being “bothered” when he began his eligibility posts on his blog back in 2009? 2010?: I saw the needle he was trying to thread (bringing attention to eligible works while at the same time respecting fandom’s campaigning moratorium) and while I recognized it as perhaps the best way to go about accomplishing those ends, I also considered it to be a slippery slope. (Scalzi may not have been the first, but his was the first I became aware of.)

    This does not mean the responsibility for the puppies lies on his shoulders. THEY chose to step over the line (and to do so in a very negative, confrontational manner), but it was another step down that slope.

    Today we learned (In the Scroll) that yet another website and/or individual has gone from eligibility mention to voting request.

    There is no more slope.

    Hopefully, more influential and well-heeled institutions will not take this step, yet, but will instead wait to see the Helsinki results before deciding whether or not to spend marketing dollars on promoting works for Hugo votes.

    That’s the last step down that slope, and, unlike the puppy campaigns, it is a step that WILL render the Hugo Awards meaningless and suspect.

    I think we all really need to take a look at this situation: I hope that we collectively decide that we want the Hugos to remain the consensus of Worldcon attending fans and that we will act to discourage any further creep down that slope.

    ***

    In future, I have access to translators for the following: Spanish, German, Italian, French & Chinese, and can probably find resources for Japanese, Hebrew, Filipino and Russian.

  22. @Jameson Quinn

    The paper on E Pluribus Hugo by Bruce Schneier and I had made it through peer review when the journal that had accepted it (Voting Matters) suddenly lost its funding and retroactively folded. . . . However, it is our belief that the paper is still eligible to be nominated for Best Related Work.

    But if it didn’t actually get published in 2016, I don’t think it’s eligible for the 2017 Hugo Awards.

  23. Is it available to read anywhere? If so, I think it is published in a Hugo sense, even if not in an academic sense.

  24. In the countries table, the rank numbers are partially cut off, so that it goes 1, 2, 3, 4, 5, 6, 7, 8, 9, 0, 1, 2, … When they get to 20 and higher, I can see a small part of the numeral 2, but not the full numeral.

  25. Mr. Davidson:

    Thanks for offering help with getting in touch with non-English speakers. This was the most glaring flaw in our survey (from my perspective), so I want to do much more to reach a broader audience the next time I run a survey like this…which will definitely happen (and will be released much sooner).

  26. steve davidson: Today we learned (In the Scroll) that yet another website and/or individual has gone from eligibility mention to voting request.

    I saw a guy on Twitter asking people to nominate his novel for a Hugo because he’s got an illness which will eventually be terminal, his reasoning being (as far as I could determine from the things he wrote) that being a Hugo Finalist would enable the sales of his book to make the money he needs to pay for his ongoing medical treatment.

    While I sympathize, and I might contribute to a GoFundMe, I am not going to nominate a book for that reason. :-/

  27. From the report:

    quite a few held a similar position as the following: “I think the Puppies represent an older demographic that’s threatened by the growing diversity of the genre — or, I should say, the growing visibility of diversity that has always been there.”

    As I’ve said before, I think this assertion keeps getting made despite the facts, rather than because of them.

    Larry Correia, founder of the whole Puppies mess, was a new writer in his thirties when he launched SP1 and led SP2. Brad Torgersen was a new-ish writer of about 40 when he led SP3. RP leaders VD is about 45. The “elders” of the Puppy set (in terms of the “thought leaders,” so to speak) seem to be Sarah Hoyt and JCW–both of whom are 50-55. Paulk and most of the others appear to fall within that range. IOW, none of them are old-timers, and some of them haven’t even been around the sf/f community or publishing world for long.

    By contrast, many of the people publicly opposing and/or publicly disagreeing with Corriea, Torgersen, and VD are a full generation older, such as GRRM, David Gerold, Connie Willis, Eric Flint, the Nielsen Haydens, or of similar ages to the Puppies (including one of the prominent “SJWs” whom VD and Torgersen seemed most obsessed with, John Scalzi). While there were also younger people objecting to Puppies, there were a LOT people people opposing them who were their own age of significantly older.

    So I don’t think there’s any evidence for an older age group (or a corresponding longer span participating in the sf/f world) being a factor of Puppyness, let alone a common or defining feature of it. In fact, if anything, I’d say the opposite: many old-timers–even those who might share some sociolpolitical conservative views with some of the Puppies–disliked seeing the Puppies politicize the Hugos just as much as they dislike seeing anyone else politicize the awards, and they REALLY disliked seeing the Puppy ploy lead fandom into a large, longterm flamewar that made the Hugo Awards a target of ridicule and linked VD’s name and “ideas” with sf/f in the media.

  28. @Greg Hullender But if [Quinn and Schneier’s paper] didn’t actually get published in 2016, I don’t think it’s eligible for the 2017 Hugo Awards.

    @Andrew M Is it available to read anywhere? If so, I think it is published in a Hugo sense, even if not in an academic sense.

    Key language from the rules:

    3.2.1: Unless otherwise specified, Hugo Awards are given for work in the field of science fiction or fantasy appearing for the first time during the previous calendar year

    I read “appearing” with its common meaning, and the paper did appear for the first time last year (Internet Archive’s Wayback Machine has it in August of last year.).

  29. @Shaun Duke: Your amendment is still incorrect; 7 of the last 20 Worldcons have been outside the US (1999, 2003, 2005, 2007, 2009, 2010, 2014), not 6 of 20. If the dividing line is the US borders rather than the bounds of North America, 2003 (Toronto) also moves across. (I have painful reason to remember this — not just the … fun … of getting a major supply truck across the border and back through trucking companies of debatable competence, but a wild ride through the San Jose convention center to make sure that Boston’s shipment came back off the custom truck going to Toronto.)

  30. the paper did appear for the first time last year (Internet Archive’s Wayback Machine has it in August of last year.).

    Yes. In fact, it was linked from F770 (more than once, but here first.)

  31. Chip Hitchcock:

    You are correct. It should be 7 total, 6 in places where English is not the primary language. Got myself gummed up!

    Thank you for the correction

  32. Airboy says he never knew how the Hugos were voted on, despite having read lots of sf and attended lots of cons. I can only assume he just wasn’t interested. It certainly isn’t hard to find out.

  33. StephenfromOttawa: Airboy says he never knew how the Hugos were voted on, despite having read lots of sf and attended lots of cons. I can only assume he just wasn’t interested. It certainly isn’t hard to find out.

    I’d believe it if Worldcon was never one of the cons he attended — and I well believe, from the things he’s said here on File770, that he’s never attended a Worldcon.

    Many — most — book awards are juried, either at the nomination stage, or at the finalist stage, or both. It’s not surprising that people would expect the same of the Hugos. I’d known about the Hugos for years, but it was only when I decided to attend a Worldcon that I found out that I got to nominate and vote for them.

  34. Well, I was going from my own experience as someone who read a lot and subscribed to fanzines but never attended conventions when I was young. At some point fairly early on I absorbed the basic facts about who awarded the Hugo and Nebula Awards.

  35. StephenfromOttawa: Well, I was going from my own experience as someone who read a lot and subscribed to fanzines but never attended conventions when I was young. At some point fairly early on I absorbed the basic facts about who awarded the Hugo and Nebula Awards.

    As a counter-example, I’ve been a science-fiction reader and fan since a very early age, and I went to Star Trek conventions when I was young, but I never read fanzines (I don’t consider Starlog a fanzine, it was a prozine) until I came to File770 a couple of years ago. I would say that your fanzine connection is the one that makes your knowledge of Hugo voting procedures unusual as compared to the general fan populace.

  36. It just seems like basic information I’ve known forever, and I’ve assumed it’s also been this way for others. Perhaps mistakenly.

Comments are closed.