statistics

Audience 2.0, Part II: Thoughts for the Future

Check out Part I for an overview of the NEA’s recent report Audience 2.0: How Technology Influences Arts Participation While Audience 2.0 gives some useful statistics on technology and media participation in the arts, the report does not provide the answers or the data that I am looking for regarding arts participation and technology.

  • How does arts participation through one technology affect participation in other technologies?  For example, how does participating through television affect web participation?
  • What impact has social media had on arts participation?
  • How do people participate in the arts digitally and online?  What are they doing on the web when they are participating?
  • Has participation in the arts via technology affected online giving to arts organizations?

Audience 2.0 draws into question the timeliness of national arts research, the vehicle being used to conduct this research, and the understanding of where arts audiences are heading in the future. This report was a useful audience analysis for 2008, but the survey upon which Audience 2.0 bases its analysis lacked a sense of forward motion as well as the ability to predict future arts participation through rapidly changing technologies.

The data used in Audience 2.0 was gathered three years ago before many current technologies were available and before many new technology users had invaded the digital market.  In his blog post Back To The Future, on Danceusa.org, Marc Kirshner states that:

Since the beginning of the 2007 survey period [for the 2008 report]:

  • Four generations of iPhones have been released [and the Android network has been launched]
  • Facebook’s user base has grown from 20 million to 400 million users
  • The entire book publishing industry has been turned upside down by e-readers, such as the Kindle, Nook and iPad
  • Millions of set-top boxes, Blu-ray DVD and home theater PCs have connected televisions to broadband Internet
  • Hulu launched its online video service to the public
  • More than 300,000 people viewed simulcasts and encores of the Metropolitan Opera’s Carmen
  • The first 3-D network began broadcasting

The three year time gap between data collection and report publication created a lack of focus on many forms of new media and social networking platforms currently leading many technology discussions in the nonprofit arts industry today. Correspondingly, the relevance of the report in our current environment is brought into question, and we must remember that the report represents a snapshot in time more than a study of current habits. Due to the speed with which technology advances and its usage changes, traditional forms of data collection and publication no longer appear as useful for tracking these trends.

The survey asks about participation in the arts through technology, but Audience 2.0 does not provide answers about specific actions and their effects. The survey does not ask participants if electronic and digital media makes them more or less likely to attend a live event, but the report draws based upon a perceived correlation in the participation data. Without causality data, this correlation leaves us with a “chicken or the egg” dilemma.  Does electronic/digital/online participation in the arts lead to an increase in live participation, or are participants in live arts events simply more likely to participate in electronic/digital/online arts events?

I would like to see more direct questions being asked of people who responded that they participated in the arts through electronic and digital media. Obtaining this next level of understanding will provide us with a deeper understanding of the effects of electronic and digital media on arts participation.

Audience 2.0 raises more questions than it provides answers, but it does show a commitment on the federal level to assess the impact of technology on the arts. I am hopeful that future reports will delve deeper into the seemingly symbiotic relationship between technology and arts participation by focusing more specifically on the  digital/online arts participant.

Home Page Call To Action Survey

Though it might be debatable, it's a commonly held belief that the home page is the most important page of a Web site. A home page must quickly communicate the soul of an organization to a visitor and provide a visitor with easy access to relevant information. Often, it is the most vital and heavily trafficked piece of real estate on your organization's Web site. We recently wondered: how effectively are performing arts organizations in the field using their home pages?

We conducted a survey that examined three common calls to action that we believe all performing arts organizations should have prominently placed on their home page:

  • ordering and purchasing tickets
  • donating or contributing money
  • joining or subscribing to a mailing list or newsletter

These are three actions that most performing arts organizations want their Web site visitors to be easily take. So, just how easy are their home pages making it?

We were also curious to see how many organizations were still using splash (Flash introductions or animations, slide shows, etc.) or landing pages that delay the visitor from getting to the actual home page.

Click past the jump for more information on how we conducted the survey and for the results.

Methodology In all, we looked at 450 home pages of performing arts organizations across the United States. All 50 states and the District of Columbia were represented. There was a mix of dance, theatre, musical theatre, opera, symphony, and choral companies.

We asked two different people to review each home page for links or areas relevant to the three calls to action described above. They then scored each call to action using a scale of 0 - 5:

0 - Not on home page 1 - Hardly noticeable 2 - Somewhat noticeable 3 - Noticeable 4 - Very noticeable 5 - Immediately noticeable

We also asked reviewers if there was a splash or landing page prior to the home page. Finally, we gave the reviewers an opportunity to provide any general comments or thoughts on the home page and its design.

The Reviewers We used workers on Amazon.com's Mechanical Turk service to perform the reviews. 44 unique workers participated in the survey responses. At least two unique workers reviewed each home page.

I'll be talking about our experience with Mechanical Turk in a later blog post. To summarize, Mechanical Turk is a service that allows you to set up and pay workers for completing repetitive, simple tasks, such as a survey, that can be accomplished by a human computer operator.

Because of this crowd-sourcing approach, we manually reviewed the resulting data. We investigated and eliminated some data points due to inaccuracy or due to large discrepancies between to the two individual reviews for a home page. Ultimately, we ended up with valid reviews for 429 of our 450 home pages.

Results The detailed results are below. I was surprised at how well performing arts organizations are doing at making tickets available online. The results are quite strong in that area. The fact that 4.9% of organizations still have splash pages makes me cringe a bit, since I am completely against them. (Why make your users work harder to get to the information they care about?)

Another area where the results surprised me was the reviewer comments. The comments were optional and required that the reviewers spend some additional time to complete their response; given the nature of working as an Amazon Mechanical Turk, time equals money. Some of the comments were really in depth and revealing. This might be a reflection on the quality of the Mechanical Turk service, but it could also be due to the reviewers being excited about contributing and giving feedback to performing arts organizations.

If anyone has any questions about the results or would like any additional information about the methodology used in this survey, please post a comment.

Download Raw Call To Action Survey Data (CSV)

Overview
# of Home Pages Reviewed 429
Splash Page
% of Sites with Splash Page 4.90%
Ordering and Purchasing Tickets
Average Score 3.0
% of Home Pages with a Score of 0 16.8%
Donating or Contributing Money
Average Score 2.5
% of Home Pages with a Score of 0 21.9%
Joining or Subscribing to a Mailing List or Newsletter
Average Score 1.6
% of Home Pages with a Score of 0 38.7%
Reviewer Comments
% of Reviews with a Reviewer Comment 36.60%
% of Comments that were Positive or Neutral 54.1%
% of Comments that were Negative 45.9%