Tag Archive for 'metrics'

Great reads from around the web on December 2nd

I come across so many great conversations, ideas, and resources across the web ever day. Here are some of the most interesting things I’ve found recently (as of December 2nd). You can join the conversations in the comments, or click through to the original posts to find what others are saying.

To follow more of the things I find online, you can follow @amysampleward on Twitter (which is just a blog and resource feed), or find me on Delicious (for all kinds of bookmarks).

  • ReputationOnline » Blog Archive » Jonathan Waddingham on ‘Can you turn fans into consumers?’ – Jonathan Waddingham from JustGiving has a great post up today: "The advent of Facebook fan pages has been great news for brands wanting to create communities without having to build their own social network. In many cases, it’s largely pointless trying to create your own community when the people you want to attract are already part of another one… But what do you do with your fans once you’ve got them?"
  • How Facebook turns active users into community managers – without paying a dime (video) | Powered by John Haydon – John Haydon has a great post and video discussing facebook's strategic design that empowers users to be community managers. "You want to develop a stronger, more passionate community. You want your members to invite like-minded folks to join your community and you want the cultists to encourage others to be more active. You them to do both of these things regularly. And you want this all to happen naturally – because it won’t happen if you push."
  • Social Media Analytics: Twitter: Quantitative & Qualitative Metrics | Occam's Razor by Avinash Kaushik – "Twitter is amongst new media channels that are challenging how we communicate, with whom we communicate and perhaps most fundamentally how we (Marketers) influence people. … So in this post my hope is to share with you what is unique about measuring one such channel, Twitter. The blog post is also sprinkled with my own words of folksy wisdom as to how you should use the channel for maximum impact."
  • Is Your Organization Human Enough for Social Media? — SocialFish – "Social media can be overwhelming. There are so many tools, none of which you’ve used before, so you don’t have an intuitive sense of how they work, let alone if they are really helping you get the work of your organization done. And if you’ve gotten into these tools at all, you’ve probably noticed that they are not implemented in the same way as many other initiatives within your organization. You’re not sure who’s supposed to tweet or blog, and suddenly there are people outside of your staff who are saying things your staff used to say."
  • Three Ways You Can Help Build The Future of NABUUR | NABUUR Blog – "NABUUR exists so people like you can make a real difference for communities worldwide. With your contributions, you have improved the lives of countless others. You have proven it works. Now, your talents and time are needed to take the next step: make NABUUR itself self-supporting and driven by a global community of volunteers. In the last year alone, the numbers of volunteers and villages have doubled. Together, we learned how to connect, share and work together via the internet, without bureaucratic controlling bodies. NABUUR is following this path itself: already, many of you have taken over work that previously required office staff. And a bold next step is ahead! From January on, NABUUR will be volunteer-run: no more office staff. The NABUUR platform will remain online, and limited central support will still be available, but how it will develop will be up to the community to decide."

Live Blogging: 09NTC Mapping Your Social Media Strategy

I’m here at NTEN’s 09NTC and am going to live blog Beth Kanter’s session on mapping your social media strategy to metrics.  Below is the live blog or the archive of the live blog.  Can’t wait!

The internet connection here is such that I don’t think a live blog portal will sustain itself.  So, I’m going to trouble shoot and just take some live notes here and post them as soon as possible.

Here goes…

Take aways:

  • How to use listening
  • The right metrics
  • Analytics tools

Panelists:

  • Wendy Harmon: social media manager, philosophy is to use social media to execute mission
  • Danielle Brigida: using social media to increase, reach, engagement and revenue
  • Qui Diaz:Livingston, recently did research for the Philanthropy 2.0 report
  • Sarah Granger: advise nonprofits on using social media for advocating and communicating

Themes that people want to learn:

  • new metrics structures can bubble up
  • funders of a 20th century mindset – what metrics speak to them
  • what things need to be measured
  • obama reach vs local reach
  • industry benchmarks
  • how to integrate tools without reinventing the wheel
  • success stories

List, Learn, Adapt – concept from David Armano: “Insight must before investment when implementing a social media project.”

Visualizing: number of months along the bottom, insight, return and dollars up the left

  • Listening: hearing what people are talking about your issue or sector
  • Learning: evaluating what is being said and what information is needed
  • Adapting: using the listening and learning to inform how you change

Listening

  • use monitoring tools
  • know your keywords
  • use your RSS reader
  • engage and monitor responses
  • engage internally

Discussion:

How/why does listening provide value?

  • at ARC, listening has been the core value of our last three year’s of social media (mentioned online over 400 times a day), learn what people want and expect from us
  • at NWF, listening has been the foundation of our social media movement, we are nothing unless someone thinks we are something
  • everything before lays the foundation, everything during and after helps you improve and change your strategy
  • listening has been to the community and to the quantitative results

How do you use a RSS feed like a rockstar?

  • pull in hashtags from Twitter into the RSS reader (pull in the RSS of a search.twitter.com result)
  • skim a lot, mark all as read liberally, don’t feel like i have to ingest everything

Listening based on location?

  • ARC does for blood drives, etc.

How do you share your data?

  • ARC – gather data every morning and share with organization via email; issues that seem sensitive or are newsworthy will contact subject matter experts to follow up
  • ARC – social media team evaluate/watch everything and then send summary and highlights to team
  • NWF – tag mentions in delicious with which programs or projects are mentioned, can share link to that tag on delicious with staff to see their section
  • Sarah – use google alerts and a page that we update with mentions
  • Qui – for clients that are larger, we set up media citation reports (like a word doc with titles and links and relevant info about the mentions and how they should respond)

How much time is spent listening?

  • ARC – 33,000 employees, budget is over a billion $, 2-3 hours of concentrated listening every morning and then ambient listening all day
  • NWF – 363 employees, budget is around 90 million, one hour every morning and then throughout the day (google alerts and rss every morning, then if there is something that happens throughout the day)
  • Livingston – encourage small nonprofits to have at least a half time person doing listening and response (10 hours a week)
  • Sarah – budget is 100,000s, 50% of the time we are listening, 15-20 hours a week personally listening

Listening tools:

  • Netvibes
  • Feed digest

Learning

  • Think like a rocket scientist, document or journal your learnings
  • Observe and sift through qualitative data like a primatologist or anthropologist

Beth’s learning process:

  • document on the fly
  • test and teweak
  • pick the right metrics
  • harvest insights
  • look at what other nonprofits are doing in the space
  • pause for reflection time before next reiteration: how to improve results?

Engagement metrics:

  • create
  • comment
  • click
  • collect
  • critic

Think about which things you really need to track and measure those, not everything you could possibly track.

Discussion:

What is your learning process from social media? How do you involve the org?

  • NWF – ad hoc, if you look at programs individually it is based on qualitative over quantitative, we adapt when we hear people saying i wish it was like this or i could do this
  • Livingston – listening is everyone’s job, might start with social media person or dept but eventually want to make sure everyone is out there and closing the feedback loop
  • Sarah – share by email because we are an online organization, can have a spreadsheet with stats and how they are growing, organization wide as well as campaigns, etc.

Examples:

  • Yammer for internal sharing, it’s a Twitter for groups
  • Delicious

What are some specific stories for using the right metrics:

  • ARC – the right metrics are those that help you identify if you have reached your goals, so if you have a goal to offer real time information to the public in times of disaster for example, the measurement is if peole get the info they need (not fundraising or anything else), so we do that by asking them and collecting metrics like how many people retweet information on Twitter, etc. over time have gotten other metrics and impact from working on this goal
  • NWF – focus on engagement, program called Wildlife Watch and is a space for people to share wildlife they see so asked people to use #nwf on twitter when they see wildlife, will track how many times the hashtag is used each day (hashtags.org) we use bit.ly and pop.url for tracking retweets (Check out Laura Lee Dooley’s URL shortener report!)
  • Livingston – corporate example, Network Solutions, negative perseption issues related to their brand (google your organization’s name and “sucks” and see what comes up!), assessed the conversation and they had a 58% negative blog/conversation ratio (used manual researching, icerocket, forumtracker, search.twitter, etc.), new that was the metric/goal to track and 6 months later there was only 18% negative ratio
  • Sarah – presidential commition on women in legisltation, legislator read our email wanted to do it and wrote a bill, so to raise awareness and support we asked people in membership what they wanted to see, asked them to come to us, gave qualitative feedback, had a tweetcast with feedback on Twitter, used facebook and tracking membership and

WeAreMedia Project (http://wearemedia.org/) has a listening toolbox!

Distinction between what you think they want to hear and what they want to know – can you address those separately?

  • Livingston – HHS, wanted evaluation of pandemic flu conversation online, point was to understand what they were saying about the government and so on to really know what to address as an organization to that community

Culture change:

  • NWF – social media is good for engagement but not always the engagement you expect, users on myspace and did a survey with all the members but only 400 responded and the boss wanted to discontinue social media work; don’t always need to hear what every person needs if you have that one person who will really tell  you useful things; there’s still community on myspace so we still update that blog and use the platform
  • Sarah – a lot of resistance to social media in political groups, the key is biting off small pieces and educating people one at a time, finding someone to train and working with them so that they can educate another person
  • organizational change is slow, you have to have patience, opinion starts to change once you find influencers within

Nonprofit staff are so overwhelmed, how many groups have someone to measure social media?

  • survey in room: most prevalent is 20 hours/week with other job duties

Co-creation Networks, look at the ladder of engagement and the number of use and the level of engagement – need all of them in your ecosystem

Clicking = good – a change in knowledge doesn’t equal a change in behavior; can you measure that?

  • NWF – greenhour.org so we share it with people in a newsletter and then see activity in a blog – we can’t see that they really did it in their home, it is hard to measure, but we are still seeing what seems to be real actions – don’t be afraid to ask!

Are there ways of catching offline datapoints?

  • NWF – every program we have has an offline component, i try to integrate a social media strategy that leverages and encourages the offline part; like #nwf wildlife watch, raises your awareness offline if you can see something and tweet it, etc.
  • ARC – it’s easier for us to suck in what people are already doing because we have found that it’s nearly 100% chance for people to give blood and then talk about it online if they have a space online
  • Livingston – if you don’t have their email, call them, keep asking questions but it is labor intensive

Adapt

Fail formally – protesting Wendy’s with a photo sharing with a protest sign but only got a few people doing it, heard so much about how hard it was for people to participate, etc. but didn’t stop doing photo contests; instead they adapted.  next, with LOLseals campaign, they made it as easy as possible for people to participate, used the Flickr API to allow people to upload from their website instead of going to Flickr, etc. this time they got 3,000 photos and 2,500 email address.  But don’t do it again just because it worked, keep evolving. Facebook app for spay day, upload a photo of your pet and then do fundraising for the Human Society with people voting on your pet’s animal. 13,000 installs of the facebook app, and $600,000 raised.

Discussion:

How have you reiterated?

  • Livingston – Network Solutions, free online video event, know who will send the most traffic second time around
  • NWF – we are still very new at this, there haven’t been a lot of programs, the photo contest is slowly moving online; we tweak all the time though, you can’t be satisfied because you can always make it better, like with #nwf as it got more participation we moved the stream onto our website
  • ARC – we have very few campaigns like Carrie’s at HSUS, but we tweak constantly, today everything is 100% different than a year ago but it was all very small tiny changes
  • HSUS – integrated it with everything else, email campaigns/newsletters, offline, etc.

Any resources to move from national to local?

  • ARC – we are set up similarly, Robin Parker does Oregon Trail chapter for example

How do you change around from failure?

  • NWF – there is no failure. everything can be taken to scale. you have to learn from everything, if it doesn’t work one time it could still work another time. have to decide if it is worth investing in.

Have you seen examples of your org changing?

  • NWF – initially i was the outcast, driving traffic but being sneaky; you need buy in to really do it. for some people it’s intuitive but others it isn’t. we had a COO who noticed social media was important and moved me to the education dept, if you are in marketing and someone says not to do it, keep doing it! i have changed my role a bit so that i serve as a consultant internally to get people started. i don’t want to force people, if they don’t want to do it, then they don’t have to.  if it isn’t natural then it won’t work.
  • Sarah – worked with a tech oriented nonprofit, had an old tech faction and the new tech faction; eventually we just got new people on and they wanted new, too so you just move on.
  • Beth – learning a lot from resisters now and strategies for it. have to have bottom up way of organizing social media but also evolve into a star fruit so that it goes all directions.

What is your ONE takeaway?

  • be more intentional
  • failure is adapting
  • tools in context
  • when you miss in battleship you take another shot
  • want to embrace failure
  • all about relationships
  • delicate balance between involvement and take over
  • take chances
  • they can’t control people when they are taking part
  • metrics spring from your goals
  • listen more
  • even one voice can give you great insight
  • if you are really interested in this stuff and you see the opportunity at your organization, just try it and see what happens
  • metrics bubble up
  • even if people say the same thing loudly doesn’t mean the minority isn’t speaking too
  • reminder to talk to eachother

Thanks!

From TechPresident: Facebook Haggadah: A Case Study in Viral ROI

Micah L. Sifry, the co-founder of Personal Democracy Forum, took a closer look at ROI for Facebook apps in his piece last week Facebook Haggadah: A Case Study in Viral ROI (Is This App Different From All Other Apps?) for TechPresident.  He sent his thoughts around asking for feedback and I was more than happy to share some ideas on the subject.

Here’s an excerpt from his post:

Within a day his Facebook Haggadah was all over the web. It looks like David Bernstein at the Volokh Conspiracy was the first major blogger to post about it, Monday at about 5pm, and AllFacebook’s Nick O’Neill tweeted about it two hours later. Soon it was being retweeted all over Twitter, and for good reason.

If you’re Jewish or you’ve ever been to a seder, Elkin’s retelling of the story is hilarious. It’s also deeply in tune with a longstanding Jewish tradition of modifying and updating the Haggadah to grapple with modern times and norms (see Arthur Waskow’s 1960s “Freedom Seder” for more on this history). I thought it would be interesting to take a look at the viral spread and impact of Elkin’s spoof, especially as it turns out that he had a serious goal in posting his parody, which is to get people involved in fighting global warming and in particular to draw users to a Facebook app he spent months writing called “YesWeConserve.com.” The app is designed to help people find and share popular energy-saving ideas, and reports that its users have collectively so far made “186 pledges to save $6243.27 and 22735 kilograms of CO2 per year.”

Elkin reports that his Facebook app Yes We Conserve has gotten about 5,500 visits as a result, but only 233 people have installed it. He notes that people can use a lot of the app’s functionality without installing it, “which is what most people do.” But he’s disappointed in his conversion rate.

Why is This App Different From All Other Apps?
Should he be? It seems to me that Elkin did pretty well in gross terms, considering that his conservation app isn’t much related to a satirical retelling of the Passover story, and in essence is functioning more like an interstitial ad than anything else. Getting nearly 4% of the people who looked at the Haggadah to click through to YesWeConserve, and then getting about 4% of that group to adopt the app seems like a decent conversion rate for something that cost him nothing to promote.

You can read the full post here.

These were the thoughts I shared with Micah:

I think that social media has created an outlet for individuals to cause-align in a way that replaces the brands of clothes you wear to be judged at school, with the issues you are passionate about to be judged online. I’m not the only one seeing this trend, though, and that’s why there are SO many Facebook apps to get people connecting their individual online space with social actions they care about. What I’m sensing is that many people are overwhelmed with apps—ones their friends keep inviting them to use, ones they accidentally click on, ones they want to use but none of their friends are using, and so on. The way to unmuck the water could be to focus in on apps that let users broadcast an array of issues and opportunities from one little box, instead of installing and managing lots of little boxes.

I think 4% is great for the YesWeConserve application! I’d certainly be proud! But, given what I just said, I’d also think about how that application could create a more user-drive, dynamic space within that 400×400 box to reassure users that adding it to their profile isn’t a wasted five minutes.

What do you think?  What questions about ROI do you or your organization have when considering the build or integration of a Facebook app or similar tool?  Have you seen apps that you really like?  Ones you really don’t like?  You can read Micah’s full blog post here.

Would love to hear your thoughts!

Five Steps to Finding ROI

Many organizations struggle with the idea of ROI and metrics when it comes to social media because so much of it feels, well, untouchable.  It’s soft and maliable and relative, pretty much all of the time.  So, how do identify if you are succeeding or evaluate if you are improving?  Here are some steps that you can walk through either as an individual looking at this process, or as a team in a workshop setting.

First, let’s settle on an example we can use to walk through all 5 steps:  you work for a small nonprofit that focuses on early childhood education, so you have lots of services for parents and partnerships with hospitals, child care facilities, and doctors offices.  You also have a volunteer program for middle and high school students to work with the children in after-school time in lieu of child care, but find that the current partners you have in the community don’t work for attracting new volunteers to participate.

1. Problem

We are usually pretty quick to highlight problems, so this is probably the easiest step!  Be sure to focus in on the problems you plan to address with your social media strategies (we all want to change the world, but that’s not a specific).  In our example, our problem is that we don’t currently reach those who could participate in our volunteer program.  Our partnerships and current communication streams aren’t ones that would easily get the attention of or shared by that group of middle and high school students.

2. Strategy

The next step is highlighting the strategies that specifically address the problem.  These 5 steps assume that your organization has already used a process to evaluate your audience and your goals and chosen tools and strategies that match the audience and organizational goals.  Assuming our fictional organization has done this, let’s say that they chose to create a blog that the middle and high school students who volunteer in the after school program author, with stories form their work, things they are thinking about, events, friendships, and so on.

3. Benefit

The benefits? These are both tangible and intangible.  It’s also important to remember that there will probably be benefits to your work that you can’t identify know or foresee!  Some of the benefits of the strategy in our example could be: opportunities for volunteers to share their stories, more word of mouth advertising, and more shared learning about the program both amongst the volunteers as well as between the volunteers and the organization.

4. Value

If we were drawing our five steps out on a white board or piece of paper, our next column would be for the values related to the strategy and benefits.  In our example we could identify a core value of connections and “community” growing around the volunteer program.

5. Metrics

So now, finally, we get to the metrics.  By charting out the problems, strategies, benefits, and values first, we give ourselves a better picture to pull out metrics. Given the answers to 1-4 of our example, some of the metrics we could use to measure our success and ROI include: volunteer participation, online “chatter,” and program growth.  So, how do we measure those items?  We can look at the number of middle and high school students applying for the volunteer positions.  We can measure how many people are reading the blog and sharing the information across the web.  We can also look at other online mentions that talk about the organization as a whole, or other programs of the organization that also link to the new blog.

In this example, we are using a blog.  Whether it’s a Wordpress, Blogger, Typepad, or whatever, you have access to built-in web analytics or the option to use Google Analytics.  There are lots of resources online that shed light on the different terms and tricks to diving into your web analytics.  But, even a beginner can identify the number of unique visitors to the site.  Setting up Google Alerts for the blog address and title will help you catch whenever other bloggers or organizations mention the blog on their sites.  Tracking how many of your volunteers participate by posting to the blog and commenting on each other’s posts + other online mentions + increase in inquiries and volunteers, etc. combines both online and offline measurement and values so can help you more thoroughly evaluate both the strategy and how to address the original problem.

Remember, your strategies should be integrated online and offline, and so should your metrics.

And then there’s Advocacy

As promised, I wanted to share some thoughts on the advocacy data included in the 2008 eNonprofit Benchmarks Study from M+R and NTEN (you can read about the email campaign data and the fundraising data, too).

Email Advocacy
The average rate for page completion (filling in a form, etc.) increased from 85% in 2006 to 89% in 2007. Things like improved layout and design of advocacy pages could be the reason for the increase, or that supporters are more comfortble/used to the forms and what to expect when clicking through to the page. I think it is also important to think about the inclusion of auto-complete/fill information either from a personal option on the users’ computers or through a cookie from your site.

Taking Action
Environmental and rights organizations each had about half of their membership taking action in 2007. That is well ahead of health and international organizations. Often, it is hard to simplify the best reason or couple reasons that contribute to the high action rates. Of course, doing everything ‘right’ doesn’t hurt! I suggest signing up on the list for organizations or campaigns that strikes/surprises/motivates/impresses you outside (or in) your sector of work and learn from the ways it is done – how the emails are done (how many, about what, etc.), how you are called to action, how you are rewarded for action if you do take it, etc.

One statistic that is very important to learn from is that of those who are active members, 13% are categorized as ’super activists’ but those 13% account for 42% of the action taken (in 2007). These super activists comprise about 5% of an organization’s list. These are very important members. That much goes without saying; but, what does it mean for your organization’s interaction with them? It’s important to investigate and develop ways for super activists to do the work of cultivating less active or inactive members into taking action, so that you don’t have to. Building a system for interaction between members can allow for further actions that include inviting others to become active when you do, or suggesting actions to your contacts, etc.

Case Studies
#1. Human Rights Campaign

The HRC increased its advocacy response rates in 2007 by a full percentage point and contribute this increase to segmentation of its list. It split the list into five sub-lists based on the members’ past activities/interactions with the organization. HRC could then communicate in a more tailored way with the members on each list.

Today, everyone on the list gets one advocacy action and the one email newsletter per month, plus a fundraising campaign every 2-3 months. Beyond that, audiences for emails are based on demonstrated interest. For example, extra action alerts only go to people who’ve already shown an interest in that issue and to core activists (who have taken 5+ online actions in the page year). Special fundraising campaigns target recent donors. Higher-threshold actions like phone calls and letters to the editor never go to inactives.

Even though there may be fewer people receiving an important action, it is directed at the members more likely to actually do it, instead of becoming another email to someone frustrated by action alerts who only subscribes for the news and information.

#2. Environmental Defense

ED noticed that they were earning 40% of their dollars in the year-end and that people gave at the same rate regardless of how many emails when looking at the data from three consecutive Decembers. In 2007, they took a random 15% of their list and those members received only 3 messages while the rest of the list received 13 (between Thanksgiving and December 31st). The group receiving only 3 messages had a lower donation rate so they plan to do further list testing to find the ’sweet spot’ with their members. What has been the result of list tests like this; if you haven’t yet done any segmenting or testing, do you plan to?

An interesting test that ED conducted on their website took place right on the home page. They used a graphic with polar bears and a call to action for contributions, in one instance, and in the other simply put the donation form in the same spot (top, center of the home page). What they noticed was an increase of 8% more gifts with the donation form, 8% more donations of $1,000 or less and 10% more donations of %500 or less. The lesson they learned was to just put the option completely in front of the visitor, take out all possible clicks, and let them decide right away if they are going to give or not.

What has been the best advocacy campaign/call to action in the last year at your organization? What data did you collect (either quantitative or qualitative) that helped you plan for the next one?

Link round up

Here is a quick list of a few things on my radar, that I think should also be on yours! :)

Mapping – The Wild Apricot blog has a great post featuring three ways nonprofits are using maps.

Marketing – The Nonprofit Communications blog tells you about a five-step strategy to market your nonprofit online.

ROI – Have you checked out Care2’s Frogloop blog’s Social Network ROI calculator before? If you haven’t, you should!

Case Studies – Beth keeps a great wiki and shares case studies of nonprofits using social media.

Fundraising – Peter Deitz has picked up on a disparaging mood about peer-to-peer fundraising, what are your thoughts?