CoolData blog

4 November 2013

Census Zip Code data versus internal data as predictors of alumni giving

Guest post by Peter Wylie and John Sammis

Thanks to data available via the 2010 US Census, for any educational institution that provides us zip codes for the alums in its advancement database, we can compute such things as the median income and the median house value of the zip code in which the alum lives.

Now, we tend to focus on internal data rather than external data. For a very long time the two of us have been harping on something that may be getting a bit tiresome: the overemphasis on finding outside wealth data in major giving, and the underemphasis on looking at internal data. Our problem has been that we’ve never had a solid way to systematically compare these two sources of data as they relate to the prediction of giving in higher education.

John Sammis has done a yeoman’s job of finding a very reasonably priced source for this Census data as well as building some add-ons to our statistical software package – add-ons that allow us to manipulate the data in interesting ways. All this has happened within the last six months or so, and I’ve been having a ball playing around with this data, getting John’s opinions on what I’ve done, and then playing with the data some more.

The data for this piece come from four private, small to medium sized higher education institutions in the eastern half of the United States. We’ll show you a smidgeon of some of the things we’ve uncovered. We hope you’ll find it interesting, and we hope you’ll decide to do some playing of your own.

Download the full, printer-friendly PDF of our study here (free, no registration required): Census ZIP data Wylie & Sammis.

10 March 2011

Gifts of stock as a predictor of Major Gift potential

Filed under: Major Giving, Model building, predictive modeling, Predictor variables, regression — Tags: , — kevinmacdonell @ 6:09 am

(Image used via Creative Commons license. Click image for source)

In an earlier post, I wrote about giving-related variables and whether or not they’re okay to use in a model that is trying to predict giving itself. (My answer was “it depends”. See Giving-related variables: Keep or leave out?) Today I zero in on a specific example: gifts of securities as a predictor of major giving.

Following the logic of my earlier post, if the sample of people whom you intend to score includes non-donors, and you want non-donors to have a chance of making it onto the radar, then you must rule out ‘Gift of Stock’ as a predictor. Why? Because you want to keep any proxy for your outcome variable (the Y side of your equation) out of the predictors (the X side of the equation), as much as possible. A ‘yes’ for ‘Has made a gift of stock’ is possible ONLY for the donors in your sample, and will provide no insight into a non-donor’s potential for major giving.

But giving-related variables are frequently used to predict major gift potential. Gift count, first gift, recency, and stock gifts are all enticing predictors. You have a decision to make: Do you exclude non-donors, or leave non-donors in and forgo the potential predictive power of these variables?

For some the answer might be easy. If the vast majority of major donors to your institution had some prior giving before making their biggest gifts, and a major gift from a non-donor is extremely unlikely, then it makes sense to exclude non-donors. This makes most sense for alumni models: Alumni who are solicited every year and don’t give are rather unlikely to turn around and give a million dollars. (Although it happens!)

You can avoid having to make the decision, however, if you build two models: One including non-donors (and using no giving-related variables), and one excluding them (freeing your hand to use giving-related variables). That’s what I do. I test the output scores against a holdout sample of major donors, and whichever model outperforms in scoring the major donors will be my choice for that year.

Let’s say that at least one of your models is a donor-only model, and you’re itching to use ‘Stock gifts’ as a predictor. Hold on! You’re not done yet. You need to evaluate the degree to which ‘Stock gifts’ is independent of your DV. If the variable equates to major giving itself, it is not at all independent and should be excluded. It is merely a proxy for being a major donor.

It’s clear that stock givers are different from other donors. In the data set I have before me, alumni who have made at least one gift of stock have median lifetime giving of about $40,000, compared with all other donors’ median giving of about $170. More than 66% of stock donors have lifetime giving over $25,000, and more than 90% of them have made at least one gift of $1,000 or greater.

The fact of having given a gift of securities cannot seriously be considered “independent” of the DV, but the degree of non-independence varies with how the DV is defined. If I define it as “LT Giving over $25K”, I’m probably in the clear, because a considerable portion of stock donors (34%, in my data set) fall outside the definition of my DV. If my DV is “One or more gifts of $1K or greater,” however, I should steer clear of the stock-gifts predictor. True, not all stock donors are in the DV, but almost all of them are.

Stock donors probably represent a very small percentage of all your donors, so the variable may have little influence either way: Not a high-value predictor, but not a damaging one, either. (Given the limited number in your sample, the correlation coefficient is going to be pretty low.) Maybe if 85% of the stock donors were in my DV, instead of 90%, I might go ahead and use it. So in the end, it’s a judgment call based on what seems to make sense for your data and what you hope to get out of it.

23 April 2010

The big list: 85 predictor variables for alumni models

Filed under: Model building, Predictor variables, regression — Tags: , — kevinmacdonell @ 10:06 am

Here is my attempt at compiling an exhaustive list of every predictor variable I have ever tested in the environment of my data – 85 of them! Not every variable is listed separately – some are grouped together by type or source. In some cases I’ve indicated whether the variable is an indicator variable (0/1) or a continuous variable, as necessary. A few variables are peculiar to the institution where I created my models. Variables that came from external sources are marked with an asterisk.

Some of these predictors were never used in a model because they were eclipsed by other, related variables that had stronger correlation with the dependent variable. Others (such as gender) proved problematic and were left out of my models for specific reasons. And some were tested and found not to be predictive at all. (A final model may contain only 15 to 20 good predictor variables.) Still, I include them all here, because any one of them might add value to models you build for your own data.

Also note: A number of predictors, listed at the end, are based on giving history. These are NOT to be used when your predicted value is ‘giving’. These variables were used in other models, such as Planned Giving potential and likelihood to attend events.

  • Class year
  • Earned a degree / Did not earn a degree
  • Number of degrees earned
  • Faculty is Education
  • Faculty is Business
  • Faculty is Arts
  • Faculty is Science
  • Spouse name present
  • Spouse is an alum
  • Spouse has giving (0/1)
  • Spouse lifetime giving (continuous)
  • Student activities present (0/1), eg. athletics, etc.
  • Number of student activities (continuous)
  • Religion present (0/1)
  • Religion is Roman Catholic (0/1)
  • Number of refusals to pledge
  • Refusal reason ‘will handle donation ourselves’
  • Requested to be excluded from affinity programs
  • Requested to be excluded from phone solicitation
  • Preferred address type is ‘Business’
  • Seasonal address present
  • Number of address updates
  • Address is in U.S.A.
  • Address is international
  • Province is Nova Scotia [also tested variables for other provinces]
  • Postal code is rural
  • Postal code is urban
  • Variables based on specific PSYTE cluster codes*
  • Has ‘Found’ code (i.e. records researcher has had to locate alum marked lost)
  • Prefers to read alumni magazine online (‘Green’ option)
  • Home phone number present
  • Business phone number present
  • Mobile phone number present
  • Seasonal phone number present
  • Number of phone updates
  • Home phone number is on Canada’s National Do Not Call Registry*
  • Email present
  • Number of email updates
  • Gender
  • Female-widowed
  • Female-married
  • Marital status ‘married’
  • Marital status ‘single’
  • Marital status ‘widow’
  • Marital status ‘divorced’
  • Marital status – other
  • Name prefix is “Dr.”
  • Name prefix is “Rev.” (or other religious)
  • Name prefix is Hon., Justice, or similar
  • Length of entire name
  • Nickname present
  • First name is single initial
  • Middle name is single initial
  • Suffix present
  • Cross-references present (0/1)
  • Number of cross-references (continuous)
  • Has attended Homecoming (0/1)
  • Number of Homecomings attended (continuous)
  • Number of President’s Receptions attended
  • Position (i.e. job title) present
  • Employer present
  • Number of employment updates
  • Employment status present
  • Employment status is ‘retired’
  • ID number begins with ‘F’ (faculty)
  • Registered as a member of the alumni online community
  • Participated in Alumni Engagement Benchmarking Survey* (0/1)
  • Engagement Survey score (continuous)*
  • [Numerous variables created from specific Engagement survey questions, including the following specific ones]
  • Lived primarily in residence while a student [survey]
  • Received a scholarship or bursary [survey]
  • Number of children under 18 [survey]
  • Enjoys speaking with student callers for Phonathon [survey]
  • Likely to attend Homecoming [survey]
  • Likely to attend an event in their area [survey]
  • Holds degrees from other universities [survey]
  • Number of close family members who are also alumni [survey]
  • Span of giving (last year of giving minus first year of giving)
  • Frequency of giving (gifts per year during span of giving)
  • Number of years in which gifts were made
  • Lifetime giving
  • Number of gifts
  • Recency: Gave in past year
  • Recency: Gave at least once in past two years
  • Recency: Gave at least once in past three years

Every year I discover new data points hiding in our database. Many other variables are out there, but often the data exists only for our youngest alumni. Someday, I’m sure, this additional data will yield cool new predictors. For ideas on other variables to look for in your data (including non-university data), refer to the list that begins on page 138 of Joshua Birkholz’s book, “Fundraising Analytics.”

The Silver is the New Black Theme. Create a free website or blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.

Join 1,082 other followers