The effect of encouraging messaging on duration and retention in a debt management plan

Interventions
Encouragement outreach
Experiment Type
Field Experiment
Goals
Increase program retention
Outcomes
Reduce debt
Focus Areas
Marketing & messaging
Behavioral Concepts
Salience
Partner
GreenPath Financial Wellness
Partner Type
Non-profit

What Happened

It didn't work. The encouraging messaging did not have an effect. The researchers hypothesize this was the case because either encouraging messaging could be the wrong type of messging or that the messages were not timely enough. Although, the researchers ran an analysis and uncovered other factors that may be more impactful to target for future research.

Lessons Learned

Encouraging messaging that occurs at the three designated points (activation day, three-month mark and six-month mark) did not have an affect on DMP retention. For future studies, researchers could try to capitalize on the analysis results, which suggests several other potential factors that could be important for DMP behavior change.

Background

Living burdened with debt negatively affects all aspects of someone’s financial well-being. High debt payments can strain a household’s monthly balance sheet, turning even small or unexpected expenses into emergencies. High amounts of debt can also reduce credit scores, making it more expensive and difficult to acquire assets or to find credit in case of emergency. While troubling, access to and use of credit cards is at an all-time high in the United States. The New York Federal Reserve released a recent report showing that, collectively, U.S. households have racked up more than $12 trillion in debt, leaving a majority of Americans just one emergency away from financial hardship.

GreenPath Financial Wellness offers a debt management plan (DMP), which can help individuals get out from under burdensome debt. DMP clients make payments directly to GreenPath, who in turn distributes these funds to the creditors.

GreenPath also negotiates with creditors directly. This often means that clients begin repaying their debt at lower interest rates, reduced fees, and at a lower monthly payment. However, the transition into a DMP is difficult and many clients do not finish, thus forgoing the benefits the DMP offers them.

Key Insights

We listened to counseling sessions and conducted interviews with counselors and other staff members to better understand the DMP experience. The team also followed up with qualitative interviews directly with DMP clients. This qualitative work was supplemented with an in-depth quantitative analysis of administrative data. Through this work, we identified several key barriers that ultimately shaped the design of the intervention.

  1. The value of the DMP is distant and abstract. DMP clients find it difficult to see progress toward a goal that feels neither quickly attainable nor concrete.

  2. The first six months are especially difficult for DMP clients. The transition to a DMP is especially difficult for clients. The first six months show the highest rate of attrition before leveling off around the six-month mark.

  3. Early in the DMP, the focus is to achieve programmatic goals or to overcome programmatic setbacks. The communication early in the DMP often reflects those goals rather than providing motivational messages.

Experiment

We designed a series of encouraging messages that would be sent to clients when their DMP was activated, at the three-month mark, and at the six-month mark. These messages intended to increase the amount of communication with clients and to signal to clients that they are making progress on their DMP.

We randomly assigned new DMP clients to receive these messages, while others continued the DMP as they would normally.

In addition to the emails, we also randomly assigned half of those receiving the encouraging messages to receive a follow-up phone call. By varying the type and degree of outreach, we could test whether encouraging messages are more or less effective depending on the mode of communication.

Results

We enrolled 3,683 new DMP clients for four months starting in December 2016 and ending in March 2017. In our analysis, we measured:

  1. The total number of days the client had an active DMP account in the first six months.

  2. Whether the client had an active account at the end of the data collection period.

  3. Whether the client reached the three-month and the six-month marks in their DMP.

We did not see an effect of the messages on any of the primary outcome measures. The encouraging messaging had no effect on program duration or client retention, regardless of the mode of outreach.

Our intervention likely failed to have an effect either because encouraging messaging is the wrong type of messaging or the messages were not timely enough.

There are opportunities to explore other kinds of messaging or more frequent messaging. We did not test using text messages, which may be a more effective channel to reach clients.

However, our analysis does point to a variety of other factors that are likely more influential in terms of program outcomes. Specifically, our analysis suggests:

  1. Participants with higher savings are more likely to succeed in a DMP.

  2. Income on its own has little effect on DMP performance, but how income relates to expenses is important. Individuals with larger households and individuals with lower incomes relative to area median income (AMI) tend to have worse outcomes on a DMP.

  3. Clients with more unsecured debt actually tend to perform better in the DMP, likely because they see greater value from a DMP as their unsecured debt increases.

  4. Unlike unsecured debt, clients with high amounts of student loans tend to perform worse in their DMP.

  5. Female DMP clients tend to have greater success on a DMP relative to their male counterparts, but this difference is mitigated by savings.

Going forward, organizations interested in helping individuals repay debt would likely be better off tailoring interventions that leverage these factors, which our analysis suggests are likely to have a larger impact.