Long trend dynamics in social media

Abstract

A main characteristic of social media is that its diverse content, copiously generated by both standard outlets and general users, constantly competes for the scarce attention of large audiences. Out of this flood of information some topics manage to get enough attention to become the most popular ones and thus to be prominently displayed as trends. Equally important, some of these trends persist long enough so as to shape part of the social agenda. How this happens is the focus of this paper. By introducing a stochastic dynamical model that takes into account the user’s repeated involvement with given topics, we can predict the distribution of trend durations as well as the thresholds in popularity that lead to their emergence within social media. Detailed measurements of datasets from Twitter confirm the validity of the model and its predictions.

1 Introduction

The past decade has witnessed an explosive growth of social media, creating a competitive environment where topics compete for the attention of users [1, 2]. A main characteristic of social media is that both users and standard media outlets generate content at the same time in the form of news, videos and stories, leading to a flood of information from which it is hard for users to sort out the relevant pieces to concentrate on [3, 4]. User attention is critical for the understand of how problems in culture, decision making and opinion formation evolve [5–7]. Several studies have shown that attention allocated to on-line content is distributed in a highly skewed fashion [8–11]. While most documents receive a negligible amount of attention, a few items become extremely popular and persist as public trends for long a period of time [12–14]. Recent studies have focused on the dynamical growth of attention on different kinds of social media, including Digg [15–17], Youtube [18], Wikipedia [19–21] and Twitter [14, 22–24]. The time-scale over which content persists as a topic in these media also varies on a scale from hours to years. In the case of news and stories, content spreads on the social network until its novelty decays [15]. In information networks like Wikipedia, where a document remains alive for months and even years, popularity is governed by bursts of sudden events and is explained by the rank shift model [19].

While previous work has successfully addressed the growth and decay of news and topics in general, a remaining problem is why some of the topics stay popular for longer periods of time than others and thus contribute to the social agenda. In this paper, we focus on the dynamics of long trends and their persistence within social media. We first introduce a dynamic model of attention growth and derive the distribution of trend durations for all topics. By analyzing the resonating nature of the content within the community, we provide a threshold criterion that successfully predicts the long term persistence of social trends. The predictions of the model are then compared with measurements taken from Twitter, which as we show provides a validation of the proposed dynamics.

This paper is structured as follows. In Section 2 we describe our model for attention growth and the persistence of trends. Section 3 describes the data-set and the collection strategies used in the study, whereas Section 4 discusses the measurements made on data-sets from Twitter and compares them with the predictions of the model. Section 5 concludes with a summary of our findings and future directions.

2 Model

On-line micro-blogging and social service websites enable users to read and send text-based messages to certain topics of interest. The popularity of these topics is commonly measured by the number of postings about these topics [15, 19]. For instance on Twitter, Digg and Youtube, users post their thoughts on topics of interest in the form of tweets and comments. One special characteristic of social media that has been ignored so far is that users can contribute to the popularity of a topic more than once. We take this into account by denoting first posts on a certain topic from a certain user by the variable First Time Post (FTP). If the same user posts on the topic more than once, we call it a Repeated Post (RP). In what follows, we first look at the growth dynamics of FTP.

When a topic first catches people’s attention, a few people may further pass it on to others in the community. If we denote the cumulative number of FTP mentioning the topic at time t by N_t, the growth of attention can be described by N_t=(1+{\chi }_t)N_{t-1}, where the {\chi }_t are assumed to be small, positive, independent and identically distributed random variables with mean μ and variance {\sigma }^2. For small {\chi }_s, the equation can be approximated as:

N_t\simeq \prod _{s=1}^t{e}^{{\chi }_s}{N}_0=e^{{\sum }_{s=1}^t{\chi }_s}{N}_0.

(1)

Taking logarithms on both sides, we obtain log\frac{N_t}{N_0}={\sum }_{s=1}^t{\chi }_s. Applying the central limit theorem to the sum, it follows that the cumulative count of FTP should obey a log-normal distribution.

We now consider the persistence of social trends. We use the variable vitality, {\varphi }_t=\frac{N_t}{N_{t-1}}, as a measurement of popularity, and assume that if the vitality of a topic falls below a certain threshold {\theta }_1, the topic stops trending. Thus

log{\varphi }_t=log\frac{N_t}{N_{t-1}}=log\frac{N_t}{N_0}-log\frac{N_{t-1}}{N_0}\simeq {\chi }_t.

(2)

The probability of ceasing to trend at the time interval s is equal to the probability that {\varphi }_s is lower than a threshold value {\theta }_1, which can be written as:

(3)

where F(x) is the cumulative distribution function of the random variable χ. We are thus able to determine the threshold value from {\theta }_1=e^{F^{-1}(p)} if we know the distribution of the random variable χ. Notice that if χ is independent and identically distributed, it follows that the distribution of trending durations is given by a geometric distribution with Pr(L=k)={(1-p)}^{k}p. The expected trending duration of a topic, E(L), is therefore given by

E(L)=\sum _0^{\mathrm{\infty }}{(1-p)}^{k}p\cdot k=\frac{1}{p}-1=\frac{1}{F(log({\theta }_1))}-1.

(4)

Thus far we have only considered the impact of FTP on social trends by treating all topics as identical to each other. To account for the resonance between users and specific topics we now include the RP into the dynamics. We define the instantaneous number of FTP posted in the time interval t as {\mathit{FTP}}_t, and the repeated posts, RP, in the time interval t as {\mathit{RP}}_t. Similarly we denote the cumulative number of all posts-including both FTP and RP-as S_t. The resonance level of fans with a given topic is measured by {\mu }_t=\frac{{\mathit{FTP}}_t+{\mathit{RP}}_t}{{\mathit{FTP}}_t}, and we define the expected value of {\mu }_t, E({\mu }_t) as the active-ratio a_q.

We can simplify the dynamics by assuming that {\mu }_t is independent and uniformly distributed on the interval [1,2a_q-1]. It then follows that the increment of S_t is given by the sum of {\mathit{FTP}}_t and {\mathit{RP}}_t. We thus have

S_t-S_{t-1}={\mathit{FTP}}_t+{\mathit{RP}}_t={\mu }_{t}FT{P}_t={\mu }_t(N_t-N_{t-1})={\mu }_t{\chi }_t{N}_{t-1}.

(5)

And also

\begin{array}{rl}{E}_{\mu }(S_t)& =E_{\mu }(S_{t-1})+a_q(N_t-N_{t-1})\\ =E_{\mu }(S_{t-2})+a_q(N_t-N_{t-2})=\cdots \\ =E_{\mu }(S_0)+a_q(N_t-N_0)=a_q{N}_t.\end{array}

(6)

We approximate S_{t-1} by {\mu }_t{N}_{t-1}. Going back to Equation 5, we have

S_t\simeq {\mu }_t({\chi }_t+1)N_{t-1}\simeq {\mu }_t{e}^{{\chi }_t}{N}_{t-1}.

(7)

From this, it follows that the dynamics of the full attention process is determined by the two independent random variables, μ and χ. Similarly to the derivation of Equation 3, the topic is assumed to stop trending if the value of either one of the random variables governing the process falls below the thresholds {\theta }_1 and {\theta }_2, respectively. One point worth mentioning here is that, {\theta }_1 and {\theta }_2 are system parameters, i.e. not dependent on the topic, but only on the studied medium. The probability of ceasing to trend, defined as p^{\star }, is now given by

(8)

p=F(log({\theta }_1))

. The expected value of L_q for any topic q is given by

E(L_q)=\frac{2(a_q-1)}{F(log{\theta }_1)({\theta }_2-1)}-1.

(9)

Which states that the persistent duration of trends associated with given topics is expected to scale linearly with the topic users’ active-ratio. From this result it follows that one can predict the trend duration for any topic by measuring its user active-ratio after the values of {\theta }_1 and {\theta }_2 are determined from empirical observations.

3 Data

To test the predictions of our dynamic model, we analyzed data from Twitter, an extremely popular social network website used by over 200 million users around the world. Its interface of allows users to post short messages, known as tweets, that can be read and retweeted by other Twitter users. Users declare the people they follow, and they get notified when there is a new post from any of these people. A user can also forward the original post of another user to his followers by the re-tweet mechanism.

In our study, the cumulative count of tweets and re-tweets that are related to a certain topic was used as a proxy for the popularity of the topic. On the front page of Twitter there is also a column named trends that presents the few keywords or sentences that are most frequently mentioned in Twitter at a given moment. The list of popular topics in the trends column is updated every few minutes as new topics become popular. We collected the topics in the trends column by performing an API query every 20 minutes. For each of the topics in the trending column, we used the Search API function to collect the full list of tweets and re-tweets related to the topic over the past 20 minutes. We also collected information about the author of the post, identified by a unique user-id, the text of the post and the time of its posting. We thus obtained a dataset of 16.32 million posts on 3361 different topics. The longest trending topic we observed had a length of 14.7 days. We found that of all the posts in our dataset, 17% belonged to the RP category.

4 Results

We start by analyzing the distribution of N from our data-set. We found out that N_{10} follows a log-normal distribution, as can be seen from Figure 1. The Q-Q plot in Figure 1 follows a straight line. Different values of t yield similar results. The Kolmogorov-Smirnov normality test of log(N_{10}) with mean 3.5577 and standard deviation 0.3266 yields a p-value of 0.0838. At a significance level of 0.05, the test fails to reject the null hypothesis that log(N_{10}) follows normal distribution, a result which is consistent with Equation 1.

Figure 1

Q-Q plot of\mathbf{log}\mathbf{(}{\mathit{N}}_{\mathbf{10}}\mathbf{)}. The straight line shows that the data follows a lognormal distribution with a slightly shorter tail.

We also measured the distribution of χ from {\chi }_t=\frac{N_t}{N_{t-1}}-1. We found that log(\chi ) follows a normal distribution with mean equal to −1.4522 and a standard deviation value of 0.6715, as shown in Figure 2. The Kolmogorov-Smirnov normality test statistic gives a high p-value of 0.5346. The mean value of χ is 0.0353, which is small for the approximations in Equation 1 and Equation 7 to be valid. We also examined the record breaking values of vitality, {\varphi }_t={\chi }_t+1, which signal the behavior of the longest lasting trends. From the theory of records, if the values {\varphi }_t come from an independent and identical distribution, the number of records that have occurred up to time t, defined as R_n(t), should scale linearly with log(t)[26, 27]. As is customary, we say that a new record has been established if the vitality of the trend at the moment is longer than all of the previous observations. As shown in Figure 3, there is a linear scaling relationship between log(t) and R_n(t) for a sample topic “Kim Chul Hee”. The topic kept trending for 14 days on Twitter in September 2010. Similar observations are repeated for other different topics on Twitter. One implication of this observation is that confirms the validity of our assumption that the values of {\chi }_1,{\chi }_2,\dots ,{\chi }_t are independent and identically distributed.

Figure 2

Density plot and Q-Q plot of\mathbf{log}\mathbf{(}\mathit{\chi }\mathbf{)}. (a) Density plot of log(\chi ) over different t and social trends. (b) Q-Q plot of log(\chi ).

Figure 3

The linear scaling relationship between{\mathit{R}}_{\mathit{n}}\mathbf{(}\mathit{t}\mathbf{)}and\mathbf{log}\mathbf{(}\mathit{t}\mathbf{)}of topic ‘Kim Chul Hee’, a Korean pop star. The number of records that have occurred up to time t scales linearly with log(t).

Next we turn our attention to the distribution of durations of long trends. As shown in Figure 4 and Figure 5, a linear fit of trend duration as a function of density in a logarithmic scale suggests an exponential family, which is consistent with Equation 4. The red line in Figure 4 gives a linear fitting with R-square 0.9112. From the log-log scale plot in Figure 5, we observe that the distribution deviates from a power law, which is a characteristic of social trends that originate from news on social media [25]. From the distribution of trending times, p is estimated to have a value of 0.12. Together with the measured distribution of χ and Equation 3, we can estimate the value of θ to be 1.0132.

Figure 4

Semi-log plot of trending duration density. The straight line suggests an exponential family of the trending time distribution.

Figure 5

Density plot of trending duration in log-log scale. The distribution of duration deviates from a power law.

We can also determine the expected duration of trend times stemming from the impact of active-ratio. The frequency count of active-ratios over different topics is shown in Figure 6, with a peak at a_q=1.2. This observation suggests that while the ratio is centered around 1.2 for the majority of topics, there are a few topics obtain large amount of repeated attention. This observation may shadow light on existing observations about the highly skewed distribution in attention dynamic studies. As can be seen in Figure 7, the trend duration of different topics scales linearly with the active-ratio, which is consistent with the prediction of Equation 9. The R-square of the linear fitting has a value of 0.98664. From the slope of the linear fit and {\theta }_1=1.0132, and Equation 9 we obtain a value for {\theta }_2=1.153. With the value of {\theta }_1 and {\theta }_2, we are able to predict the expected trend duration of any given topic based on measurements of its active-ratio.

Figure 6

Frequency count of active-ratio over all topics. The maximum ratio is 1.2 among all topics.

Figure 7

Linear relationship between trending duration and active-ratio in good agreement with the predictions of model.

5 Discussion and conclusion

In this paper we investigated the persistence dynamics of trends in social media. By introducing a stochastic dynamic model that takes into account the user’s repeated involvement with given topics, we are able to predict the distribution of trend durations as well as the thresholds in popularity that lead to the emergence of given topics as trends within social media. The predictions of our mode were confirmed by a careful analysis of a data from Twitter. Furthermore, a linear relationship between the resonance level of users with given topics, and the trending duration of a topic was derived. The proposed model provides a deeper understanding the popularity of on-line contents. Parameters {\theta }_1 and {\theta }_2 in our model are system specific and could be calculated from hidden algorithms when applying our model to other on-line social media websites. Possible refinements may include the effect of competition between topics, sudden burst of events, the effect of marketing campaigns and the actively censoring of specific topics [28]. In closing, we note that although the focus in this paper has been on trend dynamics that are featured on social media websites, the framework and model may be suitable to other types of content and off-line trends. The issue raised - that is, trending phenomenon under the impact of user’s repeated involvement - is therefore a general one and should provide ample opportunities for future work.

Author contributions

B.H. and C.W. designed the study and performed research. C.W. and B.H. wrote the paper. All authors read and approved the final manuscript.