Skip to main content
  • Regular article
  • Open access
  • Published:

Analyzing image-based political propaganda in referendum campaigns: from elements to strategies

Abstract

Due to the increasing prominence of social network services, political communication has experienced a paradigm shift. To communicate with internet users, politicians, candidates, and political organizations create fan pages. Initially, they provide text-only material on their pages; later, to increase engagement, they include photos, images, and videos. This paper investigates image-based political images in Taiwan for the first time during a nationwide referendum. Unlike an election, a referendum is a policy-based vote. We evaluate over 2000 Facebook images shared by the two most prominent political parties in order to comprehend the aspects of images and the tactics of political organizations. In addition, we examine the textual content, objects, and colors of the collected data. We find that the characteristics of propaganda materials vary between political groups. Nonetheless, the color strategies employed by both sides are equivalent, with each side utilizing its own representative colors for consolidation and the opponent’s colors for attacking.

1 Introduction

The emergence of social network services has caused a paradigm change in political communication. In order to communicate with online users on social network platforms such as Facebook and Twitter, not just politicians but also political groups create fan pages. During elections, they also use social media to spread their opinions and promote themselves. These channels allow candidates to communicate with voters who may not have access to television or newspapers. Meanwhile, numerous studies have examined the text published on Facebook and Twitter to determine how political entities disseminate propaganda on social media platforms [1, 2]. Likewise, the formats of propaganda and the platforms on which it was conducted evolve throughout time. For instance, political adverts exist not just on Twitter, but also on multimedia-rich platforms like Instagram and Tiktok [3, 4]. They often embedded images and videos in text messages to increase engagement and attract more attention. Previous research on image-based political propaganda has mainly concentrated on detecting objects, analyzing human facial expressions, and extracting image features [58]. Many scholars have also studied the use of images in propaganda during election campaigns [9, 10]. However, there are still gaps in knowledge about understanding how images are used in propaganda, such as analyzing larger social datasets to gain a more comprehensive understanding of elements and types of image-based propaganda. Additionally, there is a lack of research on investigating the differences in the use of slogans, colors, and other elements between referendum campaigns and election campaigns.

In this paper, we aim to fill these gaps by providing a deeper understanding of the elements and strategies used in online propaganda images, particularly in the context of referendum campaigns. The following are the three major research questions that have been investigated:

  1. 1.

    What are the elements (texts and objects) in the image-based propaganda materials during a referendum?

  2. 2.

    How do the government and the opposing party use color during a referendum?

  3. 3.

    What are the differences in images used for various propaganda purposes (e.g., attacking/consolidation) during a referendum?

To explore these questions, we examine the Facebook election campaign for Taiwan’s 2021 national referendum. We choose a referendum as the target because, unlike elections, which are votes on candidates, a referendum is a vote on a proposal or a policy; hence, we are interested in determining whether the content and form of online propaganda vary by political party.

During an 8-month observation period preceding the referendum, we collected over 10,000 photographs posted by the two major parties, Democratic Progressive Party (DPP, the ruling party) and Kuomintang (KMT), on Facebook. We filtered out the top one thousand DPP and KMT photos based on the number of reaction emojis that users expressed. We performed text recognition, object extraction, and color quantification on the dataset; a detailed comparison between the two parties is made and discussed in this work.

Overall, the main findings of this work are three-fold:

  1. 1.

    Political propaganda in a referendum campaign typically emphasizes slogans, the voting date, and the for or against the policy. Our analysis suggests that the ruling party tends to use more infographics in their campaign materials compared to the opposition.

  2. 2.

    Our findings indicate that political parties often use the representative color of the opposition when attacking them, rather than the propaganda strategies commonly described in previous research.

  3. 3.

    The results show that political parties tend to use their representative color more frequently when consolidating their votes and the opposing party’s color when attacking their opponents.

This paper is organized as follows: In section Related Works, this section introduces relevant works on political propaganda and the context of the examined referendum. In section Data & Methodology, we present the details of data collection and extraction methods for texts, objects, and colors. In section Experiment and Result, we show a comprehensive analysis of the texts, objects, and color usage in the images published by the two major parties. In section Strategic Analysis, we demonstrate an in-depth analysis of propaganda strategies. Finally, the conclusion and discussion of this work are depicted in section Conclusion and Future Works.

2 Related works

In 1927, Harold D. Lasswell [11] first formulated a theory of political propaganda and characterized it as “the management of collective attitudes by the manipulation of significant symbols.” Since then, political propaganda has become the principal means by which political elites convey their views, plans, and ideas to the general population. In 1997, R.A. Nelson [12] described political propaganda as usually spread through the dissemination of unilaterally controlled messages. These messages attempt to influence a particular target’s emotions, attitudes, beliefs, and behaviors were spread through large-scale, direct media channels. Due to the rise of the Internet, political propaganda has been redefined in the current day. Randal Marlin [13] defined propaganda as “the organized attempt, through communication, to affect belief or action or inculcate attitudes in a large audience in ways that circumvent an individual’s adequately informed, rational, reflective judgment.” Étienne Brown [14] considers the various means used by propagandists and categorizes three ideal types of propaganda: affective propaganda, conative propaganda, and cognitive propaganda. In 2018, Jowett and O’donnell [15] defined political propaganda as a deliberate, systematic attempt to form ideas, manipulate perceptions, and guide behavior to achieve the desired response. With the rapid growth of social network services, people’s access to information has expanded beyond traditional media like newspapers and television to online platforms like Facebook and Twitter. We explain the literature on political propaganda on social media platforms and highlight the significance and relevance of our research.

2.1 Political propaganda on social platforms

Social media lets individuals share and receive information. Meanwhile, politicians and organizations have created fan pages to communicate with the public. However, research has shown that citizens care more about party or candidate traits than specific issues [1618]. Based on these findings, some candidates or parties may post more photographs and favorable comments to control their image, which is propaganda. To study the impact of online propaganda, Woolley and Guilbeault [19] investigated how political parties spread their ideas through bot accounts on social media and their effects during major political events. Ferrara et al. [20] used the United States as a case study to examine the impact of online political propaganda on Twitter; they categorized bot accounts as right- or left-leaning in order to determine how political propaganda influences the presidential election.

As political elites increasingly use social platforms to connect with public, researchers have examined the information released and responded to by political entities to determine how social communication can affect the public. Brady et al. [21] studied the gauge influence of political elites on social media. They found a “moral contagion” effect, which refers to “elites’ use of moral-emotional language was robustly associated with increased message diffusion.” To analyze the topic and emotion of political propaganda, Miller [22] studied Russian propaganda on Twitter before, during, and after the 2016 U.S. presidential election. The results show that Russian-sponsored tweets have distinct attitudes towards different presidential candidates.

Political propaganda is a frequent method used in political communication to promote certain proposals or affect the political leanings, texts, images, and even videos of individuals. Prior to comprehending political propaganda in photographs, the majority of study relies on text mining and bot account detection [2326]. However, using images in political propaganda has become familiar with the rise of social media.

The study of image propaganda can be divided into various categories, such as images of candidates or parties, events, or ideologies. For example, Mattes et al. [27] studied how the candidate images will affect the election results through crowdsourcing, collecting the impression netizens felt from the photos. Prior to the rise of social media, candidate posters were not a significant factor in elections. Håkansson et al. [28] examined the Swedish Election poster over a period of around a century and found several interesting phenomena such as thematic repetition of style, consistency in the use of colors and materials, and subliminal appeals. Colm A. Fox [29] investigated election posters from 1955 to 2021 and found that current posters use more complex features to demonstrate why the candidate merits voter support.

Additionally, Al-Azzawi and Saleh [30] examined the posters of four contenders in the 2020 United States presidential election and found that the visual and textual elements of the posters serve as persuasive tools to highlight the political influence. They demonstrated that the designers of the posters carefully evaluate the content and visual aids in order to persuade the audience to vote for a particular candidate. Deirdre Pretorius [31] examined three 2019 South African election posters and found that the three parties’ posters differed in terms of leader size, posture, nonverbal cues, and attire.

Vliegenthart, R. [32] studied election posters in the Netherlands and found that over time, party logo and candidates appear more frequently in posters and occupy more pages, showing political personalization. Benoit, W. L. [33] studied the US presidential election posters from 1828 to 2012, and also came to similar conclusions, including praise is more common than attack, and the character of the candidate is far more than the policy.

For referendum images, O’Hagan, L. A. [34] studied Sweden’s 1922 control of alcohol consumption referendum and said that the posters used during the referendum used catchy slogans, simple pictures, and bright colors to make it easy for the public to digest, using infographics to convey a rational argument. Türkmenoğlu, A.T. [35] used semiotic analysis to examine five referendum posters from the Brexit campaign to uncover the meanings conveyed by the images and text.

Regarding event detection with social media photographs, Won et al. [5] developed a visual model to recognize protesters and estimate the level of perceived violence in a snap in order to identify protest events and statistics on perceived levels of violence in various regions. Zhang and Pan [6] attempted to identify collective action events utilizing text and image data from China’s most popular microblogging network, Sina Weibo. In order to detect real-world occurrences, they classified text using the long short-term memory (LSTM) model and extract visual features through convolutional neural networks (CNN).

In political party or ideological field research, Xi et al. [7] attempted to understand how politicians communicate their political ideology via social media images by studying the scene and facial expression to determine whether a politician is Democratic or Republican. Joshi and Buntain [8] analyzed comparable and ideologically associated political communication pictures by means of clustering and deep learning. They gathered photos of US congressmen via Twitter’s REST API and categorized them according to their association with liberal or conservative ideology.

According to our analysis of the literature, previous research on image analysis has largely focused on object detection, facial expression recognition, and feature extraction [58]. However, little attention has been given to the elements, color use, and strategies of images in political propaganda. To address this, in this work, we study the text, elements, and colors used in online propaganda images during a nationwide referendum campaign on Facebook. We aim to fill the knowledge gaps in the visual analysis of political propaganda by analyzing a large social media dataset and comparing the strategies between parties during referendum campaigns.

2.2 Politics in Taiwan and the 2021 National Referendum

Since the 1980s, Taiwan’s politics have remained polarized for decades. In the last twenty years, the two major parties, DPP (the current ruling party) and KMT, have alternately won elections and held a majority of elected seats in the parliament [3639]. The two parties have divergent views on China and the United States’ relations, and they also disagree both online and in person regarding Taiwan’s national identity [4043]. In 2021, Taiwan held a national referendum to vote on four issues, including (1) activating the Fourth Nuclear Power Plant in Gongliao District, New Taipei City; (2) prohibiting imports of pork containing ractopamine; (3) holding referendums alongside nationwide elections; and (4) relocating a Natural Gas Terminal to protect algal reefs off Taoyuan Guanyin District. Based on the results of the vote, all four proposals are rejected. Among these proposals, the prohibition on U.S. pork imports is the most controversial and has garnered the most attention domestically and internationally. In 2020, President Tsai Ing-wen declared that the prohibition on U.S. pork products would be lifted in 2021. Concerned about food safety, KMT politicians then suggested a referendum to impose limitations on the import of pork containing ractopamine. However, the government asserts that the regulation might potentially harm relations between Taiwan and the United States, as well as Taiwan’s efforts to join international trade agreements. 51.2% voted against the prohibition, while 48.8% supported it.

3 Data & methodology

Figure 1 depicts the overall procedure of our analysis scheme. The procedure includes five steps: (1) data collection and cleaning, (2) text recognition, (3) object extraction, (4) color quantification, and (5) visualization. We then visualize the results and conduct a thorough study of them.

Figure 1
figure 1

The architecture of our analysis. This paper’s analysis architecture comprises four components. (1) data collection and cleaning, (2) text recognition and object extraction, (3) color quantization, and (4) chart visualization

3.1 Data collection

From April to December 2021, eight months prior to the vote, we collected our dataset on Facebook. We crawled a total of 103,845 posts whose content linked to the four referendum questions. Only 40,953 (39%) of these postings included at least one photo. To analyze the propaganda conducted by the two major parties, we assigned political labels to each post publisher. Only images published by politicians or major party affiliations are included in our database. Table 1 displays an overview of our dataset.

Table 1 An overview of our dataset

3.2 Text recognition

In order to examine the textual content of images, we utilized the Google Cloud Vision APIFootnote 1 for optical character recognition. Our dataset consisted of the top 1000 images with the highest number of likes in the pan-blue and pan-green fan pages and select 10 words related to the referendum for testing. We computed precision and recall scores by comparing the results of the Google Vision API with manual annotations as in Table 2. According to the results, the Google Vision API achieved a precision rate of 87.02% and a recall rate of 74.78%. Based on the results, the Vision API demonstrated well character recognition ability in our dataset (Traditional Chinese). It accurately recognized most words even in complex environments. Therefore, we will continue to use the Google Cloud Vision API as the chosen text recognition method.

Table 2 Vision API text verification result.

3.3 Image categorization

We divided the data we gathered into two classes—infographic and propaganda images—in order to analyze the variations in presentations and tactics used in political propaganda. The following is a description of the categorization guide:

  • Infographic. An infographic is an image that is used in reports, technical publications, and signage. The formats include but are not limited to timelines, maps, data visualizations, flow charts, and statistical charts. Figure 2(a) illustrates a few instances.

    Figure 2
    figure 2

    Examples of infographic and non-infographic images. We classified through some key elements, such as signs, charts, reports, slogans, etc

  • Propaganda. An image includes slogans without any statistical charts or data visualizations. A few samples are displayed in Fig. 2(b).

In addition to the aforementioned two categories of images, a significant component of our collection consists of photographs taken by photographers, such as photographs of large-scale outdoor campaigns with crowds.

3.4 Object extraction

To build upon previous research on the content analysis of political propaganda texts [4446], we investigated various aspects of data collection. Our aim was to gain insights into how different political organizations created promotional materials to communicate their ideas and proposals. For this purpose, we utilized the Google Vision API to extract objects depicted in each photo and assessed the accuracy of the API’s results through human verification.

In Table 3, we present the outcomes of the tagging process, indicating satisfactory precision (> 0.75) for labels such as suits, eyewear, poster, crowd, trousers, tree, building, and curtain. However, we observed that the precision of the Google Vision API was potentially inadequate for certain labels, including T-shirts, hats, shorts, signs, and publications. This discrepancy could be attributed to variations in the definitions used by human taggers compared to those employed by Google’s algorithms.

Table 3 Vision API object verification test result

For example, our human tags only considered standalone hats as hats, while excluding hooded jackets. This could potentially lead to misidentification by the Google Vision API. Despite these limitations, given the satisfactory performance across most labels, we have decided to utilize the results obtained from the Google Vision API for our research.

3.5 Color quantification

According to prior research, color may play a significant role in psychological effects and decision-making [47, 48]. To understand the impact of colors in image-based political communication, we quantified the color distribution of images and analyzed (1) how organizations use color to create propaganda materials? And (2) do various techniques exist for employing colors for other reasons (such as assaulting the opposition or solidifying support)?

To understand the color composition of images, we applied a color quantification approach to our dataset. We utilized k-means clustering, where \(k=5\) in our setup, to group pixels according to RGB and HSV in order to identify the prominent colors of an image.

Then, we selected the center of each cluster and computed the percentage it occupies in order to extract the five predominant colors of each image.

  • RGB (RGB Color Model). RGB is an additive color model that uses red, green, and blue to express a color. In the system, red, green, and blue indexes are all set in range \(0\sim 255\), where \(( 0,0,0 )\) represent black and \(( 255,255,255 )\) represent white.

  • HSV (Hue, Saturation, and Value). Through a cylindrical coordinate system, HSV is utilized to represent colors. Hue is a fundamental characteristic of hues like red, yellow, and green. In a cylindrical coordinate system, hue is represented as an angle in the range , however, in the OpenCV module for Python, it is represented as \(0\sim 180\). Saturation is the value of the purity of colors, so colors with a low saturation value will become gray. In our program, we set saturation to the range \(0\sim 255\). Value is also known as brightness. A color with a low value of brightness would become dark.

Figure 3 depicts the colors extracted by \(k=5\) and \(k=10\). Although \(k=10\) allows us to obtain a more complete description of the color distribution, \(k=5\) allows us to reserve the most dominating colors with less computational effort. We visualized and examined the color utilization for various parties, image categories, and image functions based on the results.

Figure 3
figure 3

K values for extracting dominating colors. Example results for \(k=5\) and \(k=10\) when extracting dominating colors of images

4 Experiment and result

From the data collection, we selected the top 1000 images from pan-blue and pan-green fan pages on Facebook according to the number of likes of the posts. A summary of the images is shown in Table 4. In the pan-blue subset, 109 fan pages and 496 posts were included. The number of likes of each post ranged from 904 to 113,168; in pan-green, we included 102 fan pages and 425 posts in the subset. The number of likes of each post ranged from 1917 to 95,084. We also found DPP (pan-green, the ruling party) uses more images and texts in a post than the opposition (pan-blue).

Table 4 The top 1000 images for KMT (pan-blue) and DPP (pan-green) fan page

4.1 Text in image

We uploaded images to the Google Vision API and processed the resulting data as described previously. After the text segmentation, we tagged and used the parts of speech of words extracted from images. We then removed traditional Chinese stop words according to Table 5 and merged synonyms according to Table 6. Table 7 shows the top 10 most frequent words in pan-blue and pan-green images. We manually merged synonyms; for example, “” and “” are both equivalent to KMT.

Table 5 Part-of-speech list for stopword removal
Table 6 Synonym word for grouping
Table 7 Top 10 most frequent words in pan-blue and DPP (pan-green) images

4.2 Detection on image

We extracted object labels from images using the Google Vision API. There were 650 labels on 1000 pan-blue fan page images and 550 labels on 1000 pan-green fan page images. We set the threshold for reserving frequent labels at 20. Same as the text in the image, we are manually combining several overly detailed categories into one broader category. For example, we are combining eyewear, glasses, and sunglasses into the category of eyewear, and combining jeans trousers into the category of trousers. In this we will first filter those labels that are describing images, such as world, recreation, rectangle even more. Next, we manually filter some label that cannot explained in any strategy, such as table, chair or tire. Finally, we categorized labels as clothing, physical objects, and backgrounds.

4.3 Color quantization of images

As depicted in Fig. 4, we analyzed the color distribution of the top 1000 images from each group in this section. Figure 5 demonstrates the distribution of hue-based color usage in the HSV system using a histogram. The visualization is intended to highlight the difference in color usage between the two political groups. The figure reveals a clear polarization in using blue-tone/green tone colors between the two groups.

Figure 4
figure 4

The top 1000 images from pan-blue and pan-green fan pages. To have a macro view of the dataset, we aggregate one thousand photos into one

Figure 5
figure 5

The density plots for 1000 images of pan-blue and pan-green. The figure shows a polarized color usage in using blue-tone/green tone colors from pan-blue and pan-green

5 Strategic analysis

This section details the results of word recognition, object extraction, and color quantization performed on images published by various political groups. In addition, we analyze the strategic distinctions between the two parties’ propaganda efforts. The two most important issues we research are:

  1. 1.

    Do infographic images and propaganda images vary in any way?

  2. 2.

    Do the images used to rally supporters and demonize the opposition vary in any way?

By responding to the two questions, we attempt to comprehend the two polarized political groups’ tactics for creating propaganda materials.

To answer the aforementioned questions, we group the collected images into three categories, including infographics, propaganda, and others. The propaganda picture contains photos with linked slogans or text. The majority of the images in others were of landscapes, conferences, or people without text. We define how we classify infographics, propaganda, and other types of imagery.

  • Infographic. An infographic is an image used for signage, reports, and technical documentation. The formats consist of but are not limited to, timelines, maps, data visualizations, flow charts, and statistic charts.

  • Propaganda images. An image includes slogans but no statistics or data visualizations.

  • Others. We classify images that do not belong to “Infographic” or “Propaganda images” as “Others.” Our observations indicate the majority of these photographs depict various political activities.

As shown in Table 8, after manually tagging these images, the pan-blue group contains only 26 infographic images and 398 propaganda images. The pan-green group, on the other hand, creates 50 infographics and 561 propaganda images.

Table 8 Presentation types of the top 1000 images in KMT (pan-blue) and DPP (pan-green)

According to Table 8, the pan-green group produces 92% more infographic graphics than the pan-blue group (50 vs. 26). The pan-green group also uses more slogan-based propaganda materials than the pan-blue group. Comparatively to the pan-blue, the ruling party (pan-green) uses statistics tables and slogan visuals to justify their opposition to the referendum proposal based on the results.

5.1 Textual analysis

We list the ten most frequently used words retrieved from pan-blue and pan-green images, as shown in Table 7. The table demonstrates that the slogan of the ruling party’s propaganda is more consistent. For example, they use “ (disagree)” and “ (4 disagree)” to urge citizens to vote against the referendum. From a distribution perspective, pan-green is more purposeful and organized than pan-blue by using more consistent wordings in images (the top 5 words account for 13.34% of total word usage; pan-blue: 9.87%). The results also show that the two parties are on the opposite side of the issue, such as “ (4 agree)” versus “ (4 disagree)” and “ (oppose pork containing ractopamine)” versus “ (pork from the US)”.

We also compare the text derived from propaganda visuals and infographics. The distinction between pan-green and pan-blue groupings is the most frequently used words in propaganda imagery. The propaganda photos on pan-green fan pages include critical terms from the referendum, such as “ (the Fourth Nuclear Power Plant)” (1.19%), “ (Natural Gas Terminal)” (0.98%), and “ (pork from the US)” (0.90%). However, none of these words are among the most frequent words in pan-blue. The government’s materials stress the slogans and questions of the referendum, whilst the opposition’s materials emphasize political parties and politicians. As the referendum could be a vote of no confidence for the government, the ruling party should defend their policies rather than solicit votes for particular individuals.

5.2 Object extraction

Tables 9(a), 9(b), and 9(c) illustrate the proportions of clothing, physical objects, and backgrounds extracted from pan-blue and pan-blue images. In addition, we present the p-values of \(\chi ^{2}\) tests. In terms of clothing, pan-blue groups select glasses more frequently than pan-green groups; pan-green groups prefer to wear formal attire such as suits over pan-blue groups. The differences in casual wear, such as T-shirts and pants, reveal that pan-blue groups prefer T-shirts and trousers more than pan-green groups. As a party with a 100-year history that has received less support from youth in recent elections, KMT (pan-blue) politicians may attempt to create younger impressions in order to attract votes. In the physical objects, the numbers of posters appearing in the images of the two political parties appear first, indicating that posters in images are the primary means by which the parties convey their concepts. According to Table 9(c), pan-blue images contain more outdoor building scenes than pan-green images.

Table 9 Clothing, physical object, and background label proportions and p-values of χ2 tests in pan-blue and pan-green images

5.3 Color quantization of images

Based on the results displayed in Fig. 5, we can discover that both pan-blue and pan-green fan pages employ hue-specific colors. As indicated in Fig. 6, based on the empirical cumulative distribution function (ECDF) results, we can deduce from Fig. 5 the specifics of the two parties’ most often used hue. Through our analysis of fan pages associated with both pan-blue and pan-green political parties, we have indicated that neither party predominantly uses the color that is most closely associated with them. Instead, both parties commonly use orange-tone colors. Additionally, we found that blue-tone colors are the second most frequently used color by both parties. Such usage defies the public’s view of the many political hues. We believe that this is due to the fact that the national referendum is based on policy debate rather than individual or political party campaigning.

Figure 6
figure 6

The ECDF of hue values from 1000 images of pan-blue and pan-green groups. We demonstrate the use of pan-blue and pan-green color tones using the cumulative probability and color spectrum

5.4 Difference between attacking and consolidating images

As indicated in Table 10, we manually categorize images as either attacking or consolidating in order to comprehend how different political organizations construct their fan page graphics for various purposes. Figure 7 illustrates examples of attacking and consolidating imagery for two political organizations.

  • Attacking images. Images depicting politicians from other parties or bearing the names of other parties. Text in photos should be satirical or accusatory. Some examples are shown in Fig. 7(a) and 7(c).

    Figure 7
    figure 7

    Attacking and consolidating images. We present examples of attacking and consolidating images from pan-blue and pan-green groups

  • Consolidating images. Images devoid of politicians from opposing parties, with the text or slogan concentrating on the issue. A few samples are shown in Fig. 7(b) and 7(d).

Table 10 Different political tendencies images are designed with different purposes

As illustrated in Fig. 8, after manually tagging images, we analyzed the color utilization of the two categories of images. When consolidating voters, both sides utilize their representational hue more than the opposite; for instance, pan-blue fan pages employ a bluer tone than pan-green fan pages. Intriguingly, when attacking the opposing side, both sides employ the opposing side’s signature hue to build their offensive graphics. From the bottom panel of Fig. 8, we observe that pan-blue pages employ more green tones (hue value: 40–60) while assaulting DPP, whereas pan-green pages employ a blue style (hue: 100–120) when attacking. Although the positions and audiences of the two sides are polarized, the strategies for attacking and consolidating propaganda are comparable.

Figure 8
figure 8

Image analysis for different purposes. Results of the empirical cumulative distribution of attacking and consolidating images for both political tendencies

6 Conclusion and future works

In this paper, we present the very first study of image-based political communication during a national referendum. We studied 2000 images from the Facebook fan pages of two polarized political groups during the referendum campaign and examined them in terms of text, objects, and color. In comparison to earlier research, we presented significant findings: (1) Our analysis discovered that during a referendum campaign, political propaganda typically emphasizes slogans, the voting date, and the for or against the policy. Furthermore, we observed that the ruling party (pan-green in this case) tends to use more infographics in their campaign materials compared to the opposition. (2) By extracting objects from images, we found that the century-old party (KMT, pan-blue) preferred informal dress, but the ruling party (DPP, pan-green) chose formal attire. (3) Unlike candidate-based elections, our research indicates that political groups do not prioritize their representative colors while coloring. A plausible explanation is that the referendum is for a policy debate, not for individuals or political parties. (4) Based on images with specific purposes, i.e., attacking or consolidating, we noticed that the coloring strategies of both parties in the attacking and consolidating images are comparable, utilizing their representative color more when consolidating votes and the opposing color when assaulting.

In the subsequent phases of our research, we will broaden our examination of the propaganda differences between Taiwan’s elections and referendums. We believe that further research could help us determine if our findings in this paper are applicable to candidate-based elections. In addition, we believe that a cross-cultural analysis between other countries could help us determine whether the results are applicable to other political systems. In conclusion, we list the following potential study directions:

  • Integrating color psychology and political science into future research regarding the types of visuals and text content that can maximize the effectiveness of online propaganda.

  • Correlating developing events or poll results to examine how political groupings respond to breaking events and poll results, such as employing radical language or representative color to consolidate support.

  • Studying the similarity and differences between propaganda strategy of the referendum and election campaigns.

  • Performing cross-cultural analysis between different countries to investigate if the findings in this work could be generalized to another political system.

We expect that this research will shed light on our understanding of online political communication. Moreover, we anticipate that the quantitative perspectives in this work will enable netizens and the general public to read, evaluate, and react to political propaganda from unique angles.

Availability of data and materials

The image dataset is currently available via https://reurl.cc/3xbe18.

Notes

  1. https://cloud.google.com/vision.

Abbreviations

DPP:

Democratic Progressive Party

KMT:

Kuomintang; LSTM, Long Short-Term Memory

CNN:

Convolutional Neural Network

CKIP:

Chinese Knowledge and Information Processing.

References

  1. Stier S, Bleier A, Lietz H, Strohmaier M (2018) Election campaigning on social media: politicians, audiences, and the mediation of political communication on Facebook and Twitter. Polit Commun 35(1):50–74

    Article  Google Scholar 

  2. Bossetta M (2018) The digital architectures of social media: comparing political campaigning on Facebook, Twitter, Instagram, and snapchat in the 2016 us election. Journal Mass Commun Q 95(2):471–496

    Article  Google Scholar 

  3. Mahoney J, Feltwell T, Ajuruchi O, Lawson S (2016) Constructing the visual online political self: an analysis of Instagram use by the Scottish electorate. In: Proceedings of the 2016 CHI conference on human factors in computing systems, pp 3339–3351

    Chapter  Google Scholar 

  4. Medina Serrano JC, Papakyriakopoulos O, Hegelich S (2020) Dancing to the partisan beat: a first analysis of political communication on tiktok. In: 12th ACM conference on web science, pp 257–266

    Chapter  Google Scholar 

  5. Won D, Steinert-Threlkeld ZC, Joo J (2017) Protest activity detection and perceived violence estimation from social media images. In: Proceedings of the 25th ACM international conference on multimedia, pp 786–794

    Chapter  Google Scholar 

  6. Zhang H, Pan J (2019) Casm: a deep-learning approach for identifying collective action events with text and image data from social media. Sociol Method 49(1):1–57

    Article  Google Scholar 

  7. Xi N, Ma D, Liou M, Steinert-Threlkeld ZC, Anastasopoulos J, Joo J (2020) Understanding the political ideology of legislators from social media images. In: Proceedings of the international AAAI conference on web and social media, vol 14, pp 726–737

    Google Scholar 

  8. Joshi A, Buntain C (2021) Examining similar and ideologically correlated imagery in online political communication. arXiv:2110.01183

  9. Smith R (2017) Australian election posters. In: Election posters around the globe. Springer, Cham, pp 53–76

    Chapter  Google Scholar 

  10. Johansson B (2014) Negativity in the public space: comparing a hundred years of negative campaigning on election posters in Sweden. In: Comparing political communication across time and space. Palgrave Macmillan, London, pp 67–82

    Google Scholar 

  11. Lasswell HD (1927) The theory of political propaganda. Am Polit Sci Rev 21(3):627–631

    Article  Google Scholar 

  12. Nelson RA (1997) A chronology and glossary of propaganda in the United States (book review). Journal Mass Commun Q 74(3):645

    Google Scholar 

  13. Marlin R (2013) Propaganda and the ethics of persuasion. Broadview Press, Canada

    Google Scholar 

  14. Brown É (2018) Propaganda, misinformation, and the epistemic value of democracy. Crit Rev 30(3–4):194–218

    Article  Google Scholar 

  15. Jowett GS, O’Donnell V (2018) Propaganda & persuasion. Sage, Thousand Oaks

    Google Scholar 

  16. Hacker JS (2004) Privatizing risk without privatizing the welfare state: the hidden politics of social policy retrenchment in the United States. Am Polit Sci Rev 98(2):243–260

    Article  Google Scholar 

  17. Sheafer T (2008) Charismatic communication skill, media legitimacy, and electoral success. J Polit Mark 7(1):1–24

    Google Scholar 

  18. Stephen T, Harrison TM, Husson W, Albert D (2004) Interpersonal communication styles of political candidates: predicting winning and losing candidates in three us presidential elections. Presidential candidate images, 177–196

  19. Woolley S, Guilbeault D (2017) Computational propaganda in the united states of america: manufacturing consensus online. Technical report, University of Oxford

  20. Ferrara E, Chang H, Chen E, Muric G, Patel J (2020) Characterizing social media manipulation in the 2020 us presidential election. First Monday 25(11–2)

  21. Brady WJ, Wills JA, Burkart D, Jost JT, Van Bavel JJ (2019) An ideological asymmetry in the diffusion of moralized content on social media among political leaders. J Exp Psychol Gen 148(10):1802

    Article  Google Scholar 

  22. Miller DT (2019) Topics and emotions in russian twitter propaganda. First Monday 24(5)

  23. Williamson W III, Scrofani J (2019) Trends in detection and characterization of propaganda bots. In: Proceedings of the 52nd Hawaii international conference on system sciences, pp 7118–7123

    Google Scholar 

  24. Khanday AMUD, Khan QR, Rabani ST (2021) Identifying propaganda from online social networks during Covid-19 using machine learning techniques. Int J Inf Technol 13(1):115–122

    Google Scholar 

  25. Gavrilenko O, Oliinyk Y, Khanko H (2019) Analysis of propaganda elements detecting algorithms in text data. In: International conference on computer science, engineering and education applications, pp 438–447

    Google Scholar 

  26. Nguyen N-L, Wang M-H, Dow C-R (2021) Learning to recognize sockpuppets in online political discussions. IEEE Syst J 16(2):1873–1884

    Article  Google Scholar 

  27. Mattes K, Spezio M, Kim H, Todorov A, Adolphs R, Alvarez RM (2010) Predicting election outcomes from positive and negative trait assessments of candidate images. Polit Psychol 31(1):41–58

    Article  Google Scholar 

  28. Håkansson N, Johansson B, Vigsø O (2017) From propaganda to image building: four phases of Swedish election poster history. In: Election posters around the globe. Springer, Cham, pp 319–337

    Chapter  Google Scholar 

  29. Fox CA (2022) Visualizing politics in Indonesia: the design and distribution of election posters. Int J Commun 16:4187–4209

    Google Scholar 

  30. Al-Azzawi QO, Saleh AKA (2021) A multimodal analysis of political posters of the American election of 2020. PalArch’s J Archaeol Egypt/Egyptol 18(7):416–428

    Google Scholar 

  31. Pretorius D (2021) President, preacher and populist: anc, da and eff leader posters of the 2019 South African elections. Crit Arts 35(2):16–38

    Article  MathSciNet  Google Scholar 

  32. Vliegenthart R (2012) The professionalization of political communication? A longitudinal analysis of Dutch election campaign posters. Am Behav Sci 56(2):135–150

    Article  Google Scholar 

  33. Benoit WL (2019) A functional analysis of visual and verbal symbols in presidential campaign posters, 1828–2012. Pres Stud Q 49(1):4–22

    Article  Google Scholar 

  34. O’Hagan LA (2022) “Alcohol is humanity’s enemy!” Propaganda posters and the 1922 Swedish prohibition referendum. Scand J Hist, 1–27

  35. Türkmenoğlu AT Orientalist traces in the brexit referendum: a semiotic analysis on the Brexit posters. Erciyes İletişim Dergisi 9(1):57–75

  36. Stockton H (2010) How rules matter: electoral reform in Taiwan. Soc Sci Q 91(1):21–41

    Article  Google Scholar 

  37. Fell D (2018) Government and politics in Taiwan. Routledge, Abingdon

    Book  Google Scholar 

  38. Romberg AD (2011) The 2012 Taiwan election: off and running. China Leadersh Monit 35:1–44

    Google Scholar 

  39. Tan A (2020) Party polarisation in new zealand and taiwan: an exploratory study

  40. Clark C, Tan AC (2012) Political polarization in Taiwan: a growing challenge to catch-all parties? J Curr Chin Aff 41(3):7–31

    Article  Google Scholar 

  41. Wang M-H, Chang AC-H, Chen K-T, Lei C-L (2017) Estimating ideological scores of Facebook pages: an empirical study in Taiwan. Comput J 60(11):1675–1686

    Article  Google Scholar 

  42. Tien H-M, Tung C-Y (2011) Taiwan in 2010: mapping for a new political landscape and economic outlook. Asian Surv 51(1):76–84

    Article  Google Scholar 

  43. Wu J-M (2016) The china factor in taiwan: impact and response. Routledge Handbook Contemp Taiwan, 426–446

  44. Stukal D, Sanovich S, Tucker JA, Bonneau R (2019) For whom the bot tolls: a neural networks approach to measuring political orientation of Twitter bots in Russia. SAGE Open 9(2):2158244019827715

    Article  Google Scholar 

  45. Beğenilmiş E, Uskudarli S (2019) Supervised learning methods in classifying organized behavior in tweet collections. Int J Artif Intell Tools 28(06):1960001

    Article  Google Scholar 

  46. Neyazi TA (2020) Digital propaganda, political bots and polarized politics in India. Asian J Commun 30(1):39–57

    Article  Google Scholar 

  47. Călin R-A, Bîrsănescu I-A (2017) Colour psychology. Creat Lang Soc Sci, 150

  48. Patil D (2012) Coloring consumer’s psychology using different shades the role of perception of colors by consumers in consumer decision making process: a micro study of select departmental stores in Mumbai city. India J Bus Retail Manag Res 7(1):60–73

    MathSciNet  Google Scholar 

Download references

Acknowledgements

We would like to thank Taiwan Information Environment Research Center (IORG) (https://iorg.tw) for their kind support in data collection and valuable advice for our work. We also thank the editor and anonymous reviewers for their insightful comments and suggestions. We also appreciate Mr. Jia-Ru Song for his careful comments on our manuscript.

Funding

This work was supported by National Science and Technology Council, Taiwan, under the Grant NSTC 111-2222-E-194-003, MOST 111-2622-E-194-005, MOST 110-2927-I-194-001, and MOST 111-2927-I-194-001.

Author information

Authors and Affiliations

Authors

Contributions

Conceptualization: MHW; Data curation: WYC, KHK; Formal analysis and Methodology: MHW, WYC; Visualization: MHW, WYC; First Draft: MHW, WYC; Revisions: MHW, WYC, KHK, KYT; Supervision: MHW, KYT. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Ming-Hung Wang.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, MH., Chang, WY., Kuo, KH. et al. Analyzing image-based political propaganda in referendum campaigns: from elements to strategies. EPJ Data Sci. 12, 29 (2023). https://doi.org/10.1140/epjds/s13688-023-00407-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1140/epjds/s13688-023-00407-4

Keywords