rectr

class: center, middle, inverse, title-slide

# rectr
## Reproducible Extraction of Cross-lingual Topics using R
### Chung-hong Chan
### 2020-05-09

---

# Multilingual data: Topic model

* Welche Schäden Covid-19 im Körper anrichtet?
* 警與狗配圖教「狗」字 太陽島：是警犬 沿用11年
* Macron veut prolonger les droits des intermittents du spectacle jusqu'à août 2021
* Bevrijdende signaal in Europese voetbalcrisis komt uit Berlijn
* 現地調査は「正しい雰囲気で」　コロナ起源巡り中国大使
*  ‘사퇴 거부’ 양정숙ㆍ시민당 맞고소 진흙탕 싸움 
* الشفاء من فيروس كورونا: روايات مرضى لا يستطيعون التخلص من الفيروس
* דו"ח פנימי בסין: העוינות בין בייג'ין לוושינגטון עלולה להידרדר לעימות מזוין

---

# Path of least resistance

![](kater.png)

.small[.footnote[
[1] De Vries, E., Schoonvelde, M., & Schumacher, G. (2018). No longer lost in translation: Evidence that Google Translate works for comparative bag-of-words text applications. Political Analysis, 26(4), 417–430.

[2] Reber, U. (2019). Overcoming Language Barriers: Assessing the Potential of Machine Translation and Topic Modeling for the Comparative Analysis of Multilingual Text Corpora. Communication Methods and Measures, 13(2), 102–125.
]
]

---

# Context matters

.pull-left[
<img src = "kater1.png" height = 300>
]

.pull-right[
<img src = "kater2.png" height = 300>
]

---

# Reproducibility matters

.pull-left[
![](google-wave-logo.jpg)
]

.pull-right[
![](google-plus.jpg)
]

.center[Do you remember them?]

???

killedbygoogle.com
---

# Our proposal

.pull-left[
1. A 5-step process

2. Human validation
]

.pull-right[

]

In an easy-to-use <svg style="height:0.8em;top:.04em;position:relative;" viewBox="0 0 581 512"><path d="M581 226.6C581 119.1 450.9 32 290.5 32S0 119.1 0 226.6C0 322.4 103.3 402 239.4 418.1V480h99.1v-61.5c24.3-2.7 47.6-7.4 69.4-13.9L448 480h112l-67.4-113.7c54.5-35.4 88.4-84.9 88.4-139.7zm-466.8 14.5c0-73.5 98.9-133 220.8-133s211.9 40.7 211.9 133c0 50.1-26.5 85-70.3 106.4-2.4-1.6-4.7-2.9-6.4-3.7-10.2-5.2-27.8-10.5-27.8-10.5s86.6-6.4 86.6-92.7-90.6-87.9-90.6-87.9h-199V361c-74.1-21.5-125.2-67.1-125.2-119.9zm225.1 38.3v-55.6c57.8 0 87.8-6.8 87.8 27.3 0 36.5-38.2 28.3-87.8 28.3zm-.9 72.5H365c10.8 0 18.9 11.7 24 19.2-16.1 1.9-33 2.8-50.6 2.9v-22.1z"/></svg> package: rectr

---
# An example

3139 articles with the keyword **Paris** from Nov 1 2015 to Dec 31 2015 from The New York Times (English), Süddeutsche Zeitung (German) and Le Figaro (French).

Data requirement:

1. character vector of content, e.g. `paris$content`
2. character vector of language, e.g. `paris$lang`

```r
c("fr", "de", "en")
```
---

# Step 0: Download word embeddings

.pull-left[

```r
get_ft("fr")
get_ft("de")
get_ft("en")
```

]

.pull-right[

]

You can archive the word embeddings, hence it is reproducible.

---
# Step 1: Read word embeddings

```r
emb <- read_ft(c("fr", "de", "en"))
```

---
# Step 2: Create a multilingual corpus

Create a quanteda compatible multilingual corpus

```r
paris_corpus <- create_corpus(paris$content, paris$lang)
paris_corpus
```

```
## Corpus consisting of 3,391 documents and 1 docvar.
## text1 :
## "Avec plus de 100 000 cas par an, c'est la 3e cause de mort d..."
## 
## text2 :
## "LE FIGARO. - Lors des derniers Entretiens de Bichat (sur l'é..."
## 
## text3 :
## "L'ancien ambassadeur en Iran, analyste  de politique interna..."
## 
## text4 :
## "Le président de l'agence de communication Tilder a monté l'e..."
## 
## text5 :
## "Lancé voici un an par la Commission européenne, présenté par..."
## 
## text6 :
## "Après 18 mois de psychodrame, le groupe américain prend enfi..."
## 
## [ reached max_ndoc ... 3,385 more documents ]
```

---
# Step 3: Create document-feature matrix with word embeddings

```r
paris_dfm <- transform_dfm_boe(paris_corpus, emb)
```

```r
paris_dfm
```

```
## dfm with a dimension of 3391 x 300 and fr/en/de language(s).
```

---
# Step 4: Filter the DFM by k

k: number of topics

```r
paris_dfm_filtered <- filter_dfm(paris_dfm,
                                 paris_corpus, k = 5)
paris_dfm_filtered
```

```
## dfm with a dimension of 3391 x 11 and fr/en/de language(s).
## Filtered with k =  5
```

---
# Step 5: Fit a Guassian Mixture Model

```r
paris_gmm <- calculate_gmm(paris_dfm_filtered, seed = 42)
paris_gmm
```

```
## 5-topic rectr model trained with a dfm with a dimension of 3391 x 11 and fr/en/de language(s).
## Filtered with k =  5
```

```r
dim(paris_gmm$theta)
```

```
## [1] 3391    5
```

---
# Articles with high `$\theta_{t}$`

<div id="htmlwidget-270420b066e36ce9489c" style="width:100%;height:auto;" class="datatables html-widget"></div>
<script type="application/json" data-for="htmlwidget-270420b066e36ce9489c">{"x":{"filter":"none","data":[["1","2","3","4","5","6","7","8","9","10","11","12","13","14","15","16","17","18","19","20","21","22","23","24","25","26","27","28","29","30","31","32","33","34","35","36","37","38","39","40","41","42","43","44","45","46","47","48","49","50","51","52","53","54","55","56","57","58","59","60","61","62","63","64","65","66","67","68","69","70","71","72","73","74","75"],["Nahost-Deutschland; Hassparolen gegen Israel, Überfälle, Hunderttausende Flüchtlinge. Bei vielen Juden hierzulande wächst das Unbehagen. Andere versuchen, es zu überwinden: indem sie die Hand ausstrecken\n","RAZZIA-FOTO; Ein Detail zu viel\n","Mehr Polizisten, aber keine Soldaten; Die Kanzlerin spricht sich gegen den Einsatz der Bundeswehr an den Grenzen oder im Inneren aus. CSU-Chef Seehofer stellt ihr eine Art Ultimatum\n","USA; Obamas Widerwille\n","Die Spur nach Belgien; In dem zerstrittenen Land tun sich Islamisten leicht\n","A Dutch ISIS Fighter Is Taking Questions on Tumblr\n","Geneva Raises Level of Alert for Possible Terrorism Suspects\n","Anxiety Rising\n","After the Carnage in Paris\n","U.S. Defense Chief Prods Gulf States to Take Larger Role in ISIS Fight\n","Filière djihadiste : les écoutes qui écornent la fable du « voyage humanitaire » en Syrie\n","Les blessés, ces victimes oubliées\n","Des textes sur le djihad, une arme... la mosquée de Lagny a été fermée\n","Les ratés de l'antiterrorisme\n","Ces djihadistes francophones que Daech fait passer à l'action\n","MINISTERERLAUBNIS; Haub lenkt, Gabriel denkt\n","Das kommt 2016; Viele neue Automodelle sind für das kommende Jahr angekündigt, mit neuem Design und neuen Motoren. Doch der fällige Paradigmenwechsel mit Digitalisierung und alternativen Antrieben kommt nur mühsam voran\n","Die Bremser\n","Flammender Alarm; Seit Jahrzehnten ist ein Spanier dem CO&sub2; auf der Spur\n","Ab nach unten; Je länger die Weltgemeinschaft mit CO&sub2;-Einsparungen wartet, desto mehr werden riskante Technologien wie das Verpressen des Gases im Erdboden notwendig. In Kanada wird das sogenannte CCS bereits seit einem Jahr praktiziert\n","Mennonite Farmers Are Leaving Mexico, and Competition for Water\n","Amid Divisions, Optimism for a Climate Deal\n","The Tech Gods Giveth\n","Period of Soaring Emissions May Be Ending, New Data Suggest\n","Prices Drop as Supply of Oil Soars Worldwide\n","Budget : Juncker soutient Paris\n","« Paris doit marquer un véritable tournant »Ban Ki-moon, secrétaire général de l'ONU\n","Laurent Poupart : « Nous allons au-delà du programme »\n","Lignes rouges\n","Les passeurs d'une ambition\n","CSU-KREISRAT AUF FACEBOOK; Dresden lässt grüßen\n","Trauma; In jeder Familie Europas steckt ein Stück Krieg. Wer dem Terror mit militärischer Gewalt begegnen will, sollte das bedenken\n","Des Menschen Unfasslichkeit; Eberhard Straub hat ein fulminantes, ganz eigenes Lob der Großstadt geschrieben\n","Anschläge fachen deutsche Flüchtlingsdebatte an; Bayerns Ministerpräsident Seehofer weist seinen Finanzminister zurecht, der die Kanzlerin kritisiert hatte\n","Alle gegen rechts; Frankreichs Premier warnt vor Krieg, sollte der Front National am Sonntag siegen\n","Nostalgia and Fear, Fueling Literature\n","'Enough Is Enough,' Obama Says After the Latest Outbreak of Gun Violence\n","Washington Is Next on Hollande Tour to Press Allies for Anti-ISIS Coalition\n","A Red State, but Still an Uphill G.O.P. Bid\n","National Front Stumbles in French Elections\n","Les Républicains anticipent un probable recul de l'exécutif\n","La maire de Paris se rêve en Martine Aubry\n","Valérie Pécresse :  « Bartolone, c'est l'homme d'un clan »\n","La droite s'indigne de la reconduction de Bartolone\n","Île-de-France : Pécresse confirme son avance\n","NAHAUFNAHME; Das Leben, eine Seifenoper; Der Unternehmer Tapie muss 404 Millionen Euro zurückzahlen\n","Hans in Not; Vize-Generalsekretär des DFB steht wegen Warner-Papier vor Rauswurf\n","Zlatans Einladung; Fußball-Narziss Ibrahimovic gastiert mit Paris in Malmö, wo seine Saga Fahrt aufnahm – als Ehrerweisung bittet er seine Heimatstadt zum Public-Viewing-Fest\n","„Privatsache“; Entlastendes Platini-Dokument umstritten\n","PROFIL; Lassana Diarra; Französischer Fußballer, der trotz Trauer spielt\n","As Carnage Unfolded Outside Stadium in France, Many Inside Were Unaware\n","Gabon Advances in Qualifying\n","Two Finals Entail Two Surfaces for Murray\n","Questions Begin After United Is Ousted\n","Guardiola Will Leave Bayern\n","Une finale sous haute sécurité\n","Fifa : le camp Platini dénonce un procès en sorcellerie\n","Tavernost : « M6 ne veut pas se débarrasser des Girondins »\n","Deux défis de choix pour les Bleus à Bercy\n","Pourquoi le PSG est favori pour sa belle avec Chelsea\n","Stille Anteilnahme in Gröbenzell; Bürgermeister Martin Schäfer ruft zum Gedenken auf\n","WIR HABEN VERSTANDEN\n","München spendet Trost und Kraft\n","„. . . und sie töteten alle“; Während ihres Konzertes in Paris starben 89 Menschen durch die Gewalt der Terroristen – jetzt geben die „Eagles of Death Metal“ ihr erstes Interview\n","Die Fahrende; Ilma Rakusa, die große Europäerin der Literatur, wird 70\n","Two Collectors Who Bought Early and Often\n","Weaving the Entire Hall Into a Labyrinthine Plot\n","A Comic Book in the Company of Masterpieces\n","Transported Around the Globe and Across the Centuries\n","French Artists Find a Way to Take Their Irreverence to the Grave\n","Talisman, une familiale fort précieuse\n","CARNET DE ROUTE\n","Les maisons de ventes réestiment leur offre\n","La môme noir et jaune\n","sortir du bois\n"],["de","de","de","de","de","en","en","en","en","en","fr","fr","fr","fr","fr","de","de","de","de","de","en","en","en","en","en","fr","fr","fr","fr","fr","de","de","de","de","de","en","en","en","en","en","fr","fr","fr","fr","fr","de","de","de","de","de","en","en","en","en","en","fr","fr","fr","fr","fr","de","de","de","de","de","en","en","en","en","en","fr","fr","fr","fr","fr"],[0.846721782236191,0.862754458288053,0.919468808952656,0.986933549505622,0.999994522528256,0.973165343697385,0.984181181840741,0.988624588572492,0.997488970335843,0.999991585249253,0.898834012140729,0.982014031629418,0.999357599658476,0.99936870981845,0.999985905619504,0.82722610801951,0.859385322816291,0.999463987076866,0.999792356225764,0.999999999994873,0.814138061481971,0.923858580888075,0.937566884093632,1,1,0.916153171789382,0.955336629193066,0.999582374141236,0.999866077614389,0.999960013021718,0.879158978970743,0.931468358953295,0.958400449635906,0.997726896250113,1,0.863327632630441,0.89580245826134,0.984319679019292,0.999868759347606,0.999999999974182,0.8688631292782,0.999999908491173,0.999999914568459,0.999999972032228,1,0.928627306642318,0.95505950615129,0.99413689377477,0.999999514932288,0.999999917437311,0.999999793130456,1,1,1,1,0.999876404768316,0.999991060815433,0.999999995116863,1,1,0.808844772044791,0.885112361220793,0.911483353651139,0.941111767783137,0.972691945802234,0.913122689948928,0.965512551408325,0.999128777778225,0.99933022657455,0.999856192160877,0.983358716035825,0.998303685690823,0.998484158028369,0.999698124704861,0.999996941912123],[1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,3,3,3,3,3,3,3,3,3,3,3,3,3,3,3,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,5,5,5,5,5,5,5,5,5,5,5,5,5,5,5]],"container":"<table class=\"display\">\n  <thead>\n    <tr>\n      <th> <\/th>\n      <th>headline<\/th>\n      <th>lang<\/th>\n      <th>prob<\/th>\n      <th>topic<\/th>\n    <\/tr>\n  <\/thead>\n<\/table>","options":{"pageLength":5,"columnDefs":[{"className":"dt-right","targets":[3,4]},{"orderable":false,"targets":0}],"order":[],"autoWidth":false,"orderClasses":false,"lengthMenu":[5,10,25,50,100],"rowCallback":"function(row, data) {\nDTWidget.formatRound(this, row, data, 3, 2, 3, \",\", \".\");\nvar value=data[1]; $(this.api().cell(row, 1).node()).css({'font-size':'65%'});\nvar value=data[2]; $(this.api().cell(row, 2).node()).css({'font-size':'65%'});\nvar value=data[3]; $(this.api().cell(row, 3).node()).css({'font-size':'65%'});\nvar value=data[4]; $(this.api().cell(row, 4).node()).css({'font-size':'65%'});\n}"}},"evals":["options.rowCallback"],"jsHooks":[]}</script>

---
# The team

* Chung-hong Chan (U Mannheim)
* Jing Zeng (UZH)
* Hartmut Wessler (U Mannheim)
* Marc Jungblut (LMU München)
* Kasper Welbers (VU Amsterdam)
* Joseph Bajjalieh  (UIUC)
* Wouter van Atteveldt (VU Amsterdam)
* Scott Althaus (UIUC)

Part of the [Responsible Terrorism Coverage](https://responsibleterrorismcoverage.org/) Project

---
background-image: url(https://media.giphy.com/media/llKJGxQ1ESmac/source.gif)
background-position: center
background-size: cover
class: hide-logo, center,  hide-footer, middle

.imagelab[ICA Computational Methods Top Paper]

---
class: center, hide-logo

# Available now!