Code

v0.1.0 original#17

Code

Merged

henriquesposito merged 224 commits intomasterhenriquesposito/poldis:masterfrom develophenriquesposito/poldis:developCopy head branch name to clipboardJul 15, 2024

+4,516-291

Commits

Commits on Mar 9, 2023

• Some updates to text functions

  henriquesposito

  committed
  128c132

Commits on May 23, 2023

• Added urgency presentation

  henriquesposito

  committed
  86c28de

Commits on Feb 20, 2024

• Moved extract_treaties() function to poldis

  henriquesposito

  committed
  f3f76e5

Commits on Feb 21, 2024

• Added extract_from_pdf() draft function

  henriquesposito

  committed
  cc1ae90

Commits on Feb 26, 2024

• Removed non standard files in package

  henriquesposito

  committed
  78b8b56

• Small updates to extract script

  henriquesposito

  committed
  23686b7

• Reorganized scripts, updated documentation, and functions

  henriquesposito

  committed
  49ad7bd

Commits on Feb 27, 2024

• Added contributor names to description

  henriquesposito

  committed
  414ade9

Commits on Mar 10, 2024

• Added memo one as a case study, for now

  henriquesposito

  committed
  a541a08

Commits on Mar 11, 2024

• Cleaned mini urgency dictionary in case study

  henriquesposito

  committed
  1d5d065

Commits on Mar 12, 2024

• Updated annotate_text()

  henriquesposito

  committed
  84dd49f

• Added extract_promise() function

  henriquesposito

  committed
  8568bf0

Commits on Mar 15, 2024

• First attempt to extract subjects from text based on entity recognition

  henriquesposito

  committed
  b099f11

Commits on Mar 17, 2024

• Updated description file

  henriquesposito

  committed
  71da392

• Added memo 2 to case study folder

  henriquesposito

  committed
  adcd55f

• Added extract_related_terms()to segment functions

  henriquesposito

  committed
  36c2424

• Added get_urgency() function

  henriquesposito

  committed
  e88f55c

• Updated documention

  henriquesposito

  committed
  364f639

• Fixed knitting issue with Memo 2

  henriquesposito

  committed
  d42af7c

Commits on Mar 18, 2024

• Re-build README.md

  

  runner

  authored and

  jhollway

  committed
  30c12d0

• Added some frequency adverbs

  jhollway

  committed
  8e422c2

• Added some temporal adverbs

  jhollway

  committed
  3087d0a

• Added adverbs of degree

  jhollway

  committed
  6137a8f

• Re-build README.md

  

  runner

  authored and

  jhollway

  committed
  56aaa99

• Moved adverbs to urgency script in develop branch

  

  henriquesposito

  authored and

  jhollway

  committed
  16d6f22

• Ignore ds store

  jhollway

  committed
  86d3e4b

• Added frequency adverbs

  jhollway

  committed
  b263572

• Added first time adverb weightings

  jhollway

  committed
  fcbbde7

Commits on Mar 19, 2024

• Added some words for extracting promises

  jaeltan

  committed
  d0b8e9a

Commits on Mar 20, 2024

• Updated get_urgency() to account for word weights

  henriquesposito

  committed
  b8a73fb

• Updated extract_promises() to be more concise

  henriquesposito

  committed
  44fe8f6

• Updated extract_subjects() to work at the sentence level (i.e. for promises)

  henriquesposito

  committed
  4ff319c

• Made get_urgency()more concise and also to work at the sentence level

  henriquesposito

  committed
  2dad577

• Updated MEMO 2 for new changes

  henriquesposito

  committed
  93d6590

• First attempt to add commitment level to urgency

  henriquesposito

  committed
  687ca91

Commits on Mar 21, 2024

• Updated get_urgency() to be more concise and faster; the function now takes "subjects" as an argument.

  henriquesposito

  committed
  e2f4718

• Updated segment to add "class" to objects for later checking/identification

  henriquesposito

  committed
  460a837

• Updates to case study

  henriquesposito

  committed
  5a92d1c

• Effort at segmenting text

  jaeltan

  committed
  0a6d710

• Updated documentation across package for consistency

  henriquesposito

  committed
  56011a1

• Updated arguments in extract_subjects() to make the function more flexible

  henriquesposito

  committed
  04804b7

• Updated get_urgency() to normalize urgency score by the median number of words in promises

  henriquesposito

  committed
  f913aee

• Added examples to functions across package

  henriquesposito

  committed
  d5ca67f

Commits on Mar 22, 2024

• some preliminary adjustments to dictionary words and weightings

  jaeltan

  committed
  bb18ec6

Commits on Mar 24, 2024

• Updated examples, fixed small bugs, and added more todo for get_urgency()

  henriquesposito

  committed
  e53f253

• Updated Memo 3 for meeting

  henriquesposito

  committed
  e56c6e2

• Updated Memo 3

  henriquesposito

  committed
  6c9e7ea

• Ignored "DS_Store"

  henriquesposito

  committed
  e250bd2

Commits on Mar 25, 2024

• Added data on adverbs and adjectives form SO-CALL in package

  henriquesposito

  committed
  126baa2

• Added codes for adjectives and adverbs when coding urgency

  henriquesposito

  committed
  5645eea

• Updated urgency to score sentences based on lemmas instead of full words

  henriquesposito

  committed
  018c96c

Commits on Mar 26, 2024

• Updated description

  henriquesposito

  committed
  a4498c0

• Updated documentation and examples

  henriquesposito

  committed
  42c28dc

• extract_subjects() also accounts for nouns alongside entities. extract_related_terms() now accounts for only nouns and entities when coding related terms to subjects.

  henriquesposito

  committed
  37b3924

• Added user messages for get_urgency()

  henriquesposito

  committed
  7a80f10

Commits on Mar 27, 2024

• reformulated code for segmenting

  jaeltan

  committed
  3cb26e9

• Change segmenting to remove problems first before detecting promises

  jaeltan

  committed
  d1bce38

• added more words for detecting new segments

  jaeltan

  committed
  b07b629

• Updated documentation and examples

  henriquesposito

  committed
  4d9a7a5

• Updated annotate_text() to add variables for adverbs, adjectives, nouns, and entities to facilitate for getting promises, subjects, and urgency

  henriquesposito

  committed
  5dad533

• extract_subjects() and extract_related_terms() match only nouns and entites

  henriquesposito

  committed
  f3daa3a

• Updated internal data by adding lemmas to adjectives and adverbs

  henriquesposito

  committed
  0b1a058

• Updated adverbs and adjectives to use lemmas and match only when words are tagged as such

  henriquesposito

  committed
  9d4f65a

• Added sentence connector data

  henriquesposito

  committed
  9b0e5dc

• Added Memo 4 for meeting

  henriquesposito

  committed
  feb9c13

Commits on Mar 28, 2024

• Added to list of words for segmenting texts

  jaeltan

  committed
  13a0b47

• Added first version of rank_urgent_topics() function to rank urgent "topics"

  henriquesposito

  committed
  19003c0

Commits on Mar 29, 2024

• Renamed functions to rank topics get_urgency_rank() for consistency

  henriquesposito

  committed
  908d3c2

Commits on Apr 5, 2024

• Added WHO texts to Case Study file

  henriquesposito

  committed
  2dc545a

Commits on Apr 12, 2024

• Fixed small bug with promises extraction

  henriquesposito

  committed
  5a69131

Commits on Apr 18, 2024

• added sample texts from UNGDC database to case study

  jaeltan

  committed
  4786fcd

• modified extract_promises to identify problems and promises so that urgency scores can be computed on promises only

  jaeltan

  committed
  19806ea

• Small updates to extract_promises()

  henriquesposito

  committed
  68e3aa0

• get_urgency() is now more flexible and works when extract_related_terms() fail. Users can also now declare lists (as dictionaries) explicitly.

  henriquesposito

  committed
  cad9f60

• Added script on inter-coder reliability

  henriquesposito

  committed
  ce0d54a

• Small updates to inter-coder reliability script

  henriquesposito

  committed
  2e97a7c

• updated extract_promises to remove negative sentences

  jaeltan

  committed
  5870092

• updated extract_promises to retain only lemmas, adverbs, and adjectives for promise statements

  jaeltan

  committed
  69a665f

• updated namespace

  jaeltan

  committed
  b4be70b

• Updated get_urgency to work with new format of extract_promises

  jaeltan

  committed
  23cf2e6

• renamed segments in extract_promises output

  jaeltan

  committed
  40f4562

• fixed issue with inflated degree scores

  jaeltan

  committed
  6f9607a

Commits on Apr 19, 2024

• fixed issue with getting topics in get_urgency

  jaeltan

  committed
  2451d4a

• added code to filter out past sentences for promises

  jaeltan

  committed
  b6b888c

• Made some corrections to the way negative and past sentences are dealt with in promises

  jaeltan

  committed
  266cd2d

Commits on Apr 22, 2024

• Added memo for updates to extract_promises and get_urgency

  jaeltan

  committed
  16abbc3

• Changes to words for segmenting text

  jaeltan

  committed
  591d314

Commits on Apr 25, 2024

• Updated extract_related_terms() to rely on `keyATM, keyword-assisted topic models instead of LSS, for now

  henriquesposito

  committed
  ca8c293

Commits on Apr 26, 2024

• Fixed messages with annotate_text()

  henriquesposito

  committed
  fee39d6

• Fixed issues and updated extract_promises() by simplifying the function. Also updated extracted_related_terms().

  henriquesposito

  committed
  e8a7e3e

• Fixed small issues with get_urgency()

  henriquesposito

  committed
  45a795b

• Removed {rlang} from description file

  henriquesposito

  committed
  40058b5

Commits on Apr 28, 2024

• Added first draft of urgency methods

  henriquesposito

  committed
  4d02e42

Commits on Apr 29, 2024

• Updated extract_promises() to remove duplicates

  henriquesposito

  committed
  aeb124d

• Small updates to documentation for extract-promises()

  henriquesposito

  committed
  181266b

• updates to extract_promises to remove NAs, past sentences, and promises that coincide with problems properly

  jaeltan

  committed
  0720f4c

Commits on May 10, 2024

• Added COP21 Paris leaders meeting data

  henriquesposito

  committed
  2f861ab

Commits on May 15, 2024

• Added first version of website

  jaeltan

  committed
  c43ef90

• Added US data and RMD with data/figures to case study

  henriquesposito

  committed
  a54d913

Commits on May 17, 2024

• Added EU speeches data to Case Study

  henriquesposito

  committed
  e1d3ece

• Updated markdown in case study folder to include comparison between sentiment and urgency

  henriquesposito

  committed
  36d1c4c

Commits on May 21, 2024

• Updated extract_promises() to go back to working only at the sentence level

  henriquesposito

  committed
  fbc974c

• removed variables related to segments and added more matches for detecting promises

  jaeltan

  committed
  4a11a5b

• Added more word matches for filtering out statements that are not promises

  jaeltan

  committed
  78ab6af

Commits on May 22, 2024

• Changes to word matches for non-promises

  jaeltan

  committed
  d512a23

Commits on May 24, 2024

• Added urgency dictionary to case study for now

  jaeltan

  committed
  c47c13d

Commits on May 30, 2024

• Updated and reorganized text tools

  henriquesposito

  committed
  ba2ae3a

Commits on May 31, 2024

• Remove unused packages from description

  henriquesposito

  committed
  7212886

• Renamed and updated promises script

  henriquesposito

  committed
  2b025f3

• Updated how topics are extracted from texts

  henriquesposito

  committed
  1f15163

• Updated documentation for new changes

  henriquesposito

  committed
  9dd8878

• Updated package data by removing unecessary datasets and adding CAP topics and new urgency dictionary

  henriquesposito

  committed
  fcc6cc9

• Added additional files to case study, for now

  henriquesposito

  committed
  87afe15

• Updated variable names in urgency dictionary

  henriquesposito

  committed
  a17a237

Commits on Jun 3, 2024

• Updated get_urgency() to work with new dictionary and be more flexible

  henriquesposito

  committed
  7180fc7

• Removed get_urgency_rank() for now

  henriquesposito

  committed
  356da89

• Fixed documentation issue with promises

  henriquesposito

  committed
  7598c28

• Updated R dependency to 3.5. to avoid test issues

  henriquesposito

  committed
  ea5400f

• Updated documentation for extract_promises()

  henriquesposito

  committed
  c65f698

• Removed base R pipe in favor of {dplyr} pipe

  henriquesposito

  committed
  e64d36a

• Updated documentation for get_urgency()

  henriquesposito

  committed
  909f09d

Commits on Jun 4, 2024

• Added basic pkgdown website that works

  henriquesposito

  committed
  f25cf4d

• Added {pkgdown} to description file

  henriquesposito

  committed
  31bf4f9

• Added "case study" files to .Rbuildignore

  henriquesposito

  committed
  6db3a8e

• Renamed promises function select_promises()

  henriquesposito

  committed
  1372dd8

• Renamed topic functions gather_topics() and gather_related_terms()

  henriquesposito

  committed
  e44be85

• Do not run examples for extract_similarities() that contain warnings, for now

  henriquesposito

  committed
  1590b88

• Updated package documentation for new changes

  henriquesposito

  committed
  afb9d5f

• Small updates to documentation for text tools

  henriquesposito

  committed
  b732070

Commits on Jun 6, 2024

• Added new markdown to illustrate new changes

  henriquesposito

  committed
  cc2dfa4

Commits on Jun 7, 2024

• Updated documentation and fixed issues with examples

  henriquesposito

  committed
  5ad009e

• Updated GitHub actions to check code coverage and build website

  henriquesposito

  committed
  7d6c998

• Updated NEWS

  henriquesposito

  committed
  744be41

• Updated description file

  henriquesposito

  committed
  2934044

• removed dafault bump from push release workflow file

  henriquesposito

  committed
  d14c1f8

• Updated readme files by adding getting started text

  henriquesposito

  committed
  65013bf

• Updated README file

  henriquesposito

  committed
  0e33d67

• Merge branch 'master' into develop

  henriquesposito

  authored
  b7f1a77

• Updated tests to avoid check failures

  henriquesposito

  committed
  9ba9628

• Fixed some small code factor issues

  henriquesposito

  committed
  6818fcc

• Updated urgency dictionary csv file

  jaeltan

  committed
  405945c

Commits on Jun 10, 2024

• Moved case stiudy files to case-study branch

  henriquesposito

  committed
  d1d8faf

• Corrected function name for promises data and added CAP citation

  jaeltan

  committed
  8ffea73

• Made some minor edits to matched words for selecting promises

  jaeltan

  committed
  dcccf94

• Updated urgency words dictionary in sysdata

  jaeltan

  committed
  b84b49b

Commits on Jun 11, 2024

• Updated CAP_topics in sysdata to include British and American spellings, cleaned duplicate terms within each topic and added more relevant terms

  jaeltan

  committed
  1dc06bb

• Updated README to make it more concise

  henriquesposito

  committed
  3e2d10f

• Fixed dependency issues with extract_similarities()

  henriquesposito

  committed
  7b569e4

• Fixed issues with identifying similar names in extract_speaker()

  henriquesposito

  committed
  148e338

• Updated normalizing values in get_urgency()

  henriquesposito

  committed
  2bf586e

• Updated package documentation to improve consistency

  henriquesposito

  committed
  20a198e

• Fixed a few code issues from {lintr} checks

  henriquesposito

  committed
  323e559

• Corrected some missing British spelling and extra spaces found in CAP topics

  jaeltan

  committed
  46483ce

Commits on Jun 12, 2024

• Updated internal data

  henriquesposito

  committed
  3a1c6c8

• Updated internal data once more

  henriquesposito

  committed
  8a824d8

Commits on Jun 13, 2024

• Updates to readme

  jaeltan

  committed
  ec05edf

• Updated readme file

  henriquesposito

  committed
  cfc82ed

• Corrected some spelling and phrasing

  jaeltan

  committed
  a086741

• Delete .DS_Store

  henriquesposito

  authored
  1231de7

• Removed "case study" from .Rbuidignore

  henriquesposito

  committed
  a520fb8

• Moved a few imported packages to depends using thisRequires()

  henriquesposito

  committed
  88bf58a

• addressed some PR comments

  jaeltan

  committed
  d23c2bc

• Updated logo for vectorized version

  henriquesposito

  committed
  143853d

• Fixed more issues with readme

  henriquesposito

  committed
  7bed39e

• Renamed extract_similarities() to extract_text_similarities() and extract_speaker() to extract_names().

  henriquesposito

  committed
  23aaaa8

• Moved {stringdist} pachage to suggests

  henriquesposito

  committed
  2a7287a

• Updated documentation

  henriquesposito

  committed
  b7d69eb

• Small updates to readme

  henriquesposito

  committed
  907b17b

• Replaced "for loops" with vetorised version for efficiency

  henriquesposito

  committed
  6e88a66

• Renamed load_pdf() function to read_pdf()

  henriquesposito

  committed
  1b2d323

• Moved thisRequires()function to utils file

  henriquesposito

  committed
  c713cd4

Commits on Jun 14, 2024

• Removed for loops in text tools functions

  henriquesposito

  committed
  d760478

• Removed for loops in topic functions

  henriquesposito

  committed
  9cc8a90

• Fixed issues with declaring custom lists as dictionaries

  henriquesposito

  committed
  c4b2a5d

• Updated description branch

  henriquesposito

  committed
  2ca5884

• Updated extract_location() to use NLP instead to extract geographic locations

  henriquesposito

  committed
  5dd1c00

• Updated documentation for new changes

  henriquesposito

  committed
  5dd1933

• Moved .clean_token() function to utils

  henriquesposito

  committed
  f132a78

• Fixed issues related to how location and names are extracted and grouped

  henriquesposito

  committed
  2dac784

• Updated tests for new changes with extract_names() and extract_locations()

  henriquesposito

  committed
  01f2785

• Commented out examples for extract_locations()

  henriquesposito

  committed
  ec6b155

• Added tests for gather_topics()

  henriquesposito

  committed
  522a35f

• Added tests for urgency

  henriquesposito

  committed
  33bd91f

• Added tests for select_promises()

  henriquesposito

  committed
  1f040a3

• Added in line comments to select_promises() function

  henriquesposito

  committed
  055c962

• Updated how lists and vectors are identified in gather_topics()

  henriquesposito

  committed
  cd0cea5

• Fixed mispelling in split_text() documentation

  henriquesposito

  committed
  8c368c7

• Updated "return" documentation for all functions

  henriquesposito

  committed
  9d1f255

• Updates NEWS for consistency

  henriquesposito

  committed
  3956cea

• Updated documentation for functions to clarify various issues related to consistency and details

  henriquesposito

  committed
  27868ce

• Updated pkgdown.yml documentation

  henriquesposito

  committed
  a524e16

• Added in line comments for extract_context()

  henriquesposito

  committed
  8dcb041

Commits on Jun 17, 2024

• Updated NEWS file

  henriquesposito

  committed
  85f6eee

• Updated documentation across package to fix spelling mistakes

  henriquesposito

  committed
  2183b14

• Updated logos in package and in website to make these consistent

  henriquesposito

  committed
  e10334e

• Fixed notes with win devel checks

  henriquesposito

  committed
  c4725d4

• Updated decription file to avoid CRAN check issues

  henriquesposito

  committed
  c63cfc8

• More updates to description file

  henriquesposito

  committed
  78df503

• Small updates to description

  henriquesposito

  committed
  c0e7cc6

• Small changes in description file

  henriquesposito

  committed
  a3b7f3c

• More updates to description file

  henriquesposito

  committed
  fa97186

• Updates to description file

  henriquesposito

  committed
  f4d4891

Commits on Jun 27, 2024

• gather_topic() now returns a vector to facilitate working with 'urgency' data frames

  henriquesposito

  committed
  cd05aa1

Commits on Jul 2, 2024

• Updated urgency internal data

  henriquesposito

  committed
  2f53fe0

• Updated number of rows for urgency normalization

  henriquesposito

  committed
  2796f19

• Added argument to remove missing abservation in select_promises()

  henriquesposito

  committed
  6ecd6be

• More examples for get_urgency()

  henriquesposito

  committed
  1edf73f

• Updated date and suggested packages in description file

  henriquesposito

  committed
  4b205e1

• Updated NEWS for some more changes

  henriquesposito

  committed
  2fd78f7

• Added plotting and summary methods for "urgency" and "topics" classes

  henriquesposito

  committed
  032856a

• Updated examples for select_topics()

  henriquesposito

  committed
  f39adb3

• Fixed bugs with plot and summary methods for "topics" and "urgency"

  henriquesposito

  committed
  bff1ecd

Commits on Jul 3, 2024

• Fixed issues with internal data for urgency terms

  henriquesposito

  committed
  7c44f4b

• Made gather_topics() function more strict with topic matching by only matching defined strings

  henriquesposito

  committed
  e19907e

• Updated get_urgency() function to also be more strict with the matching of urgency words. Default normalization by dimension was also removed, for now.

  henriquesposito

  committed
  af6f897

• Small updates to internal data

  henriquesposito

  committed
  fcbb72d

• Removed uneccesary suggested packages in description

  henriquesposito

  committed
  48e14d7

• .clean_token() helper function does not remove punctuation or stopwords anymore

  henriquesposito

  committed
  33551f9

• Fixed ordering bug with get_urgency()

  henriquesposito

  committed
  7a390b5

• Small updates to gather_topic() to make it more efficient

  henriquesposito

  committed
  8c23719

• Fixed test issues with new changes in functions

  henriquesposito

  committed
  4b96a9f

• Moved {tm} package to suggests

  henriquesposito

  committed
  e6eaa9f

Commits on Jul 15, 2024

• Updated date in NEWS and description

  henriquesposito

  committed
  1e108ea

• Built website to check

  henriquesposito

  committed
  5ad0f81