Commits

Branch selector

 master

User selector

jimregan

All time

Commit History

Commits on Aug 10, 2021

• [ga] skip search results also

  jimregan

  committedAug 10, 2021
  7a218c2

• [ga] update crawler

  jimregan

  committedAug 10, 2021
  3a9c446

Commits on Nov 20, 2019

• [ga] new crawlers

  jimregan

  committedNov 20, 2019
  3f7aff5

Commits on Nov 16, 2019

• Irish Times changed the section name

  jimregan

  committedNov 16, 2019
  c7922ba

• use context setter for Irish Times (requires at least TLSv1_2)

  jimregan

  committedNov 16, 2019
  a24ed38

• make (ssl) context a property, add setter

  jimregan

  committedNov 16, 2019
  bc012db

Commits on Nov 6, 2019

• strip more boilerplate

  jimregan

  committedNov 6, 2019
  ba8c432

• fix regex

  jimregan

  committedNov 6, 2019
  0a2089e

Commits on May 8, 2018

• US embassy crawler for Polish (#38)

  

  jimregan

  authored and

  brawer

  committedMay 8, 2018
  cb81515

Commits on Dec 27, 2017

• [ga] Crawl additional Irish sites

  

  jimregan

  authored and

  brawer

  committedDec 27, 2017
  2180472

Commits on Dec 26, 2017

• CHG crawler (#35)

  

  jimregan

  authored and

  brawer

  committedDec 26, 2017
  4b181a8

• remove comment

  jimregan

  committedDec 26, 2017
  a65b268

• Irish Times

  jimregan

  committedDec 26, 2017
  8dbbf74

Commits on Dec 15, 2017

• continue if no text available; Achi bible has text in browser but not from crawler (or curl)

  

  jimregan

  authored and

  brawer

  committedDec 15, 2017
  d12e53c

• Belarusian, Bulgarian, Bambara

  

  jimregan

  authored and

  brawer

  committedDec 15, 2017
  09f24f1

• Bashkir

  

  jimregan

  authored and

  brawer

  committedDec 15, 2017
  aec1108

• Add Amharic

  

  jimregan

  authored and

  brawer

  committedDec 15, 2017
  d11ac86

• move crawl_bibleis to util; add for Ukrainian

  

  jimregan

  authored and

  brawer

  committedDec 15, 2017
  b1756ac

Commits on Dec 14, 2017

• bible crawl

  

  jimregan

  authored and

  brawer

  committedDec 14, 2017
  7a7ca05

• basic crawler for Aceh

  

  jimregan

  authored and

  brawer

  committedDec 14, 2017
  3142598

Commits on Nov 3, 2017

• [mi] (public domain) Bible scraper

  

  jimregan

  authored and

  brawer

  committedNov 3, 2017
  2d1431c

• another sentence start to omit

  

  jimregan

  authored and

  brawer

  committedNov 3, 2017
  313402a

Commits on Nov 2, 2017

• [ga] conditions were right, needed to cast to int

  

  jimregan

  authored and

  brawer

  committedNov 2, 2017
  7d68c92

• need more ns/no ns handling here

  

  jimregan

  authored and

  brawer

  committedNov 2, 2017
  97a70e3

Commits on Nov 1, 2017

• [ga] url conditions were backwards

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  d1f51a9

• handle mixed broken/unbroken namespaces

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  039de18

• fix regex

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  63554b8

• [ga] get rid of duplicate sitemap crawler

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  20427b2

• strip cookie warnings, etc.

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  4ea2d51

• some of the files in the sitemap do not exist

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  c53b003

• deal with RTE's funky sitemap

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  bedad9d

• change to Translation.en:

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  54e8098

• skip articles that describe a news programme (with identical text each time)

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  bf63f98

• make tags conditional, they aren't always present

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  01901b6

• some fixes; also crawl the sport section

  

  jimregan

  authored and

  brawer

  committedNov 1, 2017
  d9997f7

Pagination

PreviousNext