 jherve
|
dca525b846
Fix parsing of bfmtv/lemonde/leparisien pages
|
vor 1 Jahr |
|
jherve
|
32daeffb86
Fix parsing of france_tv_info
|
vor 1 Jahr |
|
jherve
|
dcc447d5c4
Remove useless run_in_executor for parsing
|
vor 1 Jahr |
|
jherve
|
e7cfa39979
Allow list[str] as argument for _from_row
|
vor 1 Jahr |
|
jherve
|
7f0578fba2
Remove useless _view/table_by_name functions
|
vor 1 Jahr |
|
jherve
|
a23394caee
Use those methods in france_tv_info
|
vor 1 Jahr |
|
jherve
|
7de4afd9ec
Change get_main/top_article to class methods
|
vor 1 Jahr |
|
jherve
|
615b6dd102
Make distinction between highlighted/non-highlighted articles for FTv
|
vor 1 Jahr |
|
jherve
|
e4879dd108
Add flags in main_articles table for live/highlighted
|
vor 1 Jahr |
|
jherve
|
4343f05778
Add flags for highlighted/live articles
|
vor 1 Jahr |
|
jherve
|
5ca6864b59
Use an enum for column types
|
vor 1 Jahr |
|
jherve
|
c05f653a97
Add link to the frontpage snapshot
|
vor 1 Jahr |
|
jherve
|
6c9e31061b
Update alias of frontpage in view
|
vor 1 Jahr |
|
jherve
|
6a2b6ad2aa
Reimplement parsing for all medias
|
vor 1 Jahr |
|
jherve
|
b263621447
Add a subclass of BeautifulSoup with extra methods
|
vor 1 Jahr |
|
jherve
|
0021efd424
Properly check that strings are not None
|
vor 1 Jahr |
|
jherve
|
7d3d2b2627
Allow replaying data from a previously failed snapshot
|
vor 1 Jahr |
|
jherve
|
ff549ef0f2
Dump the job in pickle format on error
|
vor 1 Jahr |
|
jherve
|
04a602219c
Attribute a unique monotonic id to each job
|
vor 1 Jahr |
|
jherve
|
576ed08b51
All parsing errors details are now written in the same tmp dir
|
vor 1 Jahr |
|
jherve
|
045e8b11d3
Add Reference class
|
vor 1 Jahr |
|
jherve
|
7ed2e18351
Rename ambiguous "snapshot" to "frontpage"
|
vor 1 Jahr |
|
jherve
|
f829676bdc
Export definition of tables/views
|
vor 1 Jahr |
|
jherve
|
7c555c7395
Compute name of unique indices
|
vor 1 Jahr |
|
jherve
|
6d305a47bb
Simplify database schema
|
vor 1 Jahr |
|
jherve
|
ae50096379
Add an abstract class for Storage
|
vor 1 Jahr |
|
jherve
|
4ef5335816
Move some classes to a storage abstraction module
|
vor 1 Jahr |
|
jherve
|
ade9b5968c
Add TF1Info media
|
vor 1 Jahr |
|
jherve
|
d8e8323043
Fix grid for articles published at same time
|
vor 1 Jahr |
|
jherve
|
085a82b5b1
Update README
|
vor 1 Jahr |
