 jherve
|
b615c9ec14
Change _log function
|
1 年之前 |
|
jherve
|
f6e0afb5f2
Add a proper job
|
1 年之前 |
|
jherve
|
ce3f860974
Add a job abstraction
|
1 年之前 |
|
jherve
|
4626fa3588
Add QueueWorker
|
1 年之前 |
|
jherve
|
9a355a25e7
[wip] Redesigning the tasks
|
1 年之前 |
|
jherve
|
dca525b846
Fix parsing of bfmtv/lemonde/leparisien pages
|
1 年之前 |
|
jherve
|
32daeffb86
Fix parsing of france_tv_info
|
1 年之前 |
|
jherve
|
dcc447d5c4
Remove useless run_in_executor for parsing
|
1 年之前 |
|
jherve
|
e7cfa39979
Allow list[str] as argument for _from_row
|
1 年之前 |
|
jherve
|
7f0578fba2
Remove useless _view/table_by_name functions
|
1 年之前 |
|
jherve
|
a23394caee
Use those methods in france_tv_info
|
1 年之前 |
|
jherve
|
7de4afd9ec
Change get_main/top_article to class methods
|
1 年之前 |
|
jherve
|
615b6dd102
Make distinction between highlighted/non-highlighted articles for FTv
|
1 年之前 |
|
jherve
|
e4879dd108
Add flags in main_articles table for live/highlighted
|
1 年之前 |
|
jherve
|
4343f05778
Add flags for highlighted/live articles
|
1 年之前 |
|
jherve
|
5ca6864b59
Use an enum for column types
|
1 年之前 |
|
jherve
|
c05f653a97
Add link to the frontpage snapshot
|
1 年之前 |
|
jherve
|
6c9e31061b
Update alias of frontpage in view
|
1 年之前 |
|
jherve
|
6a2b6ad2aa
Reimplement parsing for all medias
|
1 年之前 |
|
jherve
|
b263621447
Add a subclass of BeautifulSoup with extra methods
|
1 年之前 |
|
jherve
|
0021efd424
Properly check that strings are not None
|
1 年之前 |
|
jherve
|
7d3d2b2627
Allow replaying data from a previously failed snapshot
|
1 年之前 |
|
jherve
|
ff549ef0f2
Dump the job in pickle format on error
|
1 年之前 |
|
jherve
|
04a602219c
Attribute a unique monotonic id to each job
|
1 年之前 |
|
jherve
|
576ed08b51
All parsing errors details are now written in the same tmp dir
|
1 年之前 |
|
jherve
|
045e8b11d3
Add Reference class
|
1 年之前 |
|
jherve
|
7ed2e18351
Rename ambiguous "snapshot" to "frontpage"
|
1 年之前 |
|
jherve
|
f829676bdc
Export definition of tables/views
|
1 年之前 |
|
jherve
|
7c555c7395
Compute name of unique indices
|
1 年之前 |
|
jherve
|
6d305a47bb
Simplify database schema
|
1 年之前 |
