 jherve
|
80ce86dba1
Change attribute name for queue
|
2 years ago |
|
jherve
|
df5cfce360
Remove useless int parameter for worker classes + cleanup
|
2 years ago |
|
jherve
|
7ccbf4584c
Add a WebService
|
2 years ago |
|
jherve
|
8c7d187433
[unrelated] Properly close storage on web app exit
|
2 years ago |
|
jherve
|
68d3748fed
Remove fake workers
|
2 years ago |
|
jherve
|
2ec2560a91
Properly handle storage close
|
2 years ago |
|
jherve
|
b615c9ec14
Change _log function
|
2 years ago |
|
jherve
|
f6e0afb5f2
Add a proper job
|
2 years ago |
|
jherve
|
ce3f860974
Add a job abstraction
|
2 years ago |
|
jherve
|
4626fa3588
Add QueueWorker
|
2 years ago |
|
jherve
|
9a355a25e7
[wip] Redesigning the tasks
|
2 years ago |
|
jherve
|
dca525b846
Fix parsing of bfmtv/lemonde/leparisien pages
|
2 years ago |
|
jherve
|
32daeffb86
Fix parsing of france_tv_info
|
2 years ago |
|
jherve
|
dcc447d5c4
Remove useless run_in_executor for parsing
|
2 years ago |
|
jherve
|
e7cfa39979
Allow list[str] as argument for _from_row
|
2 years ago |
|
jherve
|
7f0578fba2
Remove useless _view/table_by_name functions
|
2 years ago |
|
jherve
|
a23394caee
Use those methods in france_tv_info
|
2 years ago |
|
jherve
|
7de4afd9ec
Change get_main/top_article to class methods
|
2 years ago |
|
jherve
|
615b6dd102
Make distinction between highlighted/non-highlighted articles for FTv
|
2 years ago |
|
jherve
|
e4879dd108
Add flags in main_articles table for live/highlighted
|
2 years ago |
|
jherve
|
4343f05778
Add flags for highlighted/live articles
|
2 years ago |
|
jherve
|
5ca6864b59
Use an enum for column types
|
2 years ago |
|
jherve
|
c05f653a97
Add link to the frontpage snapshot
|
2 years ago |
|
jherve
|
6c9e31061b
Update alias of frontpage in view
|
2 years ago |
|
jherve
|
6a2b6ad2aa
Reimplement parsing for all medias
|
2 years ago |
|
jherve
|
b263621447
Add a subclass of BeautifulSoup with extra methods
|
2 years ago |
|
jherve
|
0021efd424
Properly check that strings are not None
|
2 years ago |
|
jherve
|
7d3d2b2627
Allow replaying data from a previously failed snapshot
|
2 years ago |
|
jherve
|
ff549ef0f2
Dump the job in pickle format on error
|
2 years ago |
|
jherve
|
04a602219c
Attribute a unique monotonic id to each job
|
2 years ago |
