jherve
|
d7c8392903
Make embeddings worker loop
|
vor 1 Jahr |
jherve
|
d667393d7a
Add more workers
|
vor 1 Jahr |
jherve
|
be780f47b0
Refactor logging for Workers
|
vor 1 Jahr |
jherve
|
baafa29b0f
Do not use tricks to modify EmbeddingsWorker instance
|
vor 1 Jahr |
jherve
|
ae2a12a65c
Fix method names
|
vor 1 Jahr |
jherve
|
2ec883babb
Add an abstraction for application
|
vor 1 Jahr |
jherve
|
299feac56b
Ensure index worker is triggered on addition of embeddings
|
vor 1 Jahr |
jherve
|
7fcffc1aa2
Allow SimilaritySearchIndex to be recreated (not using singleton)
|
vor 1 Jahr |
jherve
|
1dd69caaee
Change outbound queue behaviour
|
vor 1 Jahr |
jherve
|
9a739012af
Add a similarity index worker
|
vor 1 Jahr |
jherve
|
42e95cfc2b
Make embeddings worker run in loop
|
vor 1 Jahr |
jherve
|
4b25b17f11
Add an embeddings watchdog
|
vor 1 Jahr |
jherve
|
56a4b4683d
Improve log
|
vor 1 Jahr |
jherve
|
2c7ac6dcd2
Revert "[unrelated] Properly close storage on web app exit"
|
vor 1 Jahr |
jherve
|
4ff66da97d
Add the missing jobs
|
vor 1 Jahr |
jherve
|
71a5c08c32
Add fetch stage and outbound queue notion
|
vor 1 Jahr |
jherve
|
754977a5b0
Move queue definition to class attribute of Job
|
vor 1 Jahr |
jherve
|
57d0f80ad4
Remove useless jobs
|
vor 1 Jahr |
jherve
|
80ce86dba1
Change attribute name for queue
|
vor 1 Jahr |
jherve
|
df5cfce360
Remove useless int parameter for worker classes + cleanup
|
vor 1 Jahr |
jherve
|
7ccbf4584c
Add a WebService
|
vor 1 Jahr |
jherve
|
8c7d187433
[unrelated] Properly close storage on web app exit
|
vor 1 Jahr |
jherve
|
68d3748fed
Remove fake workers
|
vor 1 Jahr |
jherve
|
2ec2560a91
Properly handle storage close
|
vor 1 Jahr |
jherve
|
b615c9ec14
Change _log function
|
vor 1 Jahr |
jherve
|
f6e0afb5f2
Add a proper job
|
vor 1 Jahr |
jherve
|
ce3f860974
Add a job abstraction
|
vor 1 Jahr |
jherve
|
4626fa3588
Add QueueWorker
|
vor 1 Jahr |
jherve
|
9a355a25e7
[wip] Redesigning the tasks
|
vor 1 Jahr |
jherve
|
dca525b846
Fix parsing of bfmtv/lemonde/leparisien pages
|
vor 1 Jahr |