 jherve
|
d51ff03bb2
Switch to Annoy for vector search/indexing
|
1 vuosi sitten |
|
jherve
|
2d7c272ce7
Fix storage bug
|
1 vuosi sitten |
|
jherve
|
5d907e27a8
Add a requirements file for embeddings
|
1 vuosi sitten |
|
jherve
|
78907db424
Update all queries to match postgres' dialect
|
1 vuosi sitten |
|
jherve
|
f1a4b45338
Update insert_or_get to match postgres' approach
|
1 vuosi sitten |
|
jherve
|
4c24edf277
Reduce parallelism while debugging postgres related stuff
|
1 vuosi sitten |
|
jherve
|
a39731763a
Update DDL statements to postgresql dialect
|
1 vuosi sitten |
|
jherve
|
d681c8a42c
Upgrade backend to support postgresql
|
1 vuosi sitten |
|
jherve
|
0a9d277ed8
Some light rewrite
|
1 vuosi sitten |
|
jherve
|
84b6e1b76b
Remove "soup" from representation of MainPage
|
1 vuosi sitten |
|
jherve
|
207cc110db
Move database URL to secrets
|
1 vuosi sitten |
|
jherve
|
16211d149d
Turn page addition into a transaction
|
1 vuosi sitten |
|
jherve
|
f64bfbdb78
Add proper worker/job/jobqueue abstractions
|
1 vuosi sitten |
|
jherve
|
77daef67a1
Add a job ID and debug logging to track the progress of jobs
|
1 vuosi sitten |
|
jherve
|
20e8c70670
Move definition of snapshot days/hours to settings
|
1 vuosi sitten |
|
jherve
|
cafdb28026
Do not ask for snapshots that are in the future
|
1 vuosi sitten |
|
jherve
|
86667c97a8
Add a rate limiter to delay requests after errors 429 or of connection
|
1 vuosi sitten |
|
jherve
|
e1f4821197
Move internet_archive settings to a specific section
|
1 vuosi sitten |
|
jherve
|
deb4976e9f
Move limiter configuration to settings
|
1 vuosi sitten |
|
jherve
|
b1a81e01b5
A better solution for rate limiting
|
1 vuosi sitten |
|
jherve
|
e23a632cca
Add a private function to handle get requests in InternetArchiveClient
|
1 vuosi sitten |
|
jherve
|
2ae7111cbf
Add an arbitrary limit on the number of values returned
|
1 vuosi sitten |
|
jherve
|
a1680f1c84
Allow request to raise if status code is >= 400
|
1 vuosi sitten |
|
jherve
|
4fff56ca37
Dump some information in a tmpdir in case of a parsing error
|
1 vuosi sitten |
|
jherve
|
d999f7b82b
Move DbConnection to an abstract + implementation scheme
|
1 vuosi sitten |
|
jherve
|
9d1b010d7b
Open the door to handling various db backends
|
1 vuosi sitten |
|
jherve
|
b4743db7f9
Revert "Remove one layer of "session""
|
1 vuosi sitten |
|
jherve
|
60934397f6
Fix dependencies and make web server bind to 0.0.0.0
|
1 vuosi sitten |
|
jherve
|
da86eb7a06
Make sentence transformers optional
|
1 vuosi sitten |
|
jherve
|
1599204563
Move import back to start of file
|
1 vuosi sitten |
