360b35a08f
* Fix error messages with ES results * Add lsof for debugging * Add torrents table variable to index sukebei * Use elasticsearch alias for hotswapping index * Increase max open files, increase ES heap size * Add reindex script and reindex triggers We use a table to store the actions happened to the torrents table. When the torrents table is INSERTED/UPDATED/DELETED, the trigger kicks in and an entry is made to the reindex_torrents table. The reindex_nyaapantsu.py script is then used to query the reindex_torrents table and apply the correct reindex action to elasticsearch. The entries are then removed for reindex_torrents table. * Reindex every 5 minutes as cronjob
54 lignes
1 Kio
YAML
54 lignes
1 Kio
YAML
---
|
|
settings:
|
|
analysis:
|
|
analyzer:
|
|
nyaapantsu_analyzer:
|
|
tokenizer: nyaapantsu_tokenizer
|
|
filter:
|
|
- standard
|
|
- lowercase
|
|
tokenizer:
|
|
nyaapantsu_tokenizer:
|
|
type: edge_ngram
|
|
min_gram: 2
|
|
max_gram: 15
|
|
token_chars:
|
|
- letter
|
|
- digit
|
|
index:
|
|
number_of_shards: 1
|
|
number_of_replicas: 0
|
|
max_result_window: 30000
|
|
|
|
mappings:
|
|
torrents:
|
|
properties:
|
|
# TODO Consistent ID's type in TorrentJSON
|
|
id:
|
|
type: long
|
|
name:
|
|
type: text
|
|
analyzer: nyaapantsu_analyzer
|
|
fielddata: true # Use to sort by id because it is currently a text field
|
|
category:
|
|
type: text
|
|
sub_category:
|
|
type: text
|
|
status:
|
|
type: long
|
|
hash:
|
|
type: text
|
|
date:
|
|
type: date
|
|
uploader_id:
|
|
type: long
|
|
downloads:
|
|
type: long
|
|
seeders:
|
|
type: long
|
|
leechers:
|
|
type: long
|
|
completed:
|
|
type: long
|
|
filesize:
|
|
type: long
|