Albirew/nyaa-pantsu
Albirew/nyaa-pantsu
Archivé
1
0
Bifurcation 0
Code Activité
Ce dépôt a été archivé le 2022-05-07. Vous pouvez voir ses fichiers ou le cloner, mais pas ouvrir de ticket ou de demandes d'ajout, ni soumettre de changements.
nyaa-pantsu/deploy/ansible/roles/elasticsearch/files/elasticsearch_settings.yml

55 lignes
1 Kio
YAML
Brut Vue normale Historique

Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
---
settings:
analysis:
analyzer:
Revert "Add playbook to download /build latest nyaa, fix k-on elasticsearch issue (#821)" This reverts commit da1e323825c58c022ff47696ffb398aa79cb26f5.
2017-05-29 00:24:04 +02:00
nyaapantsu_analyzer:
tokenizer: nyaapantsu_tokenizer
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
filter:
- standard
- lowercase
Revert "Add playbook to download /build latest nyaa, fix k-on elasticsearch issue (#821)" This reverts commit da1e323825c58c022ff47696ffb398aa79cb26f5.
2017-05-29 00:24:04 +02:00
tokenizer:
nyaapantsu_tokenizer:
type: edge_ngram
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
min_gram: 2
max_gram: 15
Revert "Add playbook to download /build latest nyaa, fix k-on elasticsearch issue (#821)" This reverts commit da1e323825c58c022ff47696ffb398aa79cb26f5.
2017-05-29 00:24:04 +02:00
token_chars:
- letter
- digit
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
index:
number_of_shards: 1
number_of_replicas: 0
Add reindexing every 5 minutes, and a bunch of other things (#852) * Fix error messages with ES results * Add lsof for debugging * Add torrents table variable to index sukebei * Use elasticsearch alias for hotswapping index * Increase max open files, increase ES heap size * Add reindex script and reindex triggers We use a table to store the actions happened to the torrents table. When the torrents table is INSERTED/UPDATED/DELETED, the trigger kicks in and an entry is made to the reindex_torrents table. The reindex_nyaapantsu.py script is then used to query the reindex_torrents table and apply the correct reindex action to elasticsearch. The entries are then removed for reindex_torrents table. * Reindex every 5 minutes as cronjob
2017-05-31 04:22:12 +02:00
max_result_window: 30000
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
mappings:
torrents:
properties:
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
# TODO Consistent ID's type in TorrentJSON
id:
TorrentJSON.ID is uint now, fix weird page sorting (#769) * TorrentJSON.ID is uint now, fix weird page sorting The bug was that ES would sort by ID in a weird manner because the id was a string. The id is now a uint. * Resolved the conflict for future merging
2017-05-27 03:54:41 +02:00
type: long
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
name:
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
type: text
Revert "Add playbook to download /build latest nyaa, fix k-on elasticsearch issue (#821)" This reverts commit da1e323825c58c022ff47696ffb398aa79cb26f5.
2017-05-29 00:24:04 +02:00
analyzer: nyaapantsu_analyzer
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
fielddata: true # Use to sort by id because it is currently a text field
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
category:
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
type: text
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
sub_category:
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
type: text
Create main directory and add elasticsearch configuration
2017-05-17 21:49:42 +02:00
status:
Fix typo in elasticsearch_settings.yml file
2017-05-17 22:25:30 +02:00
type: long
Elasticsearch integration (WIP) (#730) * Update mapping to be similar to TorrentJSON * Implement ES search for TorrentParam * Add seeders/leechers/completed to es index * Fix filter, use analyzer * Use ES for the search route * Add upload_id filtering with ES * Create/update ES index on torrent upload/update * Delete from ES index on Delete * Use ES everywhere, fallback to postgres query Use Elasticsearch to search the index whenever a call to searchByQuery is made. Big cleanup needed, but _it werks_. * Only fetch ids from ES, nothing else * Use ColumnUpdate instead of Save * Add FIXME/info to search * Template needs []TorrentJSON not []Torrent
2017-05-26 01:48:14 +02:00
hash:
type: text
date:
type: date
uploader_id:
type: long
downloads:
type: long
seeders:
type: long
leechers:
type: long
completed:
type: long
filesize:
type: long
Copier le lien permanent