360b35a08f
* Fix error messages with ES results * Add lsof for debugging * Add torrents table variable to index sukebei * Use elasticsearch alias for hotswapping index * Increase max open files, increase ES heap size * Add reindex script and reindex triggers We use a table to store the actions happened to the torrents table. When the torrents table is INSERTED/UPDATED/DELETED, the trigger kicks in and an entry is made to the reindex_torrents table. The reindex_nyaapantsu.py script is then used to query the reindex_torrents table and apply the correct reindex action to elasticsearch. The entries are then removed for reindex_torrents table. * Reindex every 5 minutes as cronjob
14 lignes
604 o
YAML
14 lignes
604 o
YAML
- name: Populate elasticsearch index from database
|
|
hosts: dbs
|
|
roles:
|
|
- common
|
|
- postgresql
|
|
- elasticsearch
|
|
|
|
tasks:
|
|
- name: Index the database into elasticsearch
|
|
command: python "{{ nyaapantsu_directory }}/index_nyaapantsu.py"
|
|
environment:
|
|
PANTSU_DBPARAMS: "host=localhost port={{ nyaapantsu_pgpool_port }} user={{ nyaapantsu_user }} dbname={{ nyaapantsu_dbname }} sslmode=disable password={{ nyaapantsu_password }}"
|
|
PANTSU_ELASTICSEARCH_INDEX: "{{ nyaapantsu_elasticsearch_index }}"
|
|
PANTSU_TORRENT_TABLENAME: "{{ nyaapantsu_torrent_tablename }}"
|