nyaa-pantsu/config/metainfoFetcher.go

package config

type MetainfoFetcherConfig struct {
	QueueSize        int `json:"queue_size"`
	Timeout          int `json:"timeout"`
	MaxDays          int `json:"max_days"`
	BaseFailCooldown int `json:"base_fail_cooldown"`
	MaxFailCooldown  int `json:"max_fail_cooldown"`
	WakeUpInterval   int `json:"wake_up_interval"`

	UploadRateLimiter   int `json:"upload_rate_limiter"`
	DownloadRateLimiter int `json:"download_rate_limiter"`
}

var DefaultMetainfoFetcherConfig = MetainfoFetcherConfig{
	QueueSize:        10,
	Timeout:          120, // 2 min
	MaxDays:          90,
	BaseFailCooldown: 30 * 60, // in seconds, when failed torrents will be able to be fetched again.
	MaxFailCooldown:  48 * 60 * 60,
	WakeUpInterval:   300, // 5 min

	UploadRateLimiter:   1024, // kbps
	DownloadRateLimiter: 1024,
}
Add filesize fetcher mode 2017-05-13 19:58:48 +02:00			`package config`

FilesizeFetcher -> MetainfoFetcher 2017-05-14 13:20:34 +02:00			`type MetainfoFetcherConfig struct {`
Use Mutex when modifying failedOperations, add exponential cooldown Just to be safe, won't allow concurrent goroutines to modify the map. The exponential cooldown prevents newer torrents with no seeds blocking older ones with seeds, when there are enough failures that a cooldown event would fill the queue with only failed torrents. 2017-05-15 00:30:56 +02:00			QueueSize int `json:"queue_size"`
			Timeout int `json:"timeout"`
			MaxDays int `json:"max_days"`
			BaseFailCooldown int `json:"base_fail_cooldown"`
			MaxFailCooldown int `json:"max_fail_cooldown"`
			WakeUpInterval int `json:"wake_up_interval"`
Add Upload and Download limiters, rely on unique_index for avoiding duplicates The FileList that is read with GetTorrents is empty, as it's only loaded with GetTorrentById. So, always insert the new FileList on the database, and rely on the unique_index to avoid duplications. 2017-05-14 16:35:03 +02:00
			UploadRateLimiter int `json:"upload_rate_limiter"`
			DownloadRateLimiter int `json:"download_rate_limiter"`
Add filesize fetcher mode 2017-05-13 19:58:48 +02:00			`}`

FilesizeFetcher -> MetainfoFetcher 2017-05-14 13:20:34 +02:00			`var DefaultMetainfoFetcherConfig = MetainfoFetcherConfig{`
Use Mutex when modifying failedOperations, add exponential cooldown Just to be safe, won't allow concurrent goroutines to modify the map. The exponential cooldown prevents newer torrents with no seeds blocking older ones with seeds, when there are enough failures that a cooldown event would fill the queue with only failed torrents. 2017-05-15 00:30:56 +02:00			`QueueSize: 10,`
			`Timeout: 120, // 2 min`
			`MaxDays: 90,`
			`BaseFailCooldown: 30 * 60, // in seconds, when failed torrents will be able to be fetched again.`
			`MaxFailCooldown: 48 * 60 * 60,`
			`WakeUpInterval: 300, // 5 min`
Add Upload and Download limiters, rely on unique_index for avoiding duplicates The FileList that is read with GetTorrents is empty, as it's only loaded with GetTorrentById. So, always insert the new FileList on the database, and rely on the unique_index to avoid duplications. 2017-05-14 16:35:03 +02:00
Add fail cooldown After a set cooldown, torrents that failed to be fetch will be able to be fetched again. Set FailCooldown to -1 to disable. 2017-05-14 23:10:39 +02:00			`UploadRateLimiter: 1024, // kbps`
Add Upload and Download limiters, rely on unique_index for avoiding duplicates The FileList that is read with GetTorrents is empty, as it's only loaded with GetTorrentById. So, always insert the new FileList on the database, and rely on the unique_index to avoid duplications. 2017-05-14 16:35:03 +02:00			`DownloadRateLimiter: 1024,`
Add filesize fetcher mode 2017-05-13 19:58:48 +02:00			`}`