b2b48f61b0
* [WIP] Torrent Generation on not found error As asked in #1517, it allows on-the-fly torrent generation. Since it uses magnet links, it needs some time to connect to peers. So it can't be instant generation, we need the user to wait and try after a minute at least. * Replace Fatal by simple error * attempt at fixing travis * del * Add Anacrolyx dependency * Add back difflib * Remove .torrent suffix in the url example * Add some explanations when file missing page shown * Ignore downloads directory * Either use cache (third-party site) or own download directory * Wrong import * If there is an error then it means we aren't generating a torrent file May it be "torrent not found" or "We do not store torrent files" which are the two only existing errors for this page * hash is never empty * TorrentLink may be empty at times So we add a /download/:hash link if it is * Update README.md * Made a mistake here, need to check if false * Update en-us.all.json * Update CHANGELOG.md * Torrent file generation can be triggered by click on button if JS enabled * Update download.go * Update download.go * Use c.JSON instead of text/template * Return to default behavior if we don't generate the file * Don't do the query if returned to default behavior * Add "Could not generate torrent file" error * Fix JS condition & lower delay until button updates * Start download automatically once torrent file is generated * Fix torrentFileExists() constantly returning false if external torrent download URL * torrent-view-data is two tables instead of one This allows the removal of useless things without any problem (e.g Website link), but also a better responsibe design since the previous one separated stats after a certain res looking very wonky * CSS changes to go along * Remove useless <b></b> * Update main.css * In torrentFileExists, check if filestorage path exists instead of looking at the domain in torrent link When checking if the file is stored on another server i used to simply check if the domain name was inside the torrent link, but we can straight up check for filestorage length * Fix JS of on-demand stat fetching * ScrapeAge variable accessible through view.jet.html Contains last scraped time in hours, is at -1 is torrent has never been scraped Stats will get updated if it's either at -1 or above 1460 (2 months old) * Refresh stats if older than two months OR unknown and older than 24h Show last scraped date even if stats are unknown * Add StatsObsolete variable to torrent Indicating if: - They can be shown - They need to be updated * Update scraped data even if Unknown, prevent users from trying to fetch stats every seconds * Torrent file stored locally by default * no need to do all of that if no filestorage * fix filestorage path * Fix torrent download button stuck on "Generating torrent file" at rare times * fix some css rules that didn't work on IE * Fix panic error Seems like this error is a known bug from anacrolyx torrent https://github.com/anacrolix/torrent/issues/83 To prevent it, I'm creating a single client and modifying the socket.go to make it not raise a panic but a simple error log. |
||
|---|---|---|
| .. | ||
| LICENSE.md | ||
| reader.go | ||
| README.md | ||
| writer.go | ||
| writer_appengine.go | ||
| writer_unsafe.go | ||
fwd
import "github.com/philhofer/fwd"
The fwd package provides a buffered reader
and writer. Each has methods that help improve
the encoding/decoding performance of some binary
protocols.
The fwd.Writer and fwd.Reader type provide similar
functionality to their counterparts in bufio, plus
a few extra utility methods that simplify read-ahead
and write-ahead. I wrote this package to improve serialization
performance for http://github.com/tinylib/msgp,
where it provided about a 2x speedup over bufio for certain
workloads. However, care must be taken to understand the semantics of the
extra methods provided by this package, as they allow
the user to access and manipulate the buffer memory
directly.
The extra methods for fwd.Reader are Peek, Skip
and Next. (*fwd.Reader).Peek, unlike (*bufio.Reader).Peek,
will re-allocate the read buffer in order to accommodate arbitrarily
large read-ahead. (*fwd.Reader).Skip skips the next n bytes
in the stream, and uses the io.Seeker interface if the underlying
stream implements it. (*fwd.Reader).Next returns a slice pointing
to the next n bytes in the read buffer (like Peek), but also
increments the read position. This allows users to process streams
in arbitrary block sizes without having to manage appropriately-sized
slices. Additionally, obviating the need to copy the data from the
buffer to another location in memory can improve performance dramatically
in CPU-bound applications.
fwd.Writer only has one extra method, which is (*fwd.Writer).Next, which
returns a slice pointing to the next n bytes of the writer, and increments
the write position by the length of the returned slice. This allows users
to write directly to the end of the buffer.
Constants
const (
// DefaultReaderSize is the default size of the read buffer
DefaultReaderSize = 2048
)
const (
// DefaultWriterSize is the
// default write buffer size.
DefaultWriterSize = 2048
)
type Reader
type Reader struct {
// contains filtered or unexported fields
}
Reader is a buffered look-ahead reader
func NewReader
func NewReader(r io.Reader) *Reader
NewReader returns a new *Reader that reads from 'r'
func NewReaderSize
func NewReaderSize(r io.Reader, n int) *Reader
NewReaderSize returns a new *Reader that reads from 'r' and has a buffer size 'n'
func (*Reader) BufferSize
func (r *Reader) BufferSize() int
BufferSize returns the total size of the buffer
func (*Reader) Buffered
func (r *Reader) Buffered() int
Buffered returns the number of bytes currently in the buffer
func (*Reader) Next
func (r *Reader) Next(n int) ([]byte, error)
Next returns the next 'n' bytes in the stream. Unlike Peek, Next advances the reader position. The returned bytes point to the same data as the buffer, so the slice is only valid until the next reader method call. An EOF is considered an unexpected error. If an the returned slice is less than the length asked for, an error will be returned, and the reader position will not be incremented.
func (*Reader) Peek
func (r *Reader) Peek(n int) ([]byte, error)
Peek returns the next 'n' buffered bytes, reading from the underlying reader if necessary. It will only return a slice shorter than 'n' bytes if it also returns an error. Peek does not advance the reader. EOF errors are not returned as io.ErrUnexpectedEOF.
func (*Reader) Read
func (r *Reader) Read(b []byte) (int, error)
Read implements io.Reader
func (*Reader) ReadByte
func (r *Reader) ReadByte() (byte, error)
ReadByte implements io.ByteReader
func (*Reader) ReadFull
func (r *Reader) ReadFull(b []byte) (int, error)
ReadFull attempts to read len(b) bytes into 'b'. It returns the number of bytes read into 'b', and an error if it does not return len(b). EOF is considered an unexpected error.
func (*Reader) Reset
func (r *Reader) Reset(rd io.Reader)
Reset resets the underlying reader and the read buffer.
func (*Reader) Skip
func (r *Reader) Skip(n int) (int, error)
Skip moves the reader forward 'n' bytes. Returns the number of bytes skipped and any errors encountered. It is analogous to Seek(n, 1). If the underlying reader implements io.Seeker, then that method will be used to skip forward.
If the reader encounters
an EOF before skipping 'n' bytes, it
returns io.ErrUnexpectedEOF. If the
underlying reader implements io.Seeker, then
those rules apply instead. (Many implementations
will not return io.EOF until the next call
to Read.)
func (*Reader) WriteTo
func (r *Reader) WriteTo(w io.Writer) (int64, error)
WriteTo implements io.WriterTo
type Writer
type Writer struct {
// contains filtered or unexported fields
}
Writer is a buffered writer
func NewWriter
func NewWriter(w io.Writer) *Writer
NewWriter returns a new writer
that writes to 'w' and has a buffer
that is DefaultWriterSize bytes.
func NewWriterSize
func NewWriterSize(w io.Writer, size int) *Writer
NewWriterSize returns a new writer that writes to 'w' and has a buffer that is 'size' bytes.
func (*Writer) BufferSize
func (w *Writer) BufferSize() int
BufferSize returns the maximum size of the buffer.
func (*Writer) Buffered
func (w *Writer) Buffered() int
Buffered returns the number of buffered bytes in the reader.
func (*Writer) Flush
func (w *Writer) Flush() error
Flush flushes any buffered bytes to the underlying writer.
func (*Writer) Next
func (w *Writer) Next(n int) ([]byte, error)
Next returns the next 'n' free bytes
in the write buffer, flushing the writer
as necessary. Next will return io.ErrShortBuffer
if 'n' is greater than the size of the write buffer.
Calls to 'next' increment the write position by
the size of the returned buffer.
func (*Writer) ReadFrom
func (w *Writer) ReadFrom(r io.Reader) (int64, error)
ReadFrom implements io.ReaderFrom
func (*Writer) Write
func (w *Writer) Write(p []byte) (int, error)
Write implements io.Writer
func (*Writer) WriteByte
func (w *Writer) WriteByte(b byte) error
WriteByte implements io.ByteWriter
func (*Writer) WriteString
func (w *Writer) WriteString(s string) (int, error)
WriteString is analogous to Write, but it takes a string.
Generated by godoc2md