Encoded Google News and FeedBurner URLs are decoded.įor several more features, see the customizable global and feed-specific settings, and commands.Note that this detection is skipped for a weak ETag. A TTL and ETag based compressed disk cache of URL content is used for preventing unnecessary URL reads.Īny websites with a mismatched strong ETag are probabilistically detected, and this caching is then disabled for themįor the duration of the process.Entry titles are formatted for neatness.Īny HTML tags and excessive whitespace are stripped, all-caps are replaced,Īnd excessively long titles are sanely truncated.These parsers also support configurable recursive crawling. Pandas DSLs are supported for flexibly parsing arbitrary HTML, JSON, and CSV content A SQLite database file records hashes of the entries that have been posted, thereby preventing them from being.There is however no delay for any feed which has a polling period less than or equal to 12 minutes as such a feed is This amount of time is 15 minutes for any feed which has a polling period greater than 12 minutes. Thereby avoiding the interruption of any preexisting conversations. Entries are posted only if the channel has not had any conversation for a certain minimum amount of time,.Multiple channels on an IRC server are supported, with each channel having its own set of feeds.įor use with multiple servers, a separate instance of the bot process can be run for each server.In this case, it can be viewed correctly on GitHub. If viewing this readme on Docker Hub, note that it may be misformatted. More specifically, it posts the titles and shortened URLs of entries. It essentially posts the entries of feeds in IRC channels, one entry per message. Irc-rss-feed-bot is a dockerized Python 3.9 and IRC based RSS/Atom and scraped HTML/JSON/CSV feed posting bot.
0 kommentar(er)
