Commit Graph

24 Commits

Author SHA1 Message Date
Ville Ranki 0dafd62a61
Merge pull request #110 from berlincount/poll_only_enabled
Only talk to external services when enabled explicitly
2020-11-15 22:26:50 +02:00
Andreas Kotes b0d2ed5fd2
Only talk to external services when enabled explicitly 2020-11-15 21:02:10 +01:00
Tatu Wikman d48163a058
[URL] add useragent, fixes #107
Follows googlebot useragent convention and afaik follows RFC7231

Do we want bot.owners here also?
2020-11-14 15:32:07 +02:00
Ville Ranki 3cbcbc06c3 Changed Url module timeout and maxsize to get youtube working again 2020-11-04 22:18:34 +02:00
Ville Ranki 39c1b98f88 Added relay module for relaybot functionality 2020-11-04 21:53:23 +02:00
Ville Ranki ea8fd74a85
Merge pull request #104 from tswfi/url/fix_reply_spam
url: don't check urls in reply messages, fixes #80
2020-10-10 22:30:51 +03:00
Tatu Wikman d9b9d9483e
url: don't check urls in reply messages, fixes #80 2020-10-10 21:51:39 +03:00
Tatu Wikman b818353885
url: fix reading streaming responses forever, fixes #79 2020-10-10 21:42:53 +03:00
Tatu Wikman 8187bb5478
blacken url module 2020-10-10 20:19:30 +03:00
Tatu Wikman 4bad8fe66d
url module: don't spam matrix.to urls and skip edited messages, fixes #98
Also change a few log levels and skip edited messages completely
2020-10-10 20:15:37 +03:00
Tatu Wikman 905da2fbf7
Fix timeout definition
From: https://github.com/encode/httpx/blob/master/CHANGELOG.md#0150-september-22nd-2020

The verbose httpx.Timeout(5.0, connect_timeout=60.0) style had previously been deprecated in favour of httpx.Timeout(5.0, connect=60.0). It is now fully removed.
2020-10-10 17:19:02 +03:00
Ville Ranki 11f2917d49 Url: Use og:title meta property if found. Fixes #90. 2020-07-13 23:06:55 +03:00
Tatu Wikman 76667548a9 make sure title exists before trying to use it, fixes #83 2020-06-18 14:17:58 +03:00
Ville Ranki da0ac100e3 Added timeout to url module. Fixes #79 2020-04-25 22:51:39 +03:00
Ville Ranki 48d8298828 Add support to ignore m.text messages and fix url module to use this. Fix url not saving message type. 2020-03-29 20:34:57 +03:00
Ville Ranki 18fea2501c Allow setting message type in \!url 2020-03-28 22:04:15 +02:00
Dylan Hackworth edf5c3d6fe #63 patch 2020-03-19 15:27:49 -05:00
Frank Becker 0febd01103 restored from original master after accident 2020-02-23 22:17:07 +01:00
plocki 78901ea505 umbenannt: modules/googlecal.py -> modules/off/googlecal.py
umbenannt:      modules/ig.py -> modules/off/ig.py
umbenannt:      modules/metar.py -> modules/off/metar.py
umbenannt:      modules/notam.py -> modules/off/notam.py
umbenannt:      modules/taf.py -> modules/off/taf.py
umbenannt:      modules/teamup.py -> modules/off/teamup.py
umbenannt:      modules/twitter.py -> modules/off/twitter.py
umbenannt:      modules/url.py -> modules/off/url.py
neue Datei:     modules/ping.py (check web urls)
2020-02-01 22:48:35 +01:00
Tatu Wikman b2641068ed
add setting methods for url module, fixes #31 2020-01-29 12:34:22 +02:00
Tatu Wikman 3df9c52512
Use Beautiful Soup for content parsing
This will help with pages that have broken html..

closes #29
2020-01-29 11:43:23 +02:00
Tatu Wikman 5dffd2db50
Remove old todo comment 2020-01-20 23:32:26 +02:00
Tatu Wikman 9113aa19e5
blackened 2020-01-11 02:01:41 +02:00
Tatu Wikman a2f4d7c999
renamed to url
Added different on off statuses
* title, spams titles
* description, spams descriptions
* both, spams both
* off, dont spam

And a bit of refactoring
2020-01-11 01:59:07 +02:00