Frisk/RcGcDb
1
0
Fork 0
mirror of https://gitlab.com/chicken-riders/RcGcDb.git synced 2025-02-23 00:54:09 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
542 commits 3 branches 0 tags 1.8 MiB
Commit graph

387 commits

Author SHA1 Message Date
Frisk 88ff0a3552
Created a skeleton for rewrite 2021-05-30 13:23:48 +02:00
Frisk b1ee9171aa
Created a new class 2021-05-28 19:16:14 +02:00
Frisk c273955f61
Fixed edit diff download on bad HTTP status 2021-04-14 16:19:25 +02:00
Frisk cb733ccb4b
Data sometimes can be apparently none, in that case return empty string 2021-04-14 15:47:10 +02:00
Frisk 5c63a48954
Sync with RcGcDw 2021-04-11 17:25:01 +02:00
Frisk aa6bdc632e
Fmall fix for IRC code 2021-03-20 17:28:08 +01:00
Frisk 0af390d80f
Added port argument 2021-03-20 14:44:29 +01:00
Frisk 7492229eb2
Another one of those 2021-03-20 14:14:18 +01:00
Frisk 47722de473
Fix argument list consistency 2021-03-20 14:00:29 +01:00
Frisk 5a6345a3e0
Small stylistic change in SQL query + another debug statement 2021-03-20 13:55:56 +01:00
Frisk a2f1d54f39
Added PostgreSQL compatibility, dropped SQLite compatibility 2021-03-20 13:42:54 +01:00
Frisk 2c8574445c
Converted all of the queries however there is still some work to be done 2021-03-19 16:26:19 +01:00
Frisk 79ea1a6a8b
Backuping work on Postgres DB 2021-03-18 17:00:01 +01:00
Frisk 9a5f57cda6
Let's be honest, this probably won't set anything on fire and will prevent some expensive calls 2021-03-18 00:10:04 +01:00
Frisk 7723133847
Added more debug + fixed disconnect logic and handling of encoding issues 2021-03-17 14:51:20 +01:00
Frisk 23043934cd
Added more debug + fixed disconnect logic and handling of encoding issues 2021-03-17 14:48:05 +01:00
Frisk 8a1a61dbac
Updated logic to account for wikis already in the queue but that are being added constantly because it's long 2021-03-17 14:20:22 +01:00
Frisk 98cb381d55
Remove some old debug code 2021-03-17 14:15:29 +01:00
Frisk fcdf6b66cf
Fix issue with wikis not being added properly to the queue 2021-03-17 13:46:51 +01:00
Frisk a44799dff3
Add on_disconnect function to hopefully connect back to IRC on disconect 2021-03-17 13:17:51 +01:00
Frisk 8b98cad112
Temporary fix for "a lot of messages in my console please fix". I need better way to handle this queuing logic 2021-03-16 23:17:39 +01:00
Frisk f6a2fc2f0b
Not very helpful really, reverting previous commit to find better alternative 2021-03-16 23:10:47 +01:00
Frisk 753d01e63e
Changes in timings, potentially breaking (hopefully not) 2021-03-16 22:39:21 +01:00
Frisk e291ac61b6
Add code to debug JSON decode issue 2021-03-16 22:38:57 +01:00
Frisk 359df7e879
Merge remote-tracking branch 'origin/master' 
# Conflicts:
#	src/bot.py
 2021-03-16 22:28:05 +01:00
Markus-Rost 155c50a561 bump version 
bump version for IRC
 2021-03-16 21:46:31 +01:00
MarkusRost b798250a19 Merge branch 'master' into 'master' 
Add support for IRC feeds

Closes #37

See merge request chicken-riders/RcGcDb!17
 2021-03-16 20:37:29 +00:00
MarkusRost a37a7d9365 follow redirects 2021-03-16 20:36:11 +00:00
Frisk 5e08b4a501
Start ignoring the additional delay for wikis with IRC feed. We have IRC feed only for more active domains so this additional delay does more bad than good 2021-03-08 19:00:12 +01:00
Frisk d7661469a2
Move logs to debug 2021-03-08 18:33:54 +01:00
Markus-Rost 96e678a047 Escape discussions titles because roblox 2021-02-21 17:56:24 +01:00
Frisk 4c1101e519
Fix failing discussion check 2021-02-21 16:51:43 +01:00
Frisk 8da53cabdb
Remove debug code 2021-02-20 19:18:59 +01:00
Frisk e3b0f2dab1
Fixed all immediatly visible issues 2021-02-20 19:02:57 +01:00
Frisk d7b16e9e07
wrote 4 lines for discussions, after a long break <3 2021-02-20 19:02:57 +01:00
Frisk 48bf9dd540
I have no productivity today so I'm just commiting some more work I'll have to rework anyways 2021-02-20 19:02:57 +01:00
Frisk 1d5026a553
Some sort of progress 2021-02-20 19:02:57 +01:00
Frisk 0459e3fd68
Added updates 2021-02-20 19:02:51 +01:00
Frisk 928db6a86d
Fixed all immediatly visible issues 2021-02-20 16:33:44 +01:00
Frisk 01c58417c7
wrote 4 lines for discussions, after a long break <3 2021-02-02 02:28:14 +01:00
Frisk 6b8a2e217b
I have no productivity today so I'm just commiting some more work I'll have to rework anyways 2021-01-27 18:48:46 +01:00
MarkusRost 0ef302ec7f Fix message for log action "managewiki/undelete" 
See https://github.com/miraheze/ManageWiki/blob/master/i18n/en.json#L41. Also mentioned on Discord.
 2021-01-23 22:14:41 +00:00
MarkusRost d4c44da126 Fix feeds 2021-01-22 10:29:44 +00:00
Frisk 49c36c9688
Some sort of progress 2021-01-21 14:40:55 +01:00
Frisk e1aeaaaaba
Added updates 2021-01-20 16:45:17 +01:00
Frisk 4e1aad4025
Added some comments and help 2021-01-16 15:14:06 +01:00
Frisk 4025f15e1a
Merge remote-tracking branch 'origin/master' 2021-01-12 17:50:41 +01:00
Frisk 327bc60c03
Fix formatting issue with handling exception on image error 2021-01-12 17:49:56 +01:00
Markus-Rost e344316491 Improve tag management log 2021-01-04 18:20:03 +01:00
Markus-Rost 6db23b5ed6 Fix tags for the third time 2021-01-04 17:31:09 +01:00
Frisk 030a264b3a
Fix protectsite 2020-12-29 23:33:20 +01:00
Markus-Rost df3194d3af Fix stacked embed length check 2020-12-22 11:47:41 +01:00
Frisk 1f4d375ff1
Update source file for i18n with new lang 2020-12-21 19:21:30 +01:00
Markus-Rost 3e21071148 fix stacked embed icon 2020-12-21 14:12:17 +01:00
Markus-Rost b14dac4776 contentmodel/new 
piotrex43/RcGcDw#187
 2020-12-19 13:41:49 +01:00
Markus-Rost 0f66a4236f Handle weird Fandom API 2020-12-17 00:17:23 +01:00
Markus-Rost 546ccc0ada Move compact emoji to class 2020-12-13 22:01:51 +01:00
Frisk 35c64d77d4
Fixing key error 2020-12-07 12:26:27 +01:00
Markus-Rost b046ff12ee add emoji to settings 2020-12-06 14:39:29 +01:00
Markus-Rost 5aab6222f9 fix embed link 2020-12-05 23:12:28 +01:00
Frisk b37693f85d
Merge remote-tracking branch 'origin/master' 2020-12-05 12:43:11 +01:00
Frisk b904c73b63
Updated translations and add a safety statement 2020-12-05 12:42:46 +01:00
Markus-Rost fc29d09708 update feeds fetch 
Remove counters and pagination for increased performance
 2020-12-04 16:54:58 +01:00
Markus-Rost 1ddff46ae9 Add pagelang 
piotrex43/RcGcDw#184
 2020-12-04 16:54:19 +01:00
Markus-Rost d5fca9c7b3 Extension:DataDump 
close piotrex43/RcGcDw#183
 2020-11-30 21:42:58 +01:00
Markus-Rost 548ecc8c79 fix oldid 2020-11-30 19:14:40 +01:00
Markus-Rost c3a7a7dbc3 Add Hindi and Russian 2020-11-30 17:01:50 +01:00
Frisk ddd6512e18
Doesn't need to be above anymore, fixed a bug related to this 2020-11-30 15:09:38 +01:00
Frisk 3dbb377630
Fixed QUADRUPLE MESSAGES WOW 2020-11-30 14:21:54 +01:00
Markus-Rost 684a8214f6 Fix DB update 2020-11-30 01:42:57 +01:00
Markus-Rost 7b068067ef Added Extension:Translate 
piotrex43/RcGcDw#182
 2020-11-29 23:57:11 +01:00
Markus-Rost 9ea85d0fcd Match formatters with RcGcDw 2020-11-29 12:07:55 +01:00
Frisk 2f544193ff
Merge remote-tracking branch 'origin/master' 2020-11-28 23:32:09 +01:00
Frisk ef679e042c
Fix discussion issue, add stacker for discussions 2020-11-28 23:31:13 +01:00
Markus-Rost d4a9c6a907 Fix some formatter issues 
piotrex43/RcGcDw#175
piotrex43/RcGcDw#180
piotrex43/RcGcDw#181
 2020-11-28 19:35:48 +01:00
Frisk 59d2869f4f
Stacking mechanic change 2020-11-28 14:08:37 +01:00
Frisk d391b00f9e
Fix all_wikis issue 2020-11-27 20:14:23 +01:00
Frisk b583ed097e
Merge remote-tracking branch 'origin/master' 2020-11-22 15:05:58 +01:00
Frisk c13bd149a8
Fixes 2020-11-22 15:05:45 +01:00
Markus-Rost b42341a0e8 fully remove wikiid 2020-11-22 14:19:21 +01:00
Frisk 884662b568
Some more work done on the stacking 2020-11-22 13:44:15 +01:00
Frisk f3a4094474
Some work on message stacking (GONE WRONG) 2020-11-21 23:33:57 +01:00
Frisk 2cc020dc43
changes 2020-11-20 23:27:25 +01:00
Frisk 201c1d407d
Fix disabled discussions detection 2020-11-20 21:39:25 +01:00
Frisk eb899fdd39
Fix formatting issue in discussions 2020-11-20 21:39:00 +01:00
Frisk 9e5166e17a
Depend on only postid being -1 for disabled Discussion checking 2020-11-20 17:14:37 +01:00
Frisk 10064be78d
Fix an incredibly stupid fix that replaces current rc_id with none if wiki had no new edits 2020-11-16 18:31:18 +01:00
Frisk 9e4d14e9d6
Merge remote-tracking branch 'origin/master' 2020-11-14 10:26:28 +01:00
Frisk aa6a6dad39
Fix the MediaWiki rcid ordering duplicate message issue 2020-11-14 10:26:02 +01:00
Markus-Rost 1ad94b2e3e Update diff parser 
Based on Wiki-Bot diff parser
 2020-11-09 18:05:02 +01:00
Markus-Rost 203ed89847 fix compact protect message 2020-11-05 22:46:04 +01:00
Frisk 4f60da02a0
Don't overwrite the LimitedList class with normal Python list when removing a wiki from the group 2020-10-29 20:41:11 +01:00
Frisk d79afc62a5
Don't continue until you mark the wiki as still in database 2020-10-29 20:36:48 +01:00
Frisk c85763bfa9
Quick fix for critical issue 2020-10-29 18:01:01 +01:00
Frisk b99bc90e50
Added fix for potential issue 2020-10-29 15:50:50 +01:00
Markus-Rost d729e0bc23 fix formatting fix 2020-10-25 01:52:43 +02:00
Frisk e0d0350007
Merge remote-tracking branch 'origin/master' into master 2020-10-24 21:03:59 +02:00
Frisk af98d81317
Fixed formatting in embed messages 2020-10-24 21:03:33 +02:00
Markus-Rost f5d1a35619 Don't crash when Fandom has no pageID assigned to comment yet 2020-10-23 16:00:56 +02:00
Markus-Rost ab67bc64cd Partially add ManageWiki 2020-10-23 01:24:20 +02:00
Frisk 6220913d5d
Increased the timeout for requests, updated lang files (check for brokeiness?) 2020-10-19 16:45:03 +02:00
Frisk 5cdd84e4f9
Fix not implemented feature 2020-10-14 13:51:30 +02:00
Markus-Rost 44d38c4cd1 Detect all indef block durations 2020-10-13 19:30:19 +02:00
Frisk 8113f28fb0
Fix #30 2020-10-13 18:06:24 +02:00
Frisk 9cfa0d3260
If connection error on retrieving the forumIds for article comments pass None as it's already the case in formatters 2020-10-12 16:57:51 +02:00
Markus-Rost 23284328ed Add emoji to compact messages 2020-10-09 18:30:09 +02:00
Frisk e1b8327b89
Added Miraheze ManageWiki log support (added #28) 2020-10-08 11:43:19 +02:00
Frisk bbb218b28d
Added Miraheze ManageWiki log support (added #28) 2020-10-08 11:42:47 +02:00
Frisk 8d9c3c01d9
Add message to the queue per webhook to fix #27 2020-09-13 17:26:11 +02:00
Frisk af2b779b84
Fixes #26 2020-09-13 17:02:02 +02:00
Frisk 97b2fe1880
sort of a fix 2020-09-13 01:57:37 +02:00
Frisk 75a865287f
Moved error handling for one thing since I want to handle it separately 2020-09-08 21:13:42 +02:00
Markus-Rost 0a914677d5 fix malformed translation string 2020-08-22 21:26:01 +02:00
Frisk 5ca8ccc83b
Very small fixes/improvements 2020-08-22 20:28:02 +02:00
Markus-Rost d78bdb9718 link article comments 2020-08-22 19:51:15 +02:00
Frisk 150fc6c0d5
Better error handling 2020-08-19 01:04:41 +02:00
Frisk 443bb8e5af
Add #21 2020-08-15 20:02:43 +02:00
Frisk 65c5c54c3f
Delete unused module 2020-08-15 10:59:51 +02:00
Frisk f42d2a642f
Increase timeout on discussion handler 2020-08-14 23:45:00 +02:00
Frisk 1be06f78d3
Merge remote-tracking branch 'origin/master' into master 2020-08-14 23:39:31 +02:00
Frisk 71c2d4fd8c
Various fixes based on recent crash 2020-08-14 23:38:26 +02:00
Markus-Rost 8891306208 trimmed error.log 2020-08-14 08:29:10 +02:00
Frisk a08ec3e08d
Add better shutdown control 2020-08-13 14:23:45 +02:00
Frisk 4d415a6ae4
PROPERLY HANDLE REMOVALS FROM THE QUEUE, disable some debug messages 2020-08-12 14:05:34 +02:00
Frisk 2ddd02ac0c
Trimmed the issue log 2020-08-12 13:40:48 +02:00
Frisk 8a9f3bb0d2
Close db 2020-08-12 12:50:30 +02:00
Frisk e82d985d8f
Close db 2020-08-12 12:49:13 +02:00
Frisk 1f2fae3da9
Patched two probable issues 2020-08-12 12:23:10 +02:00
Frisk b58aa6f526
3.7 again 2020-08-11 23:12:10 +02:00
Frisk c40beecf43
Fix issue when webhook is switched to on with RC 2020-08-11 20:15:25 +02:00
Frisk 931aec8377
Fix typo 2020-08-11 20:06:49 +02:00
Frisk b2b798d52a
Bring back compatibility with Python 3.8 2020-08-11 19:16:47 +02:00
Markus-Rost 00f7ec9b1d fix updating rcid 2020-08-11 18:45:08 +02:00
Markus-Rost 8a545bc23e fix typo 2020-08-11 17:20:14 +02:00
Markus-Rost a12c6d9cd0 add discussions wiki page tags 2020-08-11 17:07:45 +02:00
Markus-Rost 831797818c fix crash 2020-08-11 14:11:47 +02:00
Frisk b31d666459
Fixed annoying bugs 2020-08-11 03:54:25 +02:00
Frisk 34114e378b
Debug 2020-08-11 03:00:49 +02:00
Frisk 1e32ee4ab1
Merge remote-tracking branch 'origin/master' 2020-08-11 02:48:32 +02:00
Frisk 8c81ef2032
Fixes 2020-08-11 02:48:06 +02:00
Markus-Rost db99acb3d7 Update webhook removal strings 2020-08-11 02:29:31 +02:00
Frisk bb1c33f33c
Small improvement, added some debug code to pin point some issue 2020-08-11 02:09:50 +02:00
Frisk f731c8600c
Stop the task when it somehow runs out of wikis 2020-08-10 22:31:53 +02:00
Frisk a11fe8faea
Added pot files 2020-08-10 19:58:51 +02:00
Frisk 2cea8a8724
Merge branch 'wiki-rate-limiting' 
# Conflicts:
#	src/formatters/discussions.py
#	src/i18n.py
 2020-08-10 18:57:32 +02:00
Frisk cc637be8b1
Updated translations 2020-08-10 18:46:47 +02:00
Frisk b05608a024
Fixed translation of discussions.py 2020-08-10 02:23:09 +02:00
Frisk ed131fb6da
Added translation work 2020-08-10 01:57:14 +02:00
Markus-Rost 3bfe117f8b add discussion quiz 2020-08-09 22:49:34 +02:00
Frisk e2077a7ca1
Fixed anotter oopsie 2020-08-09 15:31:21 +02:00
Frisk d6df680e92
Fixed an oopsie 2020-08-09 15:03:04 +02:00
Frisk e81198d84b
Many fixes to rate-limiting related features, added wiki queuing with higher change limit in case 20 isn't enough 2020-08-09 13:53:11 +02:00
Markus-Rost 897dbd139c readd missing , 2020-08-08 19:32:53 +02:00
Markus-Rost 6658c399dc fix queue handler 2020-08-08 19:25:32 +02:00
Frisk fca9eb72b9
Prevent setting -1 for rcid and postid to other values when feature disabled 2020-08-07 23:03:20 +02:00
Frisk ddb104c3b7
Quick patch for image error from Slack 2020-08-07 18:59:37 +02:00
Frisk a3eb577966
Quick patch for syncing rcid 2020-08-07 18:56:29 +02:00
Markus-Rost cdd90de8a5 pt to ptbr 2020-08-06 16:54:15 +02:00
Frisk 129368fcbd
Fast fix for adding new wikis 2020-08-06 15:39:02 +02:00
Frisk 1b6be292d9
Wrapping up the work on rate-limiting 2020-08-06 15:26:06 +02:00
Frisk 71a3bdd91d
Small improvement 2020-08-06 03:07:13 +02:00
Frisk 493a1c8194
More progress, it's almost working? 2020-08-06 02:46:43 +02:00
Frisk 293947c510
Added removal handling, should be now mostly ok, with exception to exception handling 2020-08-05 19:20:38 +02:00
Frisk 1ab0eaa24f
Created basic handling of wikis 2020-08-05 16:41:40 +02:00
Frisk d7f341d081
Not a lot but it's a honest work 2020-08-05 03:02:32 +02:00
Markus-Rost 6495508f2e support comments from IPs 2020-08-05 01:48:21 +02:00
Frisk a4462369bb
Additional work done on the ratelimiting 2020-08-03 16:44:42 +02:00
Frisk c1831b992b
Merge branch 'master' into wiki-rate-limiting 2020-08-03 13:08:57 +02:00
Frisk ca43ffbed8
Very small fixes 2020-08-03 13:03:36 +02:00
Markus-Rost 321e7ffedb encoding for hal+json 2020-08-02 23:55:35 +02:00
Markus-Rost 36c6e379b2 rewrote discussions formatting 2020-08-02 23:40:30 +02:00
Frisk 0e46d4c971
Initial work 2020-08-02 20:59:17 +02:00
Markus-Rost 4d618f4268 add discussions check 2020-08-02 19:27:42 +02:00
Markus-Rost ca3be79ef1 fix indef block 2020-08-02 14:22:33 +02:00
Frisk 0f3fb86148
Started work 2020-08-02 01:43:49 +02:00
MarkusRost 5a808e4565 remove ugly work around 2020-08-01 21:19:03 +00:00
MarkusRost 5e3497c190 don't link non-link links 2020-08-01 21:17:48 +00:00
Frisk 0e5a3169e2
Improved performance, increased timeout on requests, fixed variable overshadowing issue (aka 'a') 2020-08-01 22:28:08 +02:00
Frisk 06f910b64e
Made it global rate limit resistant 2020-08-01 16:57:34 +02:00
Frisk e26258edb7
Many changes to logic of sending messages "better" exception handling 2020-08-01 12:45:41 +02:00
Frisk ecf07a0534
Fixed logic 2020-08-01 03:15:31 +02:00
Frisk 6731eea33d
Implement new logic depending on Discord's rate limit information coded in headers instead of arbitrary sleep time 2020-08-01 03:02:58 +02:00
Frisk f8293b6255
Some coroutine descriptions 2020-08-01 02:48:14 +02:00
Frisk eb6e03a365
Small fix to new error handler, added more debug in --debug (now with extra spam) 2020-08-01 02:30:49 +02:00
Frisk 8ca9918464
Added debug mode activated with --debug and some additional error handling logic 2020-08-01 01:58:04 +02:00
Frisk 6c3cd96598
Added pt-br translation as per permission from Eduaddad 2020-07-30 21:55:10 +02:00
Frisk 5370cdedc1
Fixed syntax error 2020-07-29 21:38:23 +02:00
Markus-Rost df1643cd1d encode link parts to prevent broken links 2020-07-29 20:16:41 +02:00
Frisk 8e85588ebd
Fixed possible unhandled exception, added debug messages, attempted to fix global exception handler 2020-07-29 18:33:40 +02:00
Frisk eb222bf8b4
Fixed omission with links of some compact msgs, fixed compatibility with python 3.7 2020-07-29 03:02:28 +02:00
Frisk cfa5661480
Fixes from RcGcDw 2020-07-29 02:59:42 +02:00
Frisk b04efc10dc
Fixed other issue with timeout error on python 3.7 2020-07-29 01:33:14 +02:00
Frisk c23937e971
Merge remote-tracking branch 'origin/newusers' 2020-07-29 00:25:49 +02:00
Frisk 121fdedc2b
Fix for python 3.7 2020-07-29 00:21:31 +02:00
Markus-Rost 41281e4ca9 add new users log 2020-07-28 21:15:32 +02:00
Markus-Rost 08dc1e79a5 fix categories 2020-07-28 19:52:48 +02:00
Frisk c9a8396583
Added category fixes 2020-07-28 16:18:06 +02:00
Frisk bcad172bbb
Merge remote-tracking branch 'origin/unknown_data' 2020-07-28 15:58:42 +02:00
Frisk c819694d02
Fixed categories not showing up 2020-07-28 15:58:25 +02:00
Markus-Rost 926747e405 show change on unknown event 2020-07-28 15:41:07 +02:00