Software `/` code `/` prosody

Annotate

plugins/mod_muc_mam.lua @ 11395:d336b28b4002

mod_http_errors: Style tweak Weird to have the background all the way to the edge of the viewport. Would be nice if this could be done without the extra span.

author	Kim Alvefur <zash@zash.se>
date	Sun, 21 Feb 2021 07:59:17 +0100
parent	11282:cabb022f31c0
child	11744:5f99aa6bb76d

rev	line source
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	1 -- XEP-0313: Message Archive Management for Prosody MUC
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	2 -- Copyright (C) 2011-2021 Kim Alvefur
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	3 --
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	4 -- This file is MIT/X11 licensed.
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	5
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	6 if module:get_host_type() ~= "component" then
9872 e1d68f32ce29 mod_muc_mam: Set error status if loaded on incorrect host type Matthew Wild <mwild1@gmail.com> parents: 9845 diff changeset	7 module:log_status("error", "mod_%s should be loaded only on a MUC component, not normal hosts", module.name);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	8 return;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	9 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	10
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	11 local xmlns_mam = "urn:xmpp:mam:2";
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	12 local xmlns_mam_ext = "urn:xmpp:mam:2#extended";
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	13 local xmlns_delay = "urn:xmpp:delay";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	14 local xmlns_forward = "urn:xmpp:forward:0";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	15 local xmlns_st_id = "urn:xmpp:sid:0";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	16 local xmlns_muc_user = "http://jabber.org/protocol/muc#user";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	17 local muc_form_enable = "muc#roomconfig_enablearchiving"
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	18
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	19 local st = require "util.stanza";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	20 local rsm = require "util.rsm";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	21 local jid_bare = require "util.jid".bare;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	22 local jid_split = require "util.jid".split;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	23 local jid_prep = require "util.jid".prep;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	24 local dataform = require "util.dataforms".new;
9844 3de80fc511ab mod_muc_mam: Validate that the FORM_TYPE of a query is as expected Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	25 local get_form_type = require "util.dataforms".get_type;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	26
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	27 local mod_muc = module:depends"muc";
8723 f3bdb20214ab mod_muc_mam: Remove 0.10 compat code Kim Alvefur <zash@zash.se> parents: 8722 diff changeset	28 local get_room_from_jid = mod_muc.get_room_from_jid;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	29
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	30 local is_stanza = st.is_stanza;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	31 local tostring = tostring;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	32 local time_now = os.time;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	33 local m_min = math.min;
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	34 local timestamp, timestamp_parse, datestamp = import( "util.datetime", "datetime", "parse", "date");
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	35 local default_max_items, max_max_items = 20, module:get_option_number("max_archive_query_results", 50);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	36
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	37 local cleanup_after = module:get_option_string("muc_log_expires_after", "1w");
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	38 local cleanup_interval = module:get_option_number("muc_log_cleanup_interval", 4 * 60 * 60);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	39
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	40 local default_history_length = 20;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	41 local max_history_length = module:get_option_number("max_history_messages", math.huge);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	42
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	43 local function get_historylength(room)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	44 return math.min(room._data.history_length or default_history_length, max_history_length);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	45 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	46
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	47 function schedule_cleanup()
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	48 -- replaced by non-noop later if cleanup is enabled
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	49 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	50
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	51 local log_all_rooms = module:get_option_boolean("muc_log_all_rooms", false);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	52 local log_by_default = module:get_option_boolean("muc_log_by_default", true);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	53
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	54 local archive_store = "muc_log";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	55 local archive = module:open_store(archive_store, "archive");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	56
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	57 local archive_item_limit = module:get_option_number("storage_archive_item_limit", archive.caps and archive.caps.quota or 1000);
10800 62794e065e33 MAM: Remove 1% of contents when reaching limits, fix #1545 Kim Alvefur <zash@zash.se> parents: 10683 diff changeset	58 local archive_truncate = math.floor(archive_item_limit * 0.99);
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	59
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	60 if archive.name == "null" or not archive.find then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	61 if not archive.find then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	62 module:log("error", "Attempt to open archive storage returned a driver without archive API support");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	63 module:log("error", "mod_%s does not support archiving",
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	64 archive._provided_by or archive.name and "storage_"..archive.name.."(?)" or "<unknown>");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	65 else
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	66 module:log("error", "Attempt to open archive storage returned null driver");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	67 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	68 module:log("info", "See https://prosody.im/doc/storage and https://prosody.im/doc/archiving for more information");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	69 return false;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	70 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	71
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	72 local function archiving_enabled(room)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	73 if log_all_rooms then
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	74 module:log("debug", "Archiving all rooms");
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	75 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	76 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	77 local enabled = room._data.archiving;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	78 if enabled == nil then
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	79 module:log("debug", "Default is %s (for %s)", log_by_default, room.jid);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	80 return log_by_default;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	81 end
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	82 module:log("debug", "Logging in room %s is %s", room.jid, enabled);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	83 return enabled;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	84 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	85
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	86 if not log_all_rooms then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	87 module:hook("muc-config-form", function(event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	88 local room, form = event.room, event.form;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	89 table.insert(form,
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	90 {
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	91 name = muc_form_enable,
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	92 type = "boolean",
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	93 label = "Enable archiving?",
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	94 value = archiving_enabled(room),
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	95 }
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	96 );
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	97 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	98
8723 f3bdb20214ab mod_muc_mam: Remove 0.10 compat code Kim Alvefur <zash@zash.se> parents: 8722 diff changeset	99 module:hook("muc-config-submitted/"..muc_form_enable, function(event)
f3bdb20214ab mod_muc_mam: Remove 0.10 compat code Kim Alvefur <zash@zash.se> parents: 8722 diff changeset	100 event.room._data.archiving = event.value;
8832 a9c3b15b9d37 mod_muc_mam: Set status code 170/171 on archiving configuration change Kim Alvefur <zash@zash.se> parents: 8786 diff changeset	101 event.status_codes[event.value and "170" or "171"] = true;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	102 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	103 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	104
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	105 -- Note: We ignore the 'with' field as this is internally used for stanza types
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	106 local query_form = dataform {
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	107 { name = "FORM_TYPE"; type = "hidden"; value = xmlns_mam; };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	108 { name = "with"; type = "jid-single"; };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	109 { name = "start"; type = "text-single" };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	110 { name = "end"; type = "text-single"; };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	111 };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	112
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	113 -- Serve form
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	114 module:hook("iq-get/bare/"..xmlns_mam..":query", function(event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	115 local origin, stanza = event.origin, event.stanza;
9552 87e25d352de3 mod_muc_mam: Fix missing form container element Kim Alvefur <zash@zash.se> parents: 9001 diff changeset	116 origin.send(st.reply(stanza):tag("query", { xmlns = xmlns_mam }):add_child(query_form:form()));
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	117 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	118 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	119
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	120 -- Handle archive queries
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	121 module:hook("iq-set/bare/"..xmlns_mam..":query", function(event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	122 local origin, stanza = event.origin, event.stanza;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	123 local room_jid = stanza.attr.to;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	124 local room_node = jid_split(room_jid);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	125 local orig_from = stanza.attr.from;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	126 local query = stanza.tags[1];
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	127
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	128 local room = get_room_from_jid(room_jid);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	129 if not room then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	130 origin.send(st.error_reply(stanza, "cancel", "item-not-found"))
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	131 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	132 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	133 local from = jid_bare(orig_from);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	134
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	135 -- Banned or not a member of a members-only room?
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	136 local from_affiliation = room:get_affiliation(from);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	137 if from_affiliation == "outcast" -- banned
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	138 or room:get_members_only() and not from_affiliation then -- members-only, not a member
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	139 origin.send(st.error_reply(stanza, "auth", "forbidden"))
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	140 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	141 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	142
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	143 local qid = query.attr.queryid;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	144
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	145 -- Search query parameters
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	146 local qstart, qend;
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	147 local qbefore, qafter;
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	148 local qids;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	149 local form = query:get_child("x", "jabber:x:data");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	150 if form then
9844 3de80fc511ab mod_muc_mam: Validate that the FORM_TYPE of a query is as expected Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	151 local form_type, err = get_form_type(form);
10558 40c2500208f4 mod_muc_mam: Handle form identification error (e.g. not a form at all) Kim Alvefur <zash@zash.se> parents: 10415 diff changeset	152 if not form_type then
40c2500208f4 mod_muc_mam: Handle form identification error (e.g. not a form at all) Kim Alvefur <zash@zash.se> parents: 10415 diff changeset	153 origin.send(st.error_reply(stanza, "modify", "bad-request", "Invalid dataform: "..err));
40c2500208f4 mod_muc_mam: Handle form identification error (e.g. not a form at all) Kim Alvefur <zash@zash.se> parents: 10415 diff changeset	154 return true;
40c2500208f4 mod_muc_mam: Handle form identification error (e.g. not a form at all) Kim Alvefur <zash@zash.se> parents: 10415 diff changeset	155 elseif form_type ~= xmlns_mam then
9844 3de80fc511ab mod_muc_mam: Validate that the FORM_TYPE of a query is as expected Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	156 origin.send(st.error_reply(stanza, "modify", "bad-request", "Unexpected FORM_TYPE, expected '"..xmlns_mam.."'"));
3de80fc511ab mod_muc_mam: Validate that the FORM_TYPE of a query is as expected Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	157 return true;
3de80fc511ab mod_muc_mam: Validate that the FORM_TYPE of a query is as expected Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	158 end
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	159 form, err = query_form:data(form);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	160 if err then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	161 origin.send(st.error_reply(stanza, "modify", "bad-request", select(2, next(err))));
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	162 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	163 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	164 qstart, qend = form["start"], form["end"];
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	165 qbefore, qafter = form["before-id"], form["after-id"];
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	166 qids = form["ids"];
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	167 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	168
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	169 if qstart or qend then -- Validate timestamps
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	170 local vstart, vend = (qstart and timestamp_parse(qstart)), (qend and timestamp_parse(qend))
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	171 if (qstart and not vstart) or (qend and not vend) then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	172 origin.send(st.error_reply(stanza, "modify", "bad-request", "Invalid timestamp"))
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	173 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	174 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	175 qstart, qend = vstart, vend;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	176 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	177
10415 360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	178 module:log("debug", "Archive query by %s id=%s when=%s...%s",
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	179 origin.username,
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	180 qid or stanza.attr.id,
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	181 qstart and timestamp(qstart) or "",
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	182 qend and timestamp(qend) or "");
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	183
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	184 -- RSM stuff
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	185 local qset = rsm.get(query);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	186 local qmax = m_min(qset and qset.max or default_max_items, max_max_items);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	187 local reverse = qset and qset.before or false;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	188
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	189 local before, after = qset and qset.before or qbefore, qset and qset.after or qafter;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	190 if type(before) ~= "string" then before = nil; end
10415 360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	191 if qset then
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	192 module:log("debug", "Archive query id=%s rsm=%q", qid or stanza.attr.id, qset);
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	193 end
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	194 -- A reverse query needs to be flipped
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	195 local flip = reverse;
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	196 -- A flip-page query needs to be the opposite of that.
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	197 if query:get_child("flip-page") then flip = not flip end
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	198
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	199 -- Load all the data!
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	200 local data, err = archive:find(room_node, {
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	201 start = qstart; ["end"] = qend; -- Time range
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	202 limit = qmax + 1;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	203 before = before; after = after;
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	204 ids = qids;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	205 reverse = reverse;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	206 with = "message<groupchat";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	207 });
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	208
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	209 if not data then
10415 360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	210 module:log("debug", "Archive query id=%s failed: %s", qid or stanza.attr.id, err);
10022 b56654f89cd5 mod_muc_mam: Propagate item-not-found to client (fixes #1325) Kim Alvefur <zash@zash.se> parents: 10000 diff changeset	211 if err == "item-not-found" then
b56654f89cd5 mod_muc_mam: Propagate item-not-found to client (fixes #1325) Kim Alvefur <zash@zash.se> parents: 10000 diff changeset	212 origin.send(st.error_reply(stanza, "modify", "item-not-found"));
b56654f89cd5 mod_muc_mam: Propagate item-not-found to client (fixes #1325) Kim Alvefur <zash@zash.se> parents: 10000 diff changeset	213 else
b56654f89cd5 mod_muc_mam: Propagate item-not-found to client (fixes #1325) Kim Alvefur <zash@zash.se> parents: 10000 diff changeset	214 origin.send(st.error_reply(stanza, "cancel", "internal-server-error"));
b56654f89cd5 mod_muc_mam: Propagate item-not-found to client (fixes #1325) Kim Alvefur <zash@zash.se> parents: 10000 diff changeset	215 end
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	216 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	217 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	218 local total = tonumber(err);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	219
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	220 local msg_reply_attr = { to = stanza.attr.from, from = stanza.attr.to };
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	221
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	222 local results = {};
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	223
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	224 -- Wrap it in stuff and deliver
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	225 local first, last;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	226 local count = 0;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	227 local complete = "true";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	228 for id, item, when in data do
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	229 count = count + 1;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	230 if count > qmax then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	231 complete = nil;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	232 break;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	233 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	234 local fwd_st = st.message(msg_reply_attr)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	235 :tag("result", { xmlns = xmlns_mam, queryid = qid, id = id })
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	236 :tag("forwarded", { xmlns = xmlns_forward })
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	237 :tag("delay", { xmlns = xmlns_delay, stamp = timestamp(when) }):up();
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	238
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	239 -- Strip <x> tag, containing the original senders JID, unless the room makes this public
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	240 if room:get_whois() ~= "anyone" then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	241 item:maptags(function (tag)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	242 if tag.name == "x" and tag.attr.xmlns == xmlns_muc_user then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	243 return nil;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	244 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	245 return tag;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	246 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	247 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	248 if not is_stanza(item) then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	249 item = st.deserialize(item);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	250 end
9841 a44f562e01a5 mod_muc_mam: Strip the stanza 'to' attribute (fixes #1259) Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	251 item.attr.to = nil;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	252 item.attr.xmlns = "jabber:client";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	253 fwd_st:add_child(item);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	254
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	255 if not first then first = id; end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	256 last = id;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	257
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	258 if flip then
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	259 results[count] = fwd_st;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	260 else
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	261 origin.send(fwd_st);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	262 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	263 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	264
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	265 if flip then
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	266 for i = #results, 1, -1 do
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	267 origin.send(results[i]);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	268 end
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	269 end
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	270 if reverse then
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	271 first, last = last, first;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	272 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	273
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	274
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	275 origin.send(st.reply(stanza)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	276 :tag("fin", { xmlns = xmlns_mam, queryid = qid, complete = complete })
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	277 :add_child(rsm.generate {
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	278 first = first, last = last, count = total }));
10415 360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	279
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	280 -- That's all folks!
360d574517b6 mod_muc_mam: Copy debug log improvements from mod_mam Kim Alvefur <zash@zash.se> parents: 10119 diff changeset	281 module:log("debug", "Archive query id=%s completed, %d items returned", qid or stanza.attr.id, complete and count or count - 1);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	282 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	283 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	284
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	285 module:hook("muc-get-history", function (event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	286 local room = event.room;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	287 if not archiving_enabled(room) then return end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	288 local room_jid = room.jid;
8783 79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	289 local maxstanzas = event.maxstanzas;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	290 local maxchars = event.maxchars;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	291 local since = event.since;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	292 local to = event.to;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	293
8784 64b78e3deb96 mod_muc_mam: Skip fetching history if no history was requested Kim Alvefur <zash@zash.se> parents: 8783 diff changeset	294 if maxstanzas == 0 or maxchars == 0 then
64b78e3deb96 mod_muc_mam: Skip fetching history if no history was requested Kim Alvefur <zash@zash.se> parents: 8783 diff changeset	295 return -- No history requested
64b78e3deb96 mod_muc_mam: Skip fetching history if no history was requested Kim Alvefur <zash@zash.se> parents: 8783 diff changeset	296 end
64b78e3deb96 mod_muc_mam: Skip fetching history if no history was requested Kim Alvefur <zash@zash.se> parents: 8783 diff changeset	297
8783 79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	298 if not maxstanzas or maxstanzas > get_historylength(room) then
79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	299 maxstanzas = get_historylength(room);
79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	300 end
79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	301
8785 82b889608503 mod_muc_mam: Skip fetching history if built-in recent history is enough Kim Alvefur <zash@zash.se> parents: 8784 diff changeset	302 if room._history and #room._history >= maxstanzas then
82b889608503 mod_muc_mam: Skip fetching history if built-in recent history is enough Kim Alvefur <zash@zash.se> parents: 8784 diff changeset	303 return -- It can deal with this itself
82b889608503 mod_muc_mam: Skip fetching history if built-in recent history is enough Kim Alvefur <zash@zash.se> parents: 8784 diff changeset	304 end
82b889608503 mod_muc_mam: Skip fetching history if built-in recent history is enough Kim Alvefur <zash@zash.se> parents: 8784 diff changeset	305
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	306 -- Load all the data!
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	307 local query = {
8783 79133eca0656 mod_muc_mam: Tweak calculation of max history to retrieve Kim Alvefur <zash@zash.se> parents: 8725 diff changeset	308 limit = maxstanzas;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	309 start = since;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	310 reverse = true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	311 with = "message<groupchat";
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	312 }
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	313 local data, err = archive:find(jid_split(room_jid), query);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	314
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	315 if not data then
10111 0f335815244f plugins: Remove tostring call from logging Kim Alvefur <zash@zash.se> parents: 10030 diff changeset	316 module:log("error", "Could not fetch history: %s", err);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	317 return
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	318 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	319
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	320 local history, i = {}, 1;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	321
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	322 for id, item, when in data do
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	323 item.attr.to = to;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	324 item:tag("delay", { xmlns = "urn:xmpp:delay", from = room_jid, stamp = timestamp(when) }):up(); -- XEP-0203
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	325 item:tag("stanza-id", { xmlns = xmlns_st_id, by = room_jid, id = id }):up();
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	326 if room:get_whois() ~= "anyone" then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	327 item:maptags(function (tag)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	328 if tag.name == "x" and tag.attr.xmlns == xmlns_muc_user then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	329 return nil;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	330 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	331 return tag;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	332 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	333 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	334 if maxchars then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	335 local chars = #tostring(item);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	336 if maxchars - chars < 0 then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	337 break
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	338 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	339 maxchars = maxchars - chars;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	340 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	341 history[i], i = item, i+1;
10111 0f335815244f plugins: Remove tostring call from logging Kim Alvefur <zash@zash.se> parents: 10030 diff changeset	342 -- module:log("debug", item);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	343 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	344 function event.next_stanza()
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	345 i = i - 1;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	346 return history[i];
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	347 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	348 return true;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	349 end, 1);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	350
10814 e042b0c8b310 mod_muc_mam: Fix stanza id filter event name, fixes #1546 Kim Alvefur <zash@zash.se> parents: 10682 diff changeset	351 module:hook("muc-broadcast-message", function (event)
8786 adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	352 local room, stanza = event.room, event.stanza;
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	353
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	354 -- Filter out <stanza-id> that claim to be from us
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	355 stanza:maptags(function (tag)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	356 if tag.name == "stanza-id" and tag.attr.xmlns == xmlns_st_id
8786 adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	357 and jid_prep(tag.attr.by) == room.jid then
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	358 return nil;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	359 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	360 return tag;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	361 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	362
10834 c6e852984d48 mod_muc_mam: Remove spoofed archive IDs before archiving, fix #1552 Kim Alvefur <zash@zash.se> parents: 10815 diff changeset	363 end, 1);
8786 adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	364
adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	365 -- Handle messages
adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	366 local function save_to_history(self, stanza)
10560 3adb6c46fbf4 mod_muc_mam: Remove unused variable [luacheck] Kim Alvefur <zash@zash.se> parents: 10558 diff changeset	367 local room_node = jid_split(self.jid);
8786 adffadd88ff0 mod_muc_mam: Have stanza-id filtering over all groupchat messages, not just ones considered for history Kim Alvefur <zash@zash.se> parents: 8785 diff changeset	368
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	369 local stored_stanza = stanza;
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	370
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	371 if stanza.name == "message" and self:get_whois() == "anyone" then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	372 stored_stanza = st.clone(stanza);
9841 a44f562e01a5 mod_muc_mam: Strip the stanza 'to' attribute (fixes #1259) Kim Alvefur <zash@zash.se> parents: 9552 diff changeset	373 stored_stanza.attr.to = nil;
10670 5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	374 local occupant = self._occupants[stanza.attr.from];
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	375 if occupant then
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	376 local actor = jid_bare(occupant.jid);
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	377 local affiliation = self:get_affiliation(actor) or "none";
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	378 local role = self:get_role(actor) or self:get_default_role(affiliation);
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	379 stored_stanza:add_direct_child(st.stanza("x", { xmlns = xmlns_muc_user })
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	380 :tag("item", { affiliation = affiliation; role = role; jid = actor }));
5376f882cf82 mod_muc_mam: Fix traceback saving message from non-occupant (fixes #1497) Kim Alvefur <zash@zash.se> parents: 10566 diff changeset	381 end
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	382 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	383
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	384 -- Policy check
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	385 if not archiving_enabled(self) then return end -- Don't log
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	386
9843 17060708d0eb mod_muc_mam: Add comment about the tricks done with the 'with' field Kim Alvefur <zash@zash.se> parents: 9842 diff changeset	387 -- Save the type in the 'with' field, allows storing presence without conflicts
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	388 local with = stanza.name
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	389 if stanza.attr.type then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	390 with = with .. "<" .. stanza.attr.type
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	391 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	392
9842 6f39be2e0be5 mod_muc_mam: Move a comment to the line it describes Kim Alvefur <zash@zash.se> parents: 9841 diff changeset	393 -- And stash it
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	394 local time = time_now();
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	395 local id, err = archive:append(room_node, nil, stored_stanza, time, with);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	396
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	397 if not id and err == "quota-limit" then
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	398 if type(cleanup_after) == "number" then
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	399 module:log("debug", "Room '%s' over quota, cleaning archive", room_node);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	400 local cleaned = archive:delete(room_node, {
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	401 ["end"] = (os.time() - cleanup_after);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	402 });
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	403 if cleaned then
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	404 id, err = archive:append(room_node, nil, stored_stanza, time, with);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	405 end
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	406 end
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	407 if not id and (archive.caps and archive.caps.truncate) then
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	408 module:log("debug", "User '%s' over quota, truncating archive", room_node);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	409 local truncated = archive:delete(room_node, {
10800 62794e065e33 MAM: Remove 1% of contents when reaching limits, fix #1545 Kim Alvefur <zash@zash.se> parents: 10683 diff changeset	410 truncate = archive_truncate;
10000 189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	411 });
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	412 if truncated then
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	413 id, err = archive:append(room_node, nil, stored_stanza, time, with);
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	414 end
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	415 end
189b00a782bf mod_muc_mam: Handle archive quotas Kim Alvefur <zash@zash.se> parents: 9882 diff changeset	416 end
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	417
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	418 if id then
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	419 schedule_cleanup(room_node);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	420 stanza:add_direct_child(st.stanza("stanza-id", { xmlns = xmlns_st_id, by = self.jid, id = id }));
10526 28c8e09fb3cd mod_muc_mam: Log error when unable to store stanza (fix #1480) [luacheck] Kim Alvefur <zash@zash.se> parents: 10029 diff changeset	421 else
28c8e09fb3cd mod_muc_mam: Log error when unable to store stanza (fix #1480) [luacheck] Kim Alvefur <zash@zash.se> parents: 10029 diff changeset	422 module:log("error", "Could not archive stanza: %s", err);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	423 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	424 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	425
8724 cfcc78c50905 mod_muc_mam: Let muc/history.lib decide which messages to store Kim Alvefur <zash@zash.se> parents: 8723 diff changeset	426 module:hook("muc-add-history", function (event)
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	427 local room, stanza = event.room, event.stanza;
8724 cfcc78c50905 mod_muc_mam: Let muc/history.lib decide which messages to store Kim Alvefur <zash@zash.se> parents: 8723 diff changeset	428 save_to_history(room, stanza);
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	429 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	430
9001 23070882f3d4 mod_muc_mam: Disable presence logging by default Kim Alvefur <zash@zash.se> parents: 8832 diff changeset	431 if module:get_option_boolean("muc_log_presences", false) then
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	432 module:hook("muc-occupant-joined", function (event)
8725 ced09d7d7c96 mod_muc_mam: Save the MUC <x> on recorded join stanzas Kim Alvefur <zash@zash.se> parents: 8724 diff changeset	433 save_to_history(event.room, st.stanza("presence", { from = event.nick }):tag("x", { xmlns = "http://jabber.org/protocol/muc" }));
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	434 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	435 module:hook("muc-occupant-left", function (event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	436 save_to_history(event.room, st.stanza("presence", { type = "unavailable", from = event.nick }));
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	437 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	438 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	439
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	440 if not archive.delete then
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	441 module:log("warn", "Storage driver %s does not support deletion", archive._provided_by);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	442 module:log("warn", "Archived message will persist after a room has been destroyed");
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	443 else
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	444 module:hook("muc-room-destroyed", function(event)
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	445 local room_node = jid_split(event.room.jid);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	446 archive:delete(room_node);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	447 end);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	448 end
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	449
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	450 -- And role/affiliation changes?
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	451
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	452 module:add_feature(xmlns_mam);
7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	453
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	454 local advertise_extended = archive.caps and archive.caps.full_id_range and archive.caps.ids;
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	455
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	456 module:hook("muc-disco#info", function(event)
10119 29733134c76c mod_muc_mam: Conditionally advertise MAM feature on rooms (fixes #1407) Kim Alvefur <zash@zash.se> parents: 10111 diff changeset	457 if archiving_enabled(event.room) then
29733134c76c mod_muc_mam: Conditionally advertise MAM feature on rooms (fixes #1407) Kim Alvefur <zash@zash.se> parents: 10111 diff changeset	458 event.reply:tag("feature", {var=xmlns_mam}):up();
11282 cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	459 if advertise_extended then
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	460 (event.reply or event.stanza):tag("feature", {var=xmlns_mam_ext}):up();
cabb022f31c0 mod_muc_mam: Copy extended MAM support from mod_mam Kim Alvefur <zash@zash.se> parents: 10944 diff changeset	461 end
10119 29733134c76c mod_muc_mam: Conditionally advertise MAM feature on rooms (fixes #1407) Kim Alvefur <zash@zash.se> parents: 10111 diff changeset	462 end
10815 c432b7172fa3 mod_muc_mam: Fix missing advertising of XEP-0359, fixes #1547 Kim Alvefur <zash@zash.se> parents: 10814 diff changeset	463 event.reply:tag("feature", {var=xmlns_st_id}):up();
8722 7ee93b3fa160 mod_muc_mam: Import mod_mam_muc from prosody-modules ba6466fa6823 Kim Alvefur <zash@zash.se> parents: diff changeset	464 end);
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	465
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	466 -- Cleanup
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	467
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	468 if cleanup_after ~= "never" then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	469 local cleanup_storage = module:open_store("muc_log_cleanup");
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	470 local cleanup_map = module:open_store("muc_log_cleanup", "map");
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	471
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	472 local day = 86400;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	473 local multipliers = { d = day, w = day * 7, m = 31 * day, y = 365.2425 * day };
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	474 local n, m = cleanup_after:lower():match("(%d+)%s*([dwmy]?)");
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	475 if not n then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	476 module:log("error", "Could not parse muc_log_expires_after string %q", cleanup_after);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	477 return false;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	478 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	479
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	480 cleanup_after = tonumber(n) * ( multipliers[m] or 1 );
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	481
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	482 module:log("debug", "muc_log_expires_after = %d -- in seconds", cleanup_after);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	483
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	484 if not archive.delete then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	485 module:log("error", "muc_log_expires_after set but mod_%s does not support deleting", archive._provided_by);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	486 return false;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	487 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	488
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	489 -- For each day, store a set of rooms that have new messages. To expire
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	490 -- messages, we collect the union of sets of rooms from dates that fall
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	491 -- outside the cleanup range.
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	492
10029 2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	493 local last_date = require "util.cache".new(module:get_option_number("muc_log_cleanup_date_cache_size", 1000));
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	494 function schedule_cleanup(roomname, date)
10029 2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	495 date = date or datestamp();
2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	496 if last_date:get(roomname) == date then return end
2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	497 local ok = cleanup_map:set(date, roomname, true);
2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	498 if ok then
2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	499 last_date:set(roomname, date);
2c8f674b9243 mod_muc_mam: Cache last date that archive owner has messages to reduce writes (fixes #1368) Kim Alvefur <zash@zash.se> parents: 9880 diff changeset	500 end
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	501 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	502
10585 2d8535338099 mod_muc_mam: Measure how long a cleanup run takes (like mod_mam) Kim Alvefur <zash@zash.se> parents: 10568 diff changeset	503 local cleanup_time = module:measure("cleanup", "times");
2d8535338099 mod_muc_mam: Measure how long a cleanup run takes (like mod_mam) Kim Alvefur <zash@zash.se> parents: 10568 diff changeset	504
10682 62ef68f95b6f mod_mam,mod_muc_mam: Allow other work to be performed during archive cleanup (fixes #1504) Kim Alvefur <zash@zash.se> parents: 10670 diff changeset	505 local async = require "util.async";
62ef68f95b6f mod_mam,mod_muc_mam: Allow other work to be performed during archive cleanup (fixes #1504) Kim Alvefur <zash@zash.se> parents: 10670 diff changeset	506 cleanup_runner = async.runner(function ()
10585 2d8535338099 mod_muc_mam: Measure how long a cleanup run takes (like mod_mam) Kim Alvefur <zash@zash.se> parents: 10568 diff changeset	507 local cleanup_done = cleanup_time();
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	508 local rooms = {};
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	509 local cut_off = datestamp(os.time() - cleanup_after);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	510 for date in cleanup_storage:users() do
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	511 if date <= cut_off then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	512 module:log("debug", "Messages from %q should be expired", date);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	513 local messages_this_day = cleanup_storage:get(date);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	514 if messages_this_day then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	515 for room in pairs(messages_this_day) do
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	516 rooms[room] = true;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	517 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	518 if date < cut_off then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	519 -- Messages from the same day as the cut-off might not have expired yet,
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	520 -- but all earlier will have, so clear storage for those days.
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	521 cleanup_storage:set(date, nil);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	522 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	523 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	524 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	525 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	526 local sum, num_rooms = 0, 0;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	527 for room in pairs(rooms) do
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	528 local ok, err = archive:delete(room, { ["end"] = os.time() - cleanup_after; })
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	529 if ok then
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	530 num_rooms = num_rooms + 1;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	531 sum = sum + (tonumber(ok) or 0);
10561 29b3eb95c268 mod_muc_mam: Log error when unable to delete old messages (fix #1481) [luacheck] Kim Alvefur <zash@zash.se> parents: 10526 diff changeset	532 else
10562 670afc079f68 mod_muc_mam: Schedule cleanup again on failure Kim Alvefur <zash@zash.se> parents: 10561 diff changeset	533 cleanup_map:set(cut_off, room, true);
10561 29b3eb95c268 mod_muc_mam: Log error when unable to delete old messages (fix #1481) [luacheck] Kim Alvefur <zash@zash.se> parents: 10526 diff changeset	534 module:log("error", "Could not delete messages for room '%s': %s", room, err);
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	535 end
10682 62ef68f95b6f mod_mam,mod_muc_mam: Allow other work to be performed during archive cleanup (fixes #1504) Kim Alvefur <zash@zash.se> parents: 10670 diff changeset	536 local wait, done = async.waiter();
62ef68f95b6f mod_mam,mod_muc_mam: Allow other work to be performed during archive cleanup (fixes #1504) Kim Alvefur <zash@zash.se> parents: 10670 diff changeset	537 module:add_timer(0.01, done);
62ef68f95b6f mod_mam,mod_muc_mam: Allow other work to be performed during archive cleanup (fixes #1504) Kim Alvefur <zash@zash.se> parents: 10670 diff changeset	538 wait();
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	539 end
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	540 module:log("info", "Deleted %d expired messages for %d rooms", sum, num_rooms);
10585 2d8535338099 mod_muc_mam: Measure how long a cleanup run takes (like mod_mam) Kim Alvefur <zash@zash.se> parents: 10568 diff changeset	541 cleanup_done();
9880 78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	542 end);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	543
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	544 cleanup_task = module:add_timer(1, function ()
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	545 cleanup_runner:run(true);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	546 return cleanup_interval;
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	547 end);
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	548 else
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	549 module:log("debug", "Archive expiry disabled");
78885b1bbb91 mod_muc_mam: Copy cleanup mechanism from mod_mam (fixes #672) Kim Alvefur <zash@zash.se> parents: 9843 diff changeset	550 end

prosody

d336b28b4002

plugins/mod_muc_mam.lua

Software / code / prosody

Annotate

plugins/mod_muc_mam.lua @ 11395:d336b28b4002

Software `/` code `/` prosody