614 commits

Author	SHA1	Message	Date
Ekaterina Vaartis	0cf3654907	Rework task indexing to share code with the main module ... The code in the main module now scrubs new posts too	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	117f525fd6	Adjust content indexing to skip more unneeded stuff	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	14ef6ce80f	Mark only content as searchable for meilisearch	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	52a872432d	Make the chunk size smaller	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	a586ce0ddd	Use content instead of source and scrub it	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	c3a04166a0	Tweak search ordering to hopefully return newer results	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	7b3701e6b9	Make meilisearch sort on publish date converted to unix time	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	abf82a63ec	Make the indexing batch differently and more, show number indexed	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	e5ac2ffa07	Ensure only indexing public posts and implement clearing and delete	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	41db5c8653	Add logging to milisiearch index and make it use desc(id)	2022-06-29 20:48:29 +01:00
Ekaterina Vaartis	e961cf2689	Initial meilisearch implementation, doesn't delete posts yet	2022-06-29 20:48:28 +01:00
FloatingGhost	12a171844b	Merge remote-tracking branch 'upstream/develop' into develop	2021-12-30 18:05:22 +00:00
FloatingGhost	415d9dd6f6	Merge remote-tracking branch 'origin/feature/elasticsearch' into develop	2021-12-16 16:13:41 +00:00
Alex Gleason	e1b89fe3aa	Merge remote-tracking branch 'origin/develop' into live-dashboard	2021-12-15 19:05:36 -05:00
Alex Gleason	29d80b39f2	Add Phoenix LiveDashboard ... Co-authored-by: Egor Kislitsyn <egor@kislitsyn.com>	2021-12-15 19:05:27 -05:00
sadposter	8378c3a8bc	extra cool	2021-12-14 14:48:24 +00:00
FloatingGhost	9d5d964bf8	merge	2021-12-14 14:28:15 +00:00
sadposter	cc4c5f22f4	fix inbound federation	2021-12-14 14:27:42 +00:00
sadposter	8f78cb3050	Merge branch 'develop' of gitssh.ihatebeinga.live:IHBAGang/pleroma into develop	2021-12-14 14:01:09 +00:00
sadposter	5d901c337e	fix inbound federation	2021-12-14 13:58:16 +00:00
FloatingGhost	703f53c08f	Search through users and hashtags as well	2021-12-14 13:55:14 +00:00
FloatingGhost	a85bf5929b	add hashtag indexing	2021-12-14 13:55:14 +00:00
FloatingGhost	6ca70833f5	add user import	2021-12-14 13:55:14 +00:00
FloatingGhost	c03e8d46e8	Search through users and hashtags as well	2021-12-14 13:53:46 +00:00
FloatingGhost	8547cefaff	add hashtag indexing	2021-12-14 12:37:10 +00:00
FloatingGhost	6bb19454fd	add user import	2021-12-13 20:27:35 +00:00
sadposter	e835212a7d	enforce visibility	2021-12-12 20:12:06 +00:00
sadposter	23c758bbe7	enforce visibility	2021-12-12 18:25:20 +00:00
FloatingGhost	de60b1f3c1	make search provider configurable	2021-12-12 17:35:35 +00:00
FloatingGhost	9002e5155b	Add import functionality	2021-12-12 17:35:35 +00:00
FloatingGhost	ed3a866f94	make search provider configurable	2021-12-12 17:23:44 +00:00
FloatingGhost	c684265585	Add import functionality	2021-12-11 17:36:49 +00:00
sadposter	6a6260f64e	re-enable deactivated check	2021-12-06 12:03:16 +00:00
sadposter	ca2bd8b72b	remove deactivated_users call	2021-12-06 10:18:16 +00:00
sadposter	bb54720778	add debug	2021-12-05 21:56:11 +00:00
sadposter	eb1c7d75f4	Merge branch 'develop' of https://git.pleroma.social/pleroma/pleroma into develop	2021-10-16 14:08:04 +01:00
Haelwenn (lanodan) Monnier	a17910a6c6	CI: Bump lint stage to elixir-1.12 ... Elixir 1.12 changed formatting rules, this allows to avoid having to rollback to run `mix format`	2021-10-06 08:11:05 +02:00
sadposter	b202cf15d6	Merge branch 'develop' of https://git.pleroma.social/pleroma/pleroma into develop	2021-08-30 22:04:42 +01:00
someone	cc4f20b130	mix pleroma.database set_text_search_config now runs concurrently and infinitely ... Backport of: https://git.pleroma.social/pleroma/pleroma/-/merge_requests/3514	2021-08-28 18:29:43 +02:00
someone	4b940e441a	mix pleroma.database set_text_search_config now runs concurrently and infinitely	2021-08-15 13:49:12 -04:00
sadposter	e56c319e8f	merge	2021-06-27 22:31:37 +01:00
feld	bc51dea425	Update lib/mix/tasks/pleroma/database.ex	2021-06-07 20:02:28 +00:00
faried nawaz	5be9d13981	a better query to delete from hashtags ... old query: Delete on hashtags (cost=5089.81..5521.63 rows=6160 width=18) -> Hash Semi Join (cost=5089.81..5521.63 rows=6160 width=18) Hash Cond: (hashtags.id = ht.id) -> Seq Scan on hashtags (cost=0.00..317.28 rows=17528 width=14) -> Hash (cost=5012.81..5012.81 rows=6160 width=20) -> Merge Anti Join (cost=0.70..5012.81 rows=6160 width=20) Merge Cond: (ht.id = hto.hashtag_id) -> Index Scan using hashtags_pkey on hashtags ht (cost=0.29..610.53 rows=17528 width=14) -> Index Scan using hashtags_objects_pkey on hashtags_objects hto (cost=0.42..3506.48 rows=68158 width=14) new query: Delete on hashtags ht (cost=0.70..5012.81 rows=6160 width=12) -> Merge Anti Join (cost=0.70..5012.81 rows=6160 width=12) Merge Cond: (ht.id = hto.hashtag_id) -> Index Scan using hashtags_pkey on hashtags ht (cost=0.29..610.53 rows=17528 width=14) -> Index Scan using hashtags_objects_pkey on hashtags_objects hto (cost=0.42..3506.48 rows=68158 width=14)	2021-05-08 02:00:43 +05:00
faried nawaz	a0c9a2b4cc	mix prune_objects: remove unused hashtags after pruning remote objects	2021-05-08 02:00:42 +05:00
sadposter	5f62b55a6f	Merge branch 'develop' of https://git.pleroma.social/pleroma/pleroma into develop	2021-03-23 23:01:07 +00:00
Alexander Strizhakov	4cd34d0197	suggestion	2021-03-23 17:27:02 +03:00
Alexander Strizhakov	03843a5386	migrating config to tmp folder	2021-03-23 14:29:02 +03:00
sadposter	292ddf730c	Merge branch 'develop' of https://git.pleroma.social/pleroma/pleroma into develop	2021-03-03 13:51:07 +00:00
Ivan Tashkinov	882dd46843	Merge remote-tracking branch 'remotes/origin/develop' into feature/object-hashtags-rework	2021-03-02 08:26:30 +03:00
feld	2217b35bd4	Merge branch 'ecto-rollback-in-test-env' into 'develop' ... Possibility to run rollback in test env See merge request pleroma/pleroma!3212	2021-02-26 16:47:53 +00:00