225 Commits (main)

All Branches

Search

Author	SHA1	Message	Date
Olivier 'reivilibre'	b1d2c49f96	Fix flake and make nixpkgs top-level so it can follow	2024-05-08 20:34:52 +01:00
Olivier 'reivilibre'	e07ac16bc4	Skip raking of weeded URLs ... May be useful for retroactively clearing out URLs	2023-03-31 22:59:23 +01:00
Olivier 'reivilibre'	ff514e90b8	Simplify allowed_/weed_domains	2023-03-31 22:50:02 +01:00
Olivier 'reivilibre'	1c10cb203a	Dodge some places where we enqueue URLs without checking they have supported schemes	2023-03-30 23:40:43 +01:00
Olivier 'reivilibre'	1e8aa95e7a	Respect nofollow and noindex <meta> robots tags ... Along with doing the right thing, this should speed up raking for us	2023-03-30 23:09:39 +01:00
Olivier 'reivilibre'	18d2023550	Add a debug line when we rake something	2023-03-30 21:17:15 +01:00
Olivier 'reivilibre'	83fecf1464	Improve the raker to perform a reinstate periodically and to respawn workers	2023-03-28 21:09:24 +01:00
Olivier 'reivilibre'	626b448245	raker: Switch to Jemalloc for the global allocator	2023-03-22 23:08:08 +00:00
Olivier 'reivilibre'	4f5977002b	nixos: Add way of building the static files	2023-03-22 01:20:13 +00:00
Olivier 'reivilibre'	0811be9ae0	nixos: fix path to import module	2023-03-21 23:58:26 +00:00
Olivier 'reivilibre'	63f94577c9	nixos: Add working directory config option to quickpeepSearch	2023-03-21 23:56:47 +00:00
Olivier 'reivilibre'	6d37a07d3e	Clarify and handle 'No domain for URL' error in a better way	2023-03-21 23:36:47 +00:00
Olivier 'reivilibre'	73c72bce25	nixos: Add a quickpeepIndex service if an autoIndexUrl is specified	2023-03-21 23:31:17 +00:00
Olivier 'reivilibre'	0bebfc0025	Fix unfinished work around SecureUpgrade	2022-12-03 15:13:06 +00:00
Olivier 'reivilibre'	99fcbf77f6	Hide icons that don't exist	2022-12-03 15:08:59 +00:00
Olivier 'reivilibre'	e2a4835536	Fix light theme having unreadable search results	2022-11-30 22:01:58 +00:00
Olivier 'reivilibre'	51c90ecaa0	(yarn.lock update)	2022-11-30 22:01:52 +00:00
Olivier 'reivilibre'	cfb2fca649	Add a page for testing search theme	2022-11-30 22:01:49 +00:00
Olivier 'reivilibre'	05a60af389	tantivy backend: return tags in search results	2022-11-28 23:19:11 +00:00
Olivier 'reivilibre'	bff48f35f4	Make the raker attempt HTTPS upgrades ... Not only does this improve security for searchers later on, it also enables us to cut down on the number of duplicates quite easily.	2022-11-28 23:15:37 +00:00
Olivier 'reivilibre'	34a05f84ff	Add OpenSearch XML	2022-11-28 22:49:18 +00:00
Olivier 'reivilibre'	8b439c1550	Remove noisy and obsolete debug output in the sitemap extractor	2022-11-27 10:14:47 +00:00
Olivier 'reivilibre'	b254ab1231	rakepack feeds: Only pull the ones that we can index	2022-11-27 10:11:13 +00:00
Olivier 'reivilibre'	8578ee4b10	Fix manual-pushing pipeline	2022-11-27 10:02:52 +00:00
Olivier 'reivilibre'	0654d1aa07	Fix raker tools having wrong default config path	2022-11-27 00:02:33 +00:00
Olivier 'reivilibre'	4bba2fc89b	Don't fall over on unknown schemes e.g. mailto:	2022-11-26 23:47:23 +00:00
Olivier 'reivilibre'	c940900fab	Add missing URL clean	2022-11-26 22:59:24 +00:00
Olivier 'reivilibre'	438beed86a	Add more error context	2022-11-26 22:59:14 +00:00
Olivier 'reivilibre'	08f4b7aeaa	Add a lot of debug output	2022-11-26 22:45:51 +00:00
Olivier 'reivilibre'	2ce8e2ba8e	Fix qp-seedrake	2022-11-26 22:30:40 +00:00
Olivier 'reivilibre'	54a468d079	Add facility to qp-indexer that lets it download rakepacks from a feed	2022-11-26 20:48:06 +00:00
Olivier 'reivilibre'	bd16f58d9e	Maintain an index file of rakepacks and append when a rakepack is finished	2022-11-26 20:07:12 +00:00
Olivier 'reivilibre'	52d0183942	Reinstate re-rakable URLs on startup	2022-11-26 19:22:34 +00:00
Olivier 'reivilibre'	6ecbc0561f	Add configurable re-rake times for different kinds of raked things	2022-11-26 19:05:36 +00:00
Olivier 'reivilibre'	d5255410f5	Fix comment on last_visited_days	2022-11-26 18:15:53 +00:00
Olivier 'reivilibre'	94a0a588cf	Add documentation about the seed collection service	2022-11-26 18:09:34 +00:00
Olivier 'reivilibre'	20d9fb956a	Update qp-seedcoll* to use quickpeep.ron instead of qp_web.ron ... like all the other utilities	2022-11-26 17:19:31 +00:00
Olivier 'reivilibre'	402135a6fa	Add Nix shell	2022-11-21 15:21:52 +00:00
Olivier 'reivilibre'	a7b3ed711c	Fix git links	2022-11-05 14:40:12 +00:00
Olivier 'reivilibre'	d8d6f13f7e	Update the README a little bit	2022-07-02 22:55:18 +01:00
Olivier 'reivilibre'	09f70ad8ce	Link to blog post on home page	2022-07-02 22:53:48 +01:00
Olivier 'reivilibre'	555ad2eab3	Fix typo in tantivy backend query	2022-07-02 22:53:24 +01:00
Olivier 'reivilibre'	dba851879b	Fix qp-index-search looking in wrong place for config	2022-07-02 22:41:47 +01:00
Olivier 'reivilibre'	9dc49f12bd	Add some 'About' info	2022-06-27 22:21:51 +01:00
Olivier 'reivilibre'	545e5dd11f	Fix icon store not being registered	2022-06-27 19:45:50 +01:00
Olivier 'reivilibre'	fda08b20b4	Add context for unreadable rakepacks	2022-06-26 21:32:23 +01:00
Olivier 'reivilibre'	d24083c755	Use amd64 image for mdbook	2022-06-26 20:10:46 +01:00
Olivier 'reivilibre'	7db96bee95	Bump fancy_mdbx to v0.1.1 to fix size limit	2022-06-26 18:40:18 +01:00
Olivier 'reivilibre'	e1dcd73423	Add more context to error messages	2022-06-26 18:02:03 +01:00
Olivier 'reivilibre'	117b608ab0	Use amd64 runners in CI now	2022-06-14 23:45:22 +01:00