Olivier 'reivilibre' e07ac16bc4 Skip raking of weeded URLs ... May be useful for retroactively clearing out URLs		2023-03-31 22:59:23 +01:00
..
bin	Simplify allowed_/weed_domains	2023-03-31 22:50:02 +01:00
raking	Skip raking of weeded URLs	2023-03-31 22:59:23 +01:00
storage	Simplify allowed_/weed_domains	2023-03-31 22:50:02 +01:00
config.rs	Add configurable re-rake times for different kinds of raked things	2022-11-26 19:05:36 +00:00
lib.rs	Emit rakepacks from the raker	2022-03-21 19:07:35 +00:00
rakepack_emitter.rs	Maintain an index file of rakepacks and append when a rakepack is finished	2022-11-26 20:07:12 +00:00
raking.rs	Respect nofollow and noindex <meta> robots tags	2023-03-30 23:09:39 +01:00
storage.rs	Skip raking of weeded URLs	2023-03-31 22:59:23 +01:00
test.rs	Rearrange quickpeep crates	2022-03-14 23:36:37 +00:00