81 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
husky	74c65d993d	timeout if crawling takes too long ... default is 5 minutes before the task gets killed, in the future we should probably have a more graceful shutdown method	2025-03-16 16:07:47 -07:00
husky	9237d1a048	Merge pull request 'bring latest develop changes into vorebot-tweaks' (#6) from develop into feature/nikocs/vorebot-tweaks ... Reviewed-on: #6	2025-03-16 15:50:02 -07:00
husky	4be68e4ba1	Merge pull request 'store crawler link relations' (#5) from feature/nikocs/vorebot-store-link-relations into develop ... Reviewed-on: #5	2025-03-16 15:49:22 -07:00
husky	2463986e8d	await ack	2025-03-14 18:49:27 -07:00
husky	38ef5a45f6	use suggested route	2025-03-14 18:38:43 -07:00
husky	0f6f0deb9c	linkrelstore + site suggestion cli ... logs href relations in database, allowing for pagerank calculation in the future. sites can now be added to the queue by running ./vorebot <url> [damping] default damping is 0.45 for suggested sites	2025-03-14 18:20:15 -07:00
husky	9c159c7170	Merge pull request 'bring over latest vorebot tweaks' (#4) from feature/nikocs/vorebot-tweaks into develop ... Reviewed-on: #4	2025-03-14 18:03:28 -07:00
husky	d341c66390	prioritize english	2025-03-14 14:29:46 -07:00
husky	c754338bf4	favor newer hostnames	2025-03-14 12:13:45 -07:00
husky	56d07057c9	Merge pull request 'proper proxy support for vorebot' (#3) from feature/nikocs/vorebot-proxy into develop ... Reviewed-on: #3	2025-03-14 12:12:16 -07:00
husky	384464bdbc	preemptive fix	2025-03-13 19:45:46 -07:00
husky	d45f13f030	add proxy support to vorebot	2025-03-13 19:23:59 -07:00
husky	927ce9d3ed	Merge pull request 'add password support to vorebot' (#2) from feature/nikocs/nats-password-auth into develop ... Reviewed-on: #2	2025-03-13 19:21:39 -07:00
husky	17054c0a9c	add password support to vorebot	2025-03-13 19:10:55 -07:00
husky	b6f5ae177a	Merge pull request 'CI' (#1) from feature/nikocs/ci into develop ... Reviewed-on: #1	2025-03-12 21:23:45 -07:00
husky	83053c57a8	remove searchservice from workspace (old)	2025-03-12 21:12:06 -07:00
husky	1ad6dad9eb	fix foundationdb dependency	2025-03-12 21:09:35 -07:00
husky	7de4cdc0d6	install clang	2025-03-12 21:00:34 -07:00
husky	ce60a00868	oops	2025-03-12 20:57:28 -07:00
husky	9f87a327e0	please	2025-03-12 20:57:00 -07:00
husky	f3ee26f24b	nodejs, not node	2025-03-12 20:56:32 -07:00
husky	d6509cccbe	changes in order for container to work	2025-03-12 20:56:09 -07:00
husky	1dc0a399a0	change to v3	2025-03-12 20:52:56 -07:00
husky	30b3c2352e	rearrange some stuff	2025-03-12 20:50:59 -07:00
husky	949a49e5de	nvm	2025-03-12 20:49:01 -07:00
husky	a0b31d3326	change image to docker.io	2025-03-12 20:48:33 -07:00
husky	a16782617a	change image	2025-03-12 20:48:05 -07:00
husky	73463a8d21	initial CI impl	2025-03-12 15:21:58 -07:00
husky	906c2ed8df	bring over new crawler and lyphedb	2025-03-12 12:52:24 -07:00
husky	b1202cc889	bring over changes from develop repos	2025-03-12 12:36:37 -07:00
husky	37660d826a	move everything to mono repo	2025-03-12 12:32:15 -07:00