blahaj-funkers/scrap
4
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Added: downloading and returning wikipedia articles

Browse Source
This commit is contained in:
Oliwier Adamczyk
2025-10-04 23:14:41 +02:00
parent f542f01b49
commit 6df63dc4c1
26 changed files with 636 additions and 100 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
go.mod
View File

@@ -3,6 +3,7 @@ module scrap
go 1.24.4
require (
github.com/go-chi/chi v1.5.5
github.com/gocolly/colly v1.2.0
github.com/mattn/go-sqlite3 v1.14.32
)
@@ -16,6 +17,7 @@ require (
github.com/gobwas/glob v0.2.3 // indirect
github.com/golang/groupcache v0.0.0-20241129210726-2c02b8208cf8 // indirect
github.com/golang/protobuf v1.5.4 // indirect
github.com/google/uuid v1.6.0
github.com/kennygrant/sanitize v1.2.4 // indirect
github.com/saintfish/chardet v0.0.0-20230101081208-5e3ef4b5456d // indirect
github.com/temoto/robotstxt v1.1.2 // indirect