Added: fetching polish articles

This commit is contained in:
Oliwier Adamczyk
2025-10-04 18:19:02 +02:00
parent fdd1c98e75
commit f542f01b49
11 changed files with 309 additions and 4 deletions

23
go.mod
View File

@@ -2,4 +2,25 @@ module scrap
go 1.24.4
require github.com/mattn/go-sqlite3 v1.14.32
require (
github.com/gocolly/colly v1.2.0
github.com/mattn/go-sqlite3 v1.14.32
)
require (
github.com/PuerkitoBio/goquery v1.10.3 // indirect
github.com/andybalholm/cascadia v1.3.3 // indirect
github.com/antchfx/htmlquery v1.3.4 // indirect
github.com/antchfx/xmlquery v1.4.4 // indirect
github.com/antchfx/xpath v1.3.5 // indirect
github.com/gobwas/glob v0.2.3 // indirect
github.com/golang/groupcache v0.0.0-20241129210726-2c02b8208cf8 // indirect
github.com/golang/protobuf v1.5.4 // indirect
github.com/kennygrant/sanitize v1.2.4 // indirect
github.com/saintfish/chardet v0.0.0-20230101081208-5e3ef4b5456d // indirect
github.com/temoto/robotstxt v1.1.2 // indirect
golang.org/x/net v0.44.0 // indirect
golang.org/x/text v0.29.0 // indirect
google.golang.org/appengine v1.6.8 // indirect
google.golang.org/protobuf v1.36.10 // indirect
)