Remilia is a high-performance web scraping framework designed for efficiency. It enables users to concentrate on extracting and utilizing web content, delegating the complexity of web scraping processes to the framework.
- Clean API & elegant mental model
- Concurrency supporting
- Configurable backoff retry algorithm
- Pre-request & post-response hooks supporting
titleParser := func(in *goquery.Document, put remilia.Put[string]) {
in.Find("h1").Each(func(i int, s *goquery.Selection) {
fmt.Println(s.Text())
})
}
rem, _ := remilia.New()
err := rem.Do(
rem.Just("https://go.dev/"),
rem.Unit(titleParser),
)
if err != nil {
fmt.Println("Error: ", err)
}
go get -u github.com/ShroXd/remilia
This project is licensed under the MIT License. See the LICENSE file for details.