Skip to content

ayakashi

195 1 8 AGPL-3.0-only
1.0.0-beta8.4 (29 Jun 2023) Apr 18 2019 68 (month)

Ayakashi is a web scraping library for Node.js that allows developers to easily extract structured data from websites. It is built on top of the popular "puppeteer" library and provides a simple and intuitive API for defining and querying the structure of a website.

Features:

  • Powerful querying and data models
    Ayakashi's way of finding things in the page and using them is done with props and domQL. Directly inspired by the relational database world (and SQL), domQL makes DOM access easy and readable no matter how obscure the page's structure is. Props are the way to package domQL expressions as re-usable structures which can then be passed around to actions or to be used as models for data extraction.
  • High level builtin actions
    Ready made actions so you can focus on what matters. Easily handle infinite scrolling, single page navigation, events and more. Plus, you can always build your own actions, either from scratch or by composing other actions.
  • Preload code on pages
    Need to include a bunch of code, a library you made or a 3rd party module and make it available on a page? Preloaders have you covered.

Example Use


const ayakashi = require("ayakashi");
const myAyakashi = ayakashi.init();

// navigate the browser
await myAyakashi.goTo("https://example.com/product");

// parsing HTML
// first by defnining a selector
myAyakashi
    .select("productList")
    .where({class: {eq: "product-item"}});

// then executing selector on current HTML:
const productList = await myAyakashi.extract("productList");
console.log(productList);

Alternatives / Similar


86,589 22.6.3 (20 hours ago) Mar 23 2013 compare
6,609 1.5.0 (3 months ago) Sep 10 2012 compare

Other Languages

22,036 v2.1.0 (3 years ago) May 14 2018 compare
7,526 v1.3.4 (4 years ago) Feb 15 2020 compare
2,470 2024-04-04 (a day ago) Jun 06 2019 compare
641 2024-04-04 (a day ago) Feb 09 2017 compare
50,703 2.11.1 (a month ago) Jul 26 2019 compare
1,455 1.0.4 (1 year, 7 months ago) Nov 22 2014 compare
2,833 1.4.3 (6 months ago) Sep 04 2013 compare
2,025 (2 years ago) Nov 20 2016 compare
5,606 v0.18.0 (1 year, 9 days ago) Aug 06 2019 compare
2,878 v2.1.1 (4 months ago) Jul 17 2018 compare
5,894 1.1.14 (1 year, 8 months ago) Jul 26 2019 compare
2,983 1.5.0 (a month ago) Sep 30 2018 compare
1,300 3.0.0 (1 year, 7 months ago) Dec 27 2011 compare
791 0.7.1 (2 months ago) Jul 25 2009 compare
153 2.2.4 (3 years ago) Dec 22 2019 compare
235 1.33.0 (a month ago) Feb 05 2023 compare
3,199 0.9.13 (8 months ago) Jul 04 2017 compare
1,731 0.8.5 (1 year, 6 months ago) Oct 17 2018 compare
10,458 1.1.9 (5 years ago) Aug 24 2018 compare
1,315 v3.2.0 (2 days ago) Dec 27 2021 compare
491 2.0.0 (9 months ago) May 04 2020 compare
1,320 v0.7.2 (3 months ago) Mar 16 2013 compare
411 0.1.3 (8 months ago) Feb 20 2022 compare
298 v1.7.2 (17 days ago) Apr 18 2022 compare