Hi, Myself Rocktim Saikia. And today I want to showcase a simple project that I have been working on for couple of days now.
meta-fetcher 🔎
meta-fecther is simple and tiny url meta-data fetcher for Nodejs. Under the hood this module uses node-fetch to fetch the meta tags of given website url and returns the parsed meta-data as a JSON
object.
rocktimsaikia / meta-fetcher
Simple metadata scrapper for node.js
meta-fetcher
Simple metadata scrapper.
Installation
yarn add meta-fetcher
Usage
import metaFetcher from 'meta-fetcher';
const result = await metaFetcher('https://hoppscotch.io/');
console.log(result);
Output:
{
"title": "Hoppscotch - Open source API development ecosystem",
"description": "Helps you create requests faster, saving precious time on development.",
"image": "https://hoppscotch.io/og.png",
"url": "https://hoppscotch.io/",
"siteName": "Hoppscotch",
"type": "website"
}
API
metaFetcher(input)
Takes one url string as a parameter and returns an object containing the meta-information.
input
type: string
default: 'none'
The url string to be scrapped.
Related
page-scrapper: Node.js scrapper that pulls out all links and images of a given site.
License
2024 MIT © Rocktim Saikia
Install
npm install meta-fetcher
Basic Usage
const {fetchMetaData} = require('meta-fetcher');
(async () => {
const result = await fetchMetaData('https://hoppscotch.io/');
console.log(result);
/*
{
basic_metadata: {
website: 'https://hoppscotch.io/',
title: 'Hoppscotch • A free, fast and beautiful API request builder',
description: 'A free, fast and beautiful API request builder'
},
opengraph: {
'og:image': 'https://hoppscotch.io/banner.jpg',
'og:type': 'website',
'og:title': 'Hoppscotch',
'og:site_name': 'Hoppscotch',
'og:description': 'A free, fast and beautiful API request builder',
'og:url': 'https://hoppscotch.io/'
},
opengraph_social: {
'twitter:card': 'summary_large_image',
'twitter:site': '@liyasthomas',
'twitter:creator': '@liyasthomas'
},
favicons: [
'https://hoppscotch.io/icon.png',
'https://hoppscotch.io/icon.png',
'https://hoppscotch.io/_nuxt/icons/icon_64x64.9834b3.png'
]
}
*/
})();
It can also fetch meta-data from shortened-url
.
For example:
const {fetchMetaData} = require('meta-fetcher');
(async () => {
const result = await fetchMetaData('https://bit.ly/2Fj9sNF');
console.log(result);
})();
There a few advanced options that you can use before fetching. You can check them in the readme.md
section.
If you like the project. Do leave a star at repo 🌟
Top comments (4)
Best metadata fetching tools i came across: bit.ly/3sQHiwg
I really like the idea of your website. I have noticed that you used netlify function. Would you mind sharing us what did you use to fetch metadata on your website?
Thanks for sharing. Starred. I may need it later.
Sure 😊 . Glad you liked it