Restart Pm2 Process Every Day Using A Node Script

A brute force yet effective way to restart scripts that need it

  Last Updated July 23, 2021  |  3 minutes  |  624 words  |  Talha Awan

To run NodeJS scripts and apps constantly, we usually use pm2 (some prefer forever). However, some scripts require a brute force restart from time to time as they do not fare better in uninterrupted longer runs. Mostly, the reason is memory leaks of packages you are bound to use but have no control over. [Read More]
nodejs  pm2  script 

Trace Redirect Urls NPM Request

  Last Updated July 23, 2021  |  2 minutes  |  229 words  |  Talha Awan

With NPM request module it is quite easy to observe and trace all the intermediate urls before the final url is reached. We can do that using followRedirect option, which takes either true or false, or a function that should return a boolean value. [Read More]
nodejs  request  script 

Clean Up MongoDB Of Old Inactive Users And Their Data With Node Js Script

Reduce Expensive Database Space By Pruning Never-To-Be-Used-Again Data

  Last Updated July 10, 2021  |  3 minutes  |  509 words  |  Talha Awan

Databases are not cheap, especially when your application is just taking off and you are low on budget. It is then that freeing up retrievable and precious space from the database is a good way to save some dollars for a while. [Read More]
nodejs  mongodb  mongoose  script 

Build Queue For Processing Webhooks With Node Js And MongoDB

Manage The Flood Of Webhooks With A Database Queue

  Last Updated July 23, 2021  |  4 minutes  |  831 words  |  Talha Awan

Many of the third party services we integrate in our applications use webhooks to communicate events to us. Responding to the incoming webhook with success response (status 200) is all that is required to acknowledge the receipt of the webhook. To process that webhook immediately upon receiving or entering it in a queue to be processed later is up to you.

[Read More]
nodejs  mongodb  script 

Intercept Node JS Console Log and Insert in MongoDB

Easily Manageable and Searchable Application Logs Stored in Database.

  Last Updated September 8, 2022  |  4 minutes  |  838 words  |  Talha Awan

Your node js application is running on production, leaving hard-to-search ever-increasing log files in its wake. You want all your logs in a centralized, easily searchable place. For that, you have two options: 1 - Buy a subscription to some cloud log management service, such as papertrail. [Read More]
nodejs  mongodb  script 

Scrape Website Data Without Headless Browser, Using Node Js

Not Every Website Scraping Needs Headless Browsers; Request And Cheerio Js Do Just Fine

  Last Updated July 23, 2021  |  5 minutes  |  885 words  |  Talha Awan

During the course of web development, we occasionally need to scrape a website. Not just one page but many. On such requirement, mostly because the host site does not allow otherwise, we naturally tend to favor the use of headless browsers such as phantomjs or casperjs. [Read More]
nodejs  scraping  request  cheerio  script 

Export MongoDB Collection Data In CSV From Node Express Mongoose Application

  Last Updated August 4, 2021  |  2 minutes  |  371 words  |  Talha Awan

Suppose a student collection in mongoDB have some data that we want to export in a CSV file from a Mongoose, Node, and Express app. For simplicity, let us assume only two fields in Mongoose schema: lastName and firstName. To export a CSV file, install moment, json2csv, and mongo-date-query (optional) npm packages: [Read More]
nodejs  expressjs  mongodb  mongoose  csv 

Integrate Polling Based API In Node/Express Js

  Last Updated July 10, 2021  |  5 minutes  |  1050 words  |  Talha Awan

At times we need to integrate in our Node/Express application third party APIs that have implemented polling mechanism i.e. they only send back results once available; the client must keep on attempting until the service has put together all the results to return. [Read More]
nodejs  expressjs  polling 
When you purchase through links on techighness.com, I may earn an affiliate commission.