This is a "template" repository that you can use to run multiple instances with unique fingerprints using the puppeteer-with-fingerprints library in conjunction with puppeteer-cluster. For more details, check out their repositories, and most importantly, support them.
First, clone the repository:
git clone https://github.com/silvestrodecaro/puppeteer-cluster-with-fingerprints.git
cd puppeteer-cluster-with-fingerprintsThen install the dependencies:
npm install puppeteer puppeteer-with-fingerprints puppeteer-clusterHere's an example of how to use the script:
const { plugin } = require("puppeteer-with-fingerprints");
const { Cluster } = require('puppeteer-cluster');
(async () => {
// Get a fingerprint from the server:
const fingerprint = await plugin.fetch('', {
tags: ['Microsoft Windows', 'Chrome'],
});
// Apply fingerprint:
plugin.useFingerprint(fingerprint);
const cluster = await Cluster.launch({
puppeteer: plugin,
concurrency: Cluster.CONCURRENCY_CONTEXT,
maxConcurrency: 2,
puppeteerOptions: {
headless: false,
},
});
await cluster.task(async ({ page, data: url }) => {
await page.goto(url);
await page.screenshot({ path: `${ await page.title() }.png`});
// Store screenshot, do something else
});
cluster.queue('http://www.google.com/');
cluster.queue('http://www.wikipedia.org/');
// many more pages
await cluster.idle();
await cluster.close();
})();This project relies on the 'puppeteer-with-fingerprints' and 'puppeteer-cluster' libraries, which in turn depend on Puppeteer Framework. As Puppeteer is constantly being updated, there may be issues with regressions and compatibility. It is recommended to frequently check for updates and test your implementation to ensure continued functionality.
This project is licensed under the MIT License.