@[email protected] - selenium sucks, headless scraping is much more efficient. selenium is usually only used to bypass some js antibot (e.g. cloudflare uam or captchas) - you don't. you scrape in a separate process and store everything locally, and serve the users from the local db