Boost your site speed with the LiteSpeed Cache Crawler. Learn how it works, how to set it up, and how to keep your pages cached and fast for every visitor. Our Live Support Team is always here to help you.
If your website feels slow at random times, especially for new visitors, you’re not alone. Many site owners struggle with pages loading uncached. That’s exactly where the LiteSpeed Cache Crawler steps in. It keeps your pages warmed up, refreshed, and ready before anyone even clicks on them. As a result, your visitors get instant load times instead of waiting for the server to “wake up.”
This guide walks you through how the crawler works, how to enable it, and how to configure it properly. And unlike the usual generic tutorials, this one sticks to real steps, real settings, and real outcomes.
What the LiteSpeed Cache Crawler Actually Does
Most people think caching is automatic. However, without a crawler, your pages get cached only when someone visits them. So the first visitor gets a slow load. After that, it speeds up. But that isn’t ideal for user experience.
Here’s where the LiteSpeed Cache Crawler helps. It goes through your site on its own, updates your cached pages, and ensures your visitors never hit uncached content. In short, it keeps things warm in the background.
Steps
Install the LiteSpeed Cache Plugin
First, log in to your WordPress dashboard. Then go to:
Plugins → Add New → Search “LiteSpeed Cache” → Install Now → Activate
Without this plugin, the crawler won’t exist. So make sure it’s active.
Turn On the LiteSpeed Cache Crawler
Head over to:
LiteSpeed Cache → Crawler
On the right, turn the Activate switch ON.
This instantly enables the crawler system on your site.
Enable the Crawler Cron
Next, open the General Settings tab.
Right at the top, you’ll see the Crawler Cron switch. Turn it ON.
This allows WordPress to run the crawler automatically.
Add and Load Your Sitemap
Your crawler needs to know which pages exist. That’s where the sitemap comes in.
Go to Crawler → Sitemap Settings, paste your sitemap URL, and click Save.
Then open the Map tab and click Refresh Crawler Map.
You’ll see the sitemap load with a list of pages if it’s valid.
Configure the Actual Crawler Settings
This part matters the most. Wrong values can slow down your server. Use these as your starting point:
- Run Duration: 300 seconds
- Interval Between Runs: 300 seconds
- Server Load Limit: 3
These settings give the crawler enough time to work without eating server resources. Of course, you can tweak them later.
Keep Every Page Loading Fast
Monitor the Crawler
Go to the Summary tab and click:
[R] Manually run
This helps you validate that everything is working.
Server-Level Crawler Activation (Very Important)
If you want the crawler enabled server-wide or per vhost, add this code:
<IfModule Litespeed>
CacheEngine on crawler
</IfModule>Server-Wide:
/etc/apache2/conf.d/includes/pre_main_global.conf
Per vhost (HTTP):
/etc/apache2/conf.d/userdata/std/2_4/<user>/<domain>/
Per vhost (HTTPS):
/etc/apache2/conf.d/userdata/ssl/2_4/<user>/<domain>/
This step ensures full crawler support on your hosting environment.
Conclusion
Using the LiteSpeed Cache Crawler (that’s 5 times the keyword) isn’t just about speed. It’s about giving every visitor the fastest version of your site, every single time. Set it once, monitor it, and let it do the heavy lifting.
