Search Engine Visibility robots meta vs Per-Product Visibility for pre-launch catalog control

Answer the question first

For a WooCommerce shop that must stay invisible to search engines during pre‑launch but still allow internal reviewers to hit product URLs, the safest combination is:

• Enable Search Engine Visibility (Settings > Reading) and make sure the noindex, nofollow meta tag is output on every front‑end page.
• Set every product’s Visibility to Hidden (Catalog & Search). Direct URLs will still return a 200 OK with the product page, but the product will not appear in shop archives or search results.
• Verify that no SEO plugin is overriding the core noindex tag. If an SEO plugin is active, enable its “Discourage search engines” or equivalent setting.
• Optionally, protect the entire site with a simple password (e.g., a .htpasswd file or a “Coming Soon” plugin) to guarantee that crawlers and unauthenticated REST API requests cannot access the content.

Why this works

The core noindex tag is a hint to compliant crawlers; it does not prevent a crawler from fetching the page, but most major search engines respect it. WooCommerce’s Hidden visibility keeps the product out of catalog and search listings while still serving the page at its permalink. Together they give you a two‑layer protection: a site‑wide noindex for crawlers and per‑product visibility to keep the catalog hidden from public search results.

Potential pitfalls

• SEO plugins (Yoast, Rank Math, SEOPress, etc.) filter wp_robots and can override the core tag. Verify that the plugin’s noindex setting is enabled.
• REST API endpoints (/wp-json/wp/v2/products) are publicly accessible for published products regardless of catalog visibility. If you need to restrict API access, add a filter or require authentication.
• Cache plugins may serve stale pages that omit the noindex meta. Clear all caches after changing the setting.
• Search engines may still crawl the URLs until they re‑index the site. Use Google Search Console to confirm the noindex status with the URL Inspection tool.

Steps for this case

1. Check for SEO plugins. If one is active, enable its site‑wide noindex option.
2. Activate Search Engine Visibility. Go to Settings > Reading and check Discourage search engines from indexing this site.
3. Set product visibility to Hidden. In the product editor, under Catalog visibility, choose Hidden.
4. Clear caches. Flush any page‑cache, CDN cache, and browser cache.
5. Verify robots meta. View source of a product page; confirm <meta name="robots" content="noindex, nofollow"> is present.
6. Test REST API. Run curl -I https://example.com/wp-json/wp/v2/products?per_page=5 and check that hidden products do not appear unless you add authentication.
7. Use Search Console. Submit a URL for inspection and confirm that the page is marked noindex.

What to ask next

To fine‑tune the recommendation, I need to know which SEO plugin (if any) is currently managing robots output on your site. This will determine whether the core noindex tag is reliable or if you must rely on the plugin’s settings.