Merge pull request #58 from woocommerce/25-02/add/extension-sets

Basic docs on extension sets.

Author: singerb

docs/managed-tests/activation.md

@@ -80,6 +80,10 @@ Replace `your-extension` with the slug of your plugin.
 
 Some plugins might need an actual live site URL to work properly, such as payment gateways and SaaS. For those, you can use our [built-in tunnel feature](../environment/tunnel.md) to test these plugins.
 
+## Canonical compatibility check in the WooCommerce Marketplace
+
+The WooCommerce Marketplace will automatically run an activation test using the [`compatibility` extension set](extension-sets) upon new submission or update. You will see the results in the list of tests under `Activation (canonical compatibility check)`. Currently this test is informational only, and will not block a submission or an update.
+
 ## What to do if it fails
 
 If your Activation test fails:

docs/managed-tests/extension-sets.md

@@ -0,0 +1,33 @@
+# Extension sets
+
+Extension sets provide a way to run certain managed test types with a predefined set of other extensions included in the environment. This allows for standardized compatibility testing, as well as testing in environments closer to a production WooCommerce store.
+
+## Compatible test types
+
+Extension sets can be utilized with [Woo E2E](woo-e2e), [Woo API](woo-api), and [Activation](activation) tests currently.
+
+## Available extension sets
+
+`compatibility` is the only extension set available in production right now. It's designed to contain a selection of typical WooCommerce extensions, including many official extensions:
+- [Gift Cards](https://woocommerce.com/products/gift-cards/)
+- [WooCommerce Product Add-Ons](https://woocommerce.com/products/product-add-ons/)
+- [WooCommerce Min/Max Quantities](https://woocommerce.com/products/min-max-quantities/)
+- [WooCommerce Product Bundles](https://woocommerce.com/products/product-bundles/)
+- [WooCommerce Product Recommendations](https://woocommerce.com/products/product-recommendations/)
+- [WooCommerce Payments](https://woocommerce.com/products/woocommerce-payments/)
+- [AutomateWoo](https://woocommerce.com/products/automatewoo/)
+- [WooCommerce Shipping](https://woocommerce.com/products/shipping/)
+- [WooCommerce Subscriptions](https://woocommerce.com/products/woocommerce-subscriptions/)
+- [WooCommerce Composite Products](https://woocommerce.com/products/composite-products/)
+- [WooCommerce Tax](https://woocommerce.com/products/tax/)
+- [WooCommerce Google Analytics Integration](https://wordpress.org/plugins/woocommerce-google-analytics-integration/)
+- [MailPoet](https://wordpress.org/plugins/mailpoet/)
+- [Jetpack](https://wordpress.org/plugins/jetpack/)
+
+## Running tests with an extension set
+
+All test types that support extension sets support an `--extension_set` argument to the QIT CLI to specify a set to include.
+
+## The WooCommerce Marketplace and extension sets
+
+Currently the WooCommerce Marketplace will automatically run an Activation test using the `compatibility` extension set upon new submission or update. You will see the results in the list of tests under `Activation (canonical compatibility check)`. Currently this test is informational only, and will not block a submission or an update.

docs/support/test-options.md

@@ -12,6 +12,7 @@ When running tests with QIT, you can specify various options—like WordPress, W
 | PHP Version                  | ✅         | ✅       | ✅       | ❌       | ❌      | ❌         | ❌           |
 | Additional Extensions        | ✅         | ✅       | ✅       | ❌       | ❌      | ❌         | ❌           |
 | Additional WordPress Plugins | ✅         | ✅       | ✅       | ❌       | ❌      | ❌         | ❌           |
+| [Extension sets](../managed-tests/extension-sets) | ✅         | ✅       | ✅       | ❌       | ❌      | ❌         | ❌           |
 
 **Key:**
 - ✅: Option supported by that test type.
@@ -55,6 +56,13 @@ qit run:activation my-extension --plugin=woocommerce --plugin=my-other-plugin
 
 This ensures compatibility and stable interactions within a controlled environment.
 
+## Extension sets
+
+```qitbash
+qit run:woo-api my-extension --extension_set=compatibility
+```
+Extension sets provide a way to run certain managed test types with a predefined set of other extensions included in the environment. For more information see [their documentation page](../managed-tests/extension-sets).
+
 ## Configuring test options in config files
 
 Instead of passing flags every time, define options in `qit.yml` or `qit.json`:

sidebars.js

@@ -54,6 +54,7 @@ const sidebars = {
                 'managed-tests/malware',
                 'managed-tests/validation',
                 'managed-tests/plugin-check',
+                'managed-tests/extension-sets',
             ],
         },
         {
@@ -121,4 +122,4 @@ const sidebars = {
     ],
 };
 
-export default sidebars;
+export default sidebars;