Login to the user interface here: https://cloud-manager.cloud2-stg.rezfusion.com/

Resources:

A collection of examples Postman requests to get started is below:

Live/shared Postman environment: https://app.getpostman.com/join-team?invite_code=f051d21c83e9cb1be231988b5439e158&target_code=a2b51a0b8996192acd17798d454cb1c7

Application Flow:

...

Canary Endpoints:

const (
	BlueService          SelectorName = "blue"
	GreenService         SelectorName = "green"
	InitialCanaryService SelectorName = "blue"
)

...

Jobs

• Install - runs wp core install... against the actively provisioning site.

• ActivateTheme - runs wp theme install --activate {theme-name} against the actively provisioning site.

• Ingress - adds an Ingress hosts entry for the given site.

• FlushCaches - runs wp cache flush against the given site.

• PatchIngress - updates an Ingress host entry for a given site. This will point the given site’s ingress handler to the active canary service. Usually used within the context of a promotion.

• PatchService - patches a site’s service value within the sites repository to reflect the active Canary service the site was moved to.

Upgrading a Canary Service/Deployment

Upgrading a deployment/canary service is done by specifying the image hash value and putting it on the canary service. This affects the active canary service. See below for examples.

Update active canary service:

POST /services
{
    "selector": "green"
}

...

If the active service is already the selector given, then a message telling the user is provided:

...

Before:

iiq-wp-platform git:(dev) kc get configmap -n wp-platform -o yaml
apiVersion: v1
items:
- apiVersion: v1
  data:
    canaryEnv: '{"selector":"blue","image":"961406424767.dkr.ecr.us-west-2.amazonaws.com/rezfusion-cloud:dev"}'
  kind: ConfigMap
  ...

...

POST /services
{
  "imageTag": "216c0204fa1e71f93603c0d5087ef16d6b2ba5bce9084874bf9b2aebcddebc77",
  "promote": false, // Denote if this is a promote or upgrade. Promote runs an additional
  // step to PatchIngress.
}

...

➜  iiq-wp-platform git:(dev) kc describe -n wp-platform deployment/green-deployment
Name:                   green-deployment
Namespace:              wp-platform
CreationTimestamp:      Wed, 05 Apr 2023 15:06:04 -0600
Labels:                 app=green
Annotations:            deployment.kubernetes.io/revision: 63
Selector:               app=green
Replicas:               1 desired | 1 updated | 1 total | 1 available | 0 unavailable
StrategyType:           RollingUpdate
MinReadySeconds:        0
RollingUpdateStrategy:  25% max unavailable, 25% max surge
Pod Template:
  Labels:       app=green
  Annotations:  kubectl.kubernetes.io/restartedAt: 2023-04-11T05:00:45-06:00
  Containers:
   web:
    Image:      961406424767.dkr.ecr.us-west-2.amazonaws.com/rezfusion-cloud@sha256:1274e8bc4d963536e88265781170e72a2939caae25127cd9d400ab124393f946

...

Functionality & Examples

Create

Creating a site creates the bare-minimum configuration to represent a site:

POST /sites/create
{
    "id": "rrr",
    "theme": "astra",
    "hostnames": ["rrr.cloud2-stg.rezfusion.com"],
    "service": "blue",
    "name": "Project Bluelaunch | rrr",
    "canonicalHostname": "rrr.cloud2-stg.rezfusion.com"
}

This will create the AWS Dynamo DB entry for the site as well as relevant secrets for accessing the database and WP CMS.

Fetching Site Details

Site details can be viewed by running a GET request against /sites/rrr:

GET /sites/{site-id}

...

Provision

After creating a site, it is able to be provisioned. Provisioning a site means that an actual site instance, along with relevant databases created, S3 bucket subdirectories, etc. for the site to use. This endpoint kicks off the installation of a WP site, a job to add an Ingress entry, and a job to activate the desired theme for a given site.

POST /sites/{site-id}/provision

Assuming all goes well, a site should be visible at the hostname configured during /sites/create within 5-10 minutes.

Image AddedImage Added

rrr-activate-theme-78-wqzk5        0/1     Completed   0          16m
rrr-install-78-zdlsg               0/1     Completed   0          16m

Upgrade

Upgrading a site is the act of moving it from the current service to the active canary service. When a site upgrades the following queued jobs are triggered.

Jobs Executed:

• PatchService - updates the entry in the sites repository so the site.Service value reflects the service a site is moved to/actively on.

• FlushCaches - flushes the caches on the WP site.

PUT /sites/{site-id}/upgrade

Site originally provisioned on blue service. Active Canary service set to green.

...

Image Added

Now, the service on the site is green:

...

A related job to flush the cache is also executed against ttt:

...

Promote

Promoting, almost identical to upgrading, moves a site to the active Canary service. Additionally, this triggers several queued jobs on the given site after moving to the new image.

Jobs executed:

• FlushCaches

• PatchIngress

• PatchService

PUT /sites/{site-id}/promote

Bulk Promotions/Upgrades

To roll an upgrade or promotion out for all sites on a given service, simply execute a PUT request against the /services endpoint. These request types affect all sites on the active canary service. The only differences between the two requests is the promote value. When false, this request triggers a new upgrade pipeline for all sites on the active canary service.

If promote is true, then the promote pipeline is executed against each site on the active canary service. The promote pipeline includes an additional step to patch the ingress.

Upgrade

PUT /services
{
  "imageTag": "f2e9a5d05ef6fe7714962afaa468d643b6c7195656ffc86b15b0435daeef91a4",
  "promote": "false"
}

...

Promote

PUT /services
PUT /services
{
  "imageTag": "f2e9a5d05ef6fe7714962afaa468d643b6c7195656ffc86b15b0435daeef91a4",
  "promote": "true"
}

...

Reverting Bad Deployments/Rollbacks

...

This will delete the relevant AWS Secrets entries, database related to the site, S3 site objects (aka site files) and removes the ingress entry for the site. This removes the site and all related data.

Before:

Create

Creating a site creates the bare-minimum configuration to represent a site:

POST /sites/create
{
    "id": "ggg",
    "hostnames": ["ggg.cloud2-stg.rezfusion.com"],
    "service": "blue",
    "name": "Project Bluelaunch | GGG",
    "canonicalHostname": "ggg.cloud2-stg.rezfusion.com"
}

This will create the AWS Dynamo DB entry for the site as well as relevant secrets for accessing the database and WP CMS.

...

After creating a site, it is able to be provisioned. Provisioning a site means that an actual site instance, along with relevant databases created, S3 bucket subdirectories, etc. for the site to use. This endpoint kicks off the installation of a WP site, a job to add an Ingress entry, and a job to activate the desired theme for a given site.

POST /sites/{site-id}/provision

Assuming all goes well, a site should be visible at the hostname configured during /sites/create within 5-10 minutes.

Misc. Fixes

...

Sent request:

...

After:

AWS Secrets are deleted (with a 7 day recovery period):

...

DB is deleted

...

Ingress entry removed

...

Directory deleted in S3

...

Site is gone

...