rancher-partner-charts/README.md

315 lines
14 KiB
Markdown
Raw Normal View History

2020-10-16 23:54:42 +00:00
# partner-charts
2020-06-30 18:08:43 +00:00
2020-10-16 23:54:42 +00:00
This repository is reserved for partner charts in the Rancher's v2.5+ catalog. As part of this catalog,
all charts will benefit of a cloud native packaging system that directly references an upstream chart
from a Helm repository and automates applying Rancher specific modifications and adding overlay
2020-10-16 23:54:42 +00:00
files on top of it.
2020-06-30 18:08:43 +00:00
2020-10-16 23:54:42 +00:00
## Requirements
2020-06-30 18:08:43 +00:00
2020-10-16 23:54:42 +00:00
* Chart must be Helm 3 compatible.
2020-06-30 18:08:43 +00:00
2021-06-25 19:05:01 +00:00
Helm 2 installed CRDs via an `helm.sh/hook: crd-install` annotation that installed
CRDs via a special hook. In Helm 3, this annotation was removed in favor of a `crds/`
directory where your CRDs should now reside. Templating and upgrading CRDs is also no
longer supported by default. Users who need to support templating / upgrading CRDs should
use a separate CRD chart that installs the CRDs via the `templates/` directory instead.
Leaving this hook in your chart will not cause it to break, but will cause the Helm logs
to emit the warning `manifest_sorter.go:175: info: skipping unknown hook: "crd-install"`
on an install or upgrade.
2020-06-30 18:08:43 +00:00
2021-06-25 19:05:01 +00:00
In addition, starting [Helm 3.5.2](https://github.com/helm/helm/releases/tag/v3.5.2), Helm is stricter about parsing semver strings. Therefore, to ensure that your chart is deployable via Helm 3.5.2, your chart must have a semver-compliant version.
2020-10-16 23:54:42 +00:00
More information:
* Supported Hooks: https://helm.sh/docs/topics/charts_hooks/
* Helm 2 to 3 migration: https://helm.sh/docs/topics/v2_v3_migration/
* Managing CRDs and best practices: https://helm.sh/docs/chart_best_practices/custom_resource_definitions/
* Semver Rules: https://semver.org/
2020-06-30 18:08:43 +00:00
* Chart must be in a hosted [Helm](https://helm.sh/docs/topics/chart_repository/) (recommended) or Git repository that we can reference.
2020-06-30 18:08:43 +00:00
2020-10-16 23:54:42 +00:00
* Chart must have the following Rancher specific add-ons (More details on this below).
2021-06-25 19:05:01 +00:00
* kubeVersion set in the chart's metadata
2020-10-16 23:54:42 +00:00
* app-readme.md
* questions.yml (Optional)
2020-06-30 18:08:43 +00:00
2020-10-16 23:54:42 +00:00
## Workflow
2020-06-30 18:08:43 +00:00
#### 1. Fork the [Rancher Partner Charts](https://github.com/rancher/partner-charts/) repository, clone your fork, checkout the **main-source** branch and pull the latest changes.
Then create a new branch off of main-source
2023-01-13 15:08:32 +00:00
#### 2. Create subdirectories in **packages** in the form of `<vendor>/<chart>`
2022-12-02 08:05:41 +00:00
```bash
cd partner-charts
mkdir -p packages/suse/kubewarden-controller
2020-06-30 18:08:43 +00:00
2022-12-02 08:05:41 +00:00
```
#### 3. Create your [upstream.yaml](#configuration-file) in `packages/<vendor>/<chart>`
The tool reads a configuration yaml, `upstream.yaml`, to know where to fetch the upstream chart. This file is also able to define any alterations for valid variables in the Chart.yaml as described by [Helm](https://helm.sh/docs/topics/charts/#the-chartyaml-file).
**Important:** In GKE clusters, a Helm Chart will NOT display in Rancher Apps unless `kubeVersion` includes `-0` suffix in `Chart.yaml` For example:
```bash
kubeVersion: '>= 1.19.0-0'
```
Some [example upstream.yaml](#examples) are provided below
```bash
2022-12-02 08:05:41 +00:00
cat <<EOF > packages/suse/kubewarden-controller/upstream.yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
2022-12-02 08:05:41 +00:00
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
EOF
2020-10-16 23:54:42 +00:00
```
2023-01-13 15:08:32 +00:00
#### 4. [Create 'overlay' files](#overlay)
Create any add-on files such as an `app-readme.md` and `questions.yml` in an `overlay` subdirectory (Optional)
2022-12-02 08:05:41 +00:00
```bash
mkdir packages/suse/kubewarden-controller/overlay
echo "Example app-readme.md" > packages/suse/kubewarden-controller/overlay/app-readme.md
```
2023-01-13 15:08:32 +00:00
#### 5. Commit your packages directory
2022-12-02 08:05:41 +00:00
```bash
git add packages/suse/kubewarden-controller
git commit -m "Submitting suse/kubewarden-controller"
```
2023-01-13 15:08:32 +00:00
#### 6. [Test your configuration](#testing-your-configuration)
#### 7. Push your commit
2022-12-02 08:05:41 +00:00
```bash
git push origin <your_branch>
2020-10-16 23:54:42 +00:00
```
2023-01-13 15:08:32 +00:00
#### 8. Open a pull request to **main-source** branch
2022-12-02 08:05:41 +00:00
## Testing your configuration
If you would like to test your configuration using the CI tool, simply run the provided script in `scripts/pull-ci-scripts` to download the binary. The 'auto' function is what will be run to download and store your chart.
2021-07-27 19:55:10 +00:00
2022-12-02 08:16:19 +00:00
#### 1. Download the binary
2022-12-02 08:05:41 +00:00
```bash
scripts/pull-ci-scripts
```
2022-12-02 08:16:19 +00:00
#### 2. Set the **PACKAGE** environment variable to your chart
2022-12-02 08:05:41 +00:00
You can confirm the package entry with `bin/partner-charts-ci list` which will list all detected charts with a configuration file.
```bash
export PACKAGE=<vendor>/<chart>
```
2022-12-02 08:16:19 +00:00
#### 3. Run the 'auto' or 'stage' function
2022-12-02 08:05:41 +00:00
The 'auto' subcommand will run the complete CI process.
The 'stage' subcommand will do the same process but will not create a git commit when it completes.
```bash
bin/partner-charts-ci auto
```
2022-12-02 08:16:19 +00:00
#### 4. Validate your changes
2022-12-02 08:05:41 +00:00
```bash
bin/partner-charts-ci validate
```
#### Testing new chart on Rancher Apps UI
1. If you haven't done so yet, pull down your new chart files into your local `partner-charts` repository:
```bash
2023-01-30 21:38:35 +00:00
a) Get scripts: scripts/pull-ci-scripts
b) List and find your company name/chart: bin/partner-charts-ci list | grep <vendor>
c) set PACKAGE variable to your company/chart: export PACKAGE=<vendor>/<chart-name> or export PACKAGE=<vendor>
d) Run bin/partner-charts-ci stage or auto # the new charts should be downloaded
```
2023-01-30 21:38:35 +00:00
2. In your local `partner-charts` directory start a python3 http server:
```bash
#python3 -m http.server 8000
```
3. From a second terminal expose your local http server via ngrok ( https://ngrok.com/download )
```bash
#./ngrok http 8000
```
2023-01-30 22:00:58 +00:00
4. In Rancher UI create a test repository that points to your local `partner-charts` repo by selecting an appropriate cluster and going to Apps > Repositories and clicking "Create". Enter a Name, copy ngrok forwarding url and paste it into Target http(s) "Index URL" and click "Create" again.
2023-01-30 21:38:35 +00:00
5. Once the new repository is "Active" go to Apps > Charts , find your new chart, review Readme is correct, etc. and install it. It should be successfully deployed.
2021-07-27 19:55:10 +00:00
2022-12-02 08:05:41 +00:00
## Overlay
2021-07-27 19:55:10 +00:00
Any files placed in the `packages/<vendor>/<chart>/overlay` directory will be overlayed onto the chart. This allows for adding or overwriting files within the chart as needed. The primary intended purpose is for adding the optional app-readme.md and questions.yml files but it may be used for adding or replacing any chart files.
2020-10-16 23:54:42 +00:00
- `app-readme.md` - Write a brief description of the app and how to use it. It's recommended to keep
it short as the longer `README.md` in your chart will be displayed in the UI as detailed description.
- `questions.yml` - Defines a set of questions to display in the chart's installation page in order for users to
2021-06-25 19:05:01 +00:00
answer them and configure the chart using the UI instead of modifying the chart's values file directly.
2021-07-27 19:55:10 +00:00
#### Questions example
2022-12-02 08:05:41 +00:00
[Variable Reference](https://docs.ranchermanager.rancher.io/how-to-guides/new-user-guides/helm-charts-in-rancher/create-apps#question-variable-reference)
2020-10-16 23:54:42 +00:00
```yaml
2021-06-25 19:05:01 +00:00
questions:
2020-10-16 23:54:42 +00:00
- variable: password
default: ""
required: true
type: password
label: Admin Password
group: "Global Settings"
- variable: service.type
default: "ClusterIP"
type: enum
group: "Service Settings"
options:
- "ClusterIP"
- "NodePort"
- "LoadBalancer"
required: true
label: Service Type
show_subquestion_if: "NodePort"
subquestions:
- variable: service.nodePort
default: ""
description: "NodePort port number (to set explicitly, choose port between 30000-32767)"
type: int
min: 30000
max: 32767
label: Service NodePort
```
2022-12-02 08:05:41 +00:00
## Configuration File
Options for `upstream.yaml`
| Variable | Requires | Description |
| ------------- | ------------- |------------- |
| ArtifactHubPackage | ArtifactHubRepo | Defines the package to pull from the defined ArtifactHubRepo
| ArtifactHubRepo | ArtifactHubPackage | Defines the repo to access on Artifact Hub
| AutoInstall | | Allows setting a required additional chart to deploy prior to current chart, such as a dedicated CRDs chart
| ChartMetadata | | Allows setting/overriding the value of any valid [Chart.yaml variable](https://helm.sh/docs/topics/charts/#the-chartyaml-file)
| DisplayName | | Sets the name the chart will be listed under in the Rancher UI
| Experimental | | Adds the 'experimental' annotation which adds a flag on the UI entry
| Fetch | HelmChart, HelmRepo | Selects set of charts to pull from upstream.<br />- **latest** will pull only the latest chart version *default*<br />- **newer** will pull all newer versions than currently stored<br />- **all** will pull all versions
| GitBranch | GitRepo | Defines which branch to pull from the upstream GitRepo
| GitHubRelease | GitRepo | If true, will pull latest GitHub release from repo. Requires GitHub URL
| GitRepo | | Defines the git repo to pull from
| GitSubdirectory | GitRepo | Allows selection of a subdirectory of the upstream git repo to pull the chart from
| HelmChart | HelmRepo | Defines which chart to pull from the upstream Helm repo
| HelmRepo | HelmChart | Defines the upstream Helm repo to pull from
| Hidden | | Adds the 'hidden' annotation which hides the chart from the Rancher UI
| Namespace | | Addes the 'namespace' annotation which hard-codes a deployment namespace for the chart
| PackageVersion | | Used to generate new patch version of chart
| ReleaseName | | Sets the value of the release-name Rancher annotation. Defaults to the chart name
| TrackVersions | HelmChart, HelmRepo | Allows selection of multiple *Major.Minor* versions to track from upstream independently.
| Vendor | | Sets the vendor name providing the chart
## Examples
### Helm Repo
2022-12-02 10:20:12 +00:00
#### Minimal Requirements
```yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
```
#### Multiple Release Streams
2022-12-02 08:05:41 +00:00
```yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
Fetch: newer
TrackVersions:
- 0.4
- 1.0
- 1.1
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
```
2022-12-02 08:05:41 +00:00
### Artifact Hub
```yaml
2022-12-02 08:05:41 +00:00
ArtifactHubRepo: kubewarden
ArtifactHubPackage: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
```
2022-12-02 08:05:41 +00:00
### Git Repo
```yaml
GitRepo: https://github.com/kubewarden/helm-charts.git
GitBranch: main
GitSubdirectory: charts/kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
2020-06-30 18:08:43 +00:00
```
2022-12-02 08:05:41 +00:00
### GitHub Release
```yaml
GitRepo: https://github.com/kubewarden/helm-charts.git
GitHubRelease: true
GitSubdirectory: charts/kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
2020-10-16 23:54:42 +00:00
```
2023-01-12 22:59:26 +00:00
## Migrate existing chart to automated updates
These steps are for charts still using `package.yaml` to track upstream chart. These charts should be migrated to receive automatic updates via an `upstream.yaml` by following the steps below. After chart is migrated, it should get updated from your helm/github repo automatically.
2023-01-12 22:59:26 +00:00
#### 1. Fork partner-charts repository, clone your fork, checkout the main-source branch and pull the latest changes. Then create a new branch off of main-source
#### 2. Create directory structure for your company and chart in `packages/<vendor>/<chart>` e.g.
2023-01-12 23:36:06 +00:00
```bash
mkdir -p partner-charts/packages/suse/kubewarden-controller
```
#### 3. Create an `upstream.yaml` in `packages/<vendor>/<chart>`
If your existing chart is using a high patch version like 5.5.100 due to old method of taking version 5.5.1 and modifying it with the PackageVersion, add `PackageVersion` to the `upstream.yaml` (set it to 01 , 00 is not valid). Ideally, when the the next minor version is released e.g. 5.6.X you can then remove `PackageVersion` from the `upstream.yaml` since 5.6.X > 5.5.XXX. E.g.
2023-01-12 22:59:26 +00:00
```yaml
2023-01-12 23:04:32 +00:00
cat <<EOF > packages/suse/kubewarden-controller/upstream.yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
PackageVersion: 01 # add if existing chart is using high patch version
2023-01-12 23:04:32 +00:00
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
EOF
2023-01-12 22:59:26 +00:00
```
#### 4. If there is an `overlay` dir in `partner-charts/packages/<chart>/generated-changes/` move it to `packages/<vendor>/<chart>/` and ensure only necessary files are present in overlay dir e.g.
2023-01-12 23:36:06 +00:00
```bash
mv partner-charts/packages/kubewarden-controller/generated-changes/overlay partner-charts/packages/suse/kubewarden-controller/
```
Check the old generated-changes/patch directory for any requisite other changes. If there is an edit in `Chart.yaml.patch` that needs to be replicated, it can be handled in the `upstream.yaml` `ChartMetadata` (see https://github.com/rancher/partner-charts#configuration-file). If it is a change for any other file in the chart it can be done via an overlay file. See https://github.com/rancher/partner-charts#overlay
2023-01-12 22:59:26 +00:00
2023-01-24 23:51:57 +00:00
#### 5. Clean up old packages and charts directories:
2023-01-12 22:59:26 +00:00
```bash
git rm -r packages/<chart>
git rm -r charts/<chart>
2023-01-12 22:59:26 +00:00
```
* Note: If a chart is using a logo file in partner-charts repo, make sure the `icon:` variable is set correctly in the `upstream.yaml ChartMetadata`.
2023-01-24 23:51:57 +00:00
#### 6. Stage your changes (To make sure the config works, and to setup the new charts and assets directories)
2023-01-12 22:59:26 +00:00
```bash
export PACKAGE=<vendor>/<chart>
2023-01-12 22:59:26 +00:00
bin/partner-charts-ci stage
```
2023-01-24 23:51:57 +00:00
#### 7. Move the old assets files to the new directory (Sometimes this is unchanged but most times it does change)
2023-01-12 22:59:26 +00:00
```bash
git mv assets/<chart>/* assets/<vendor>/
2023-01-12 22:59:26 +00:00
```
2023-01-24 23:51:57 +00:00
#### 8. Update the `index.yaml` to reflect the new assets path for existing entries
2023-01-12 22:59:26 +00:00
```bash
sed -i 's%assets/<chart>%assets/<vendor>%' index.yaml
2023-01-12 22:59:26 +00:00
```
After doing this, run this loop to validate that every assets file referenced in the index actually exists, it makes sure your paths aren't edited incorrectly.
```bash
for charts in $(yq '.entries[][] | .urls[0]' index.yaml); do stat ${charts} > /dev/null; if [[ ! $? -eq 0 ]]; then echo ${charts}; fi; done
```
The command should return quickly with no output. If it outputs anything it means some referenced assets files don't exist which is a problem.
2023-01-24 23:51:57 +00:00
#### 9. Add/Commit your changes
2023-01-12 22:59:26 +00:00
```bash
git add assets charts packages index.yaml
git commit -m "Migrating <vendor> <chart> chart"
```
2023-01-24 23:51:57 +00:00
#### 10. Push your commit
2023-01-12 22:59:26 +00:00
```bash
git push origin <your branch>
```
2023-01-24 23:51:57 +00:00
#### 11. Open a pull request to the `main-source` branch for review