rancher-partner-charts/README.md

339 lines
15 KiB
Markdown
Raw Normal View History

2020-10-16 23:54:42 +00:00
# partner-charts
2020-06-30 18:08:43 +00:00
Rancher Partner Charts is a collection of Helm charts from SUSE partners that
are certified to run on Rancher-supported Kubernetes distributions. These charts
are served from this repository so that users can deploy these charts directly
from the Apps view in Rancher Manager.
2020-06-30 18:08:43 +00:00
Rancher-specific modifications are applied to these charts, and overlay files
may be added as well.
## SUSE Ready Partnership
2020-06-30 18:08:43 +00:00
Before submitting a contribution to this repository, you must be a
[SUSE "Ready" Verified partner](https://www.suse.com/product-certification/ready/certify-your-applications/).
2020-06-30 18:08:43 +00:00
Start this process with a [Partner Application](https://partner.suse.com/s/apply).
2020-06-30 18:08:43 +00:00
To certify your software, you need to attest that the software:
* has been tested on RKE2 or K3s and publishes documentation showing supported
versions, including
* version of Rancher (e.g. 2.8)
* Rancher-supported distribution of Kubernetes (RKE2, K3s, EKS, etc.)
* version of Kubernetes (e.g. 1.27)
* is supported by your organization on the declared Rancher versions and configurations
* is actively maintained and proactively updated
* Critical vulnerabilities are patched in a timely way
* release notes disclose serious bugs and vulnerabilities
* has a license and/or terms and conditions for use available in public
documentation or via the chart itself
* does not compete commercially with Rancher Prime
2020-06-30 18:08:43 +00:00
## Requirements
2020-06-30 18:08:43 +00:00
Once your software is certified SUSE "Ready", there are a few more requirements
for inclusion in Rancher Partner charts. The Helm chart must:
* be Helm 3 compatible
* be in a hosted [Helm](https://helm.sh/docs/topics/chart_repository/)
(recommended) or Git repository that we can reference
* have the following Rancher specific add-ons (More details on this below)
2021-06-25 19:05:01 +00:00
* kubeVersion set in the chart's metadata
2020-10-16 23:54:42 +00:00
* app-readme.md
* questions.yml (Optional)
* be deployable from the current version of Rancher with the default Values
Testing these requirements will ensure that Rancher users can deploy your
software correctly and easily.
2020-06-30 18:08:43 +00:00
### Removal
Charts will be removed from this repo if technical requirements are not met, if
a serious security problem arises, or if the vendor's SUSE "Ready" partnership
is no longer active. In these cases, the pull request that removes the chart
will indicate an alternative source (e.g. the corresponding upstream project or
[Rancher Prime Application Collection](https://apps.rancher.io)) if one is
available.
2020-10-16 23:54:42 +00:00
## Workflow
2020-06-30 18:08:43 +00:00
#### 1. Fork the [Rancher Partner Charts](https://github.com/rancher/partner-charts/) repository, clone your fork, checkout the **main-source** branch and pull the latest changes.
Then create a new branch off of main-source
2023-01-13 15:08:32 +00:00
#### 2. Create subdirectories in **packages** in the form of `<vendor>/<chart>`
2022-12-02 08:05:41 +00:00
```bash
cd partner-charts
mkdir -p packages/suse/kubewarden-controller
2020-06-30 18:08:43 +00:00
2022-12-02 08:05:41 +00:00
```
#### 3. Create your [upstream.yaml](#configuration-file) in `packages/<vendor>/<chart>`
The tool reads a configuration yaml, `upstream.yaml`, to know where to fetch the upstream chart. This file is also able to define any alterations for valid variables in the Chart.yaml as described by [Helm](https://helm.sh/docs/topics/charts/#the-chartyaml-file).
**Important:** In GKE clusters, a Helm Chart will NOT display in Rancher Apps unless `kubeVersion` includes `-0` suffix in `Chart.yaml` For example:
```bash
kubeVersion: '>= 1.19.0-0'
```
Some [example upstream.yaml](#examples) are provided below
```bash
2022-12-02 08:05:41 +00:00
cat <<EOF > packages/suse/kubewarden-controller/upstream.yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
2022-12-02 08:05:41 +00:00
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
EOF
2020-10-16 23:54:42 +00:00
```
2023-01-13 15:08:32 +00:00
#### 4. [Create 'overlay' files](#overlay)
Create any add-on files such as an `app-readme.md` and `questions.yml` in an `overlay` subdirectory (Optional)
2022-12-02 08:05:41 +00:00
```bash
mkdir packages/suse/kubewarden-controller/overlay
echo "Example app-readme.md" > packages/suse/kubewarden-controller/overlay/app-readme.md
```
2023-01-13 15:08:32 +00:00
#### 5. Commit your packages directory
2022-12-02 08:05:41 +00:00
```bash
git add packages/suse/kubewarden-controller
git commit -m "Submitting suse/kubewarden-controller"
```
2023-01-13 15:08:32 +00:00
#### 6. [Test your configuration](#testing-your-configuration)
#### 7. Push your commit
2022-12-02 08:05:41 +00:00
```bash
git push origin <your_branch>
2020-10-16 23:54:42 +00:00
```
2023-01-13 15:08:32 +00:00
#### 8. Open a pull request to **main-source** branch
2022-12-02 08:05:41 +00:00
## Testing your configuration
If you would like to test your configuration using the CI tool, simply run the provided script in `scripts/pull-scripts` to download the binary. The 'auto' function is what will be run to download and store your chart.
2021-07-27 19:55:10 +00:00
2022-12-02 08:16:19 +00:00
#### 1. Download the binary
2022-12-02 08:05:41 +00:00
```bash
scripts/pull-scripts
2022-12-02 08:05:41 +00:00
```
2022-12-02 08:16:19 +00:00
#### 2. Set the **PACKAGE** environment variable to your chart
2022-12-02 08:05:41 +00:00
You can confirm the package entry with `bin/partner-charts-ci list` which will list all detected charts with a configuration file.
```bash
export PACKAGE=<vendor>/<chart>
```
2022-12-02 08:16:19 +00:00
#### 3. Run the 'auto' or 'stage' function
2022-12-02 08:05:41 +00:00
The 'auto' subcommand will run the complete CI process.
The 'stage' subcommand will do the same process but will not create a git commit when it completes.
```bash
bin/partner-charts-ci auto
```
2022-12-02 08:16:19 +00:00
#### 4. Validate your changes
2022-12-02 08:05:41 +00:00
```bash
bin/partner-charts-ci validate
```
#### Testing new chart on Rancher Apps UI
1. If you haven't done so yet, pull down your new chart files into your local `partner-charts` repository:
```bash
a) Get scripts: scripts/pull-scripts
b) List and find your company name/chart: bin/partner-charts-ci list | grep <vendor>
c) set PACKAGE variable to your company/chart: export PACKAGE=<vendor>/<chart-name> or export PACKAGE=<vendor>
d) Run bin/partner-charts-ci stage or auto # the new charts should be downloaded
```
2023-01-30 21:38:35 +00:00
2. In your local `partner-charts` directory start a python3 http server:
```bash
#python3 -m http.server 8000
```
3. From a second terminal expose your local http server via ngrok ( https://ngrok.com/download )
```bash
#./ngrok http 8000
```
2023-01-30 22:00:58 +00:00
4. In Rancher UI create a test repository that points to your local `partner-charts` repo by selecting an appropriate cluster and going to Apps > Repositories and clicking "Create". Enter a Name, copy ngrok forwarding url and paste it into Target http(s) "Index URL" and click "Create" again.
2023-01-30 21:38:35 +00:00
5. Once the new repository is "Active" go to Apps > Charts , find your new chart, review Readme is correct, etc. and install it. It should be successfully deployed.
2021-07-27 19:55:10 +00:00
2022-12-02 08:05:41 +00:00
## Overlay
2021-07-27 19:55:10 +00:00
Any files placed in the `packages/<vendor>/<chart>/overlay` directory will be overlayed onto the chart. This allows for adding or overwriting files within the chart as needed. The primary intended purpose is for adding the optional app-readme.md and questions.yml files but it may be used for adding or replacing any chart files.
2020-10-16 23:54:42 +00:00
- `app-readme.md` - Write a brief description of the app and how to use it. It's recommended to keep
it short as the longer `README.md` in your chart will be displayed in the UI as detailed description.
- `questions.yml` - Defines a set of questions to display in the chart's installation page in order for users to
2021-06-25 19:05:01 +00:00
answer them and configure the chart using the UI instead of modifying the chart's values file directly.
2021-07-27 19:55:10 +00:00
#### Questions example
2022-12-02 08:05:41 +00:00
[Variable Reference](https://docs.ranchermanager.rancher.io/how-to-guides/new-user-guides/helm-charts-in-rancher/create-apps#question-variable-reference)
2020-10-16 23:54:42 +00:00
```yaml
2021-06-25 19:05:01 +00:00
questions:
2020-10-16 23:54:42 +00:00
- variable: password
default: ""
required: true
type: password
label: Admin Password
group: "Global Settings"
- variable: service.type
default: "ClusterIP"
type: enum
group: "Service Settings"
options:
- "ClusterIP"
- "NodePort"
- "LoadBalancer"
required: true
label: Service Type
show_subquestion_if: "NodePort"
subquestions:
- variable: service.nodePort
default: ""
description: "NodePort port number (to set explicitly, choose port between 30000-32767)"
type: int
min: 30000
max: 32767
label: Service NodePort
```
2022-12-02 08:05:41 +00:00
## Configuration File
Options for `upstream.yaml`
| Variable | Requires | Description |
| ------------- | ------------- |------------- |
| ArtifactHubPackage | ArtifactHubRepo | Defines the package to pull from the defined ArtifactHubRepo
| ArtifactHubRepo | ArtifactHubPackage | Defines the repo to access on Artifact Hub
| AutoInstall | | Allows setting a required additional chart to deploy prior to current chart, such as a dedicated CRDs chart
| ChartMetadata | | Allows setting/overriding the value of any valid [Chart.yaml variable](https://helm.sh/docs/topics/charts/#the-chartyaml-file)
| DisplayName | | Sets the name the chart will be listed under in the Rancher UI
| Experimental | | Adds the 'experimental' annotation which adds a flag on the UI entry
| Fetch | HelmChart, HelmRepo | Selects set of charts to pull from upstream.<br />- **latest** will pull only the latest chart version *default*<br />- **newer** will pull all newer versions than currently stored<br />- **all** will pull all versions
| GitBranch | GitRepo | Defines which branch to pull from the upstream GitRepo
| GitHubRelease | GitRepo | If true, will pull latest GitHub release from repo. Requires GitHub URL
| GitRepo | | Defines the git repo to pull from
| GitSubdirectory | GitRepo | Allows selection of a subdirectory of the upstream git repo to pull the chart from
| HelmChart | HelmRepo | Defines which chart to pull from the upstream Helm repo
| HelmRepo | HelmChart | Defines the upstream Helm repo to pull from
| Hidden | | Adds the 'hidden' annotation which hides the chart from the Rancher UI
| Namespace | | Addes the 'namespace' annotation which hard-codes a deployment namespace for the chart
| PackageVersion | | Used to generate new patch version of chart
| ReleaseName | | Sets the value of the release-name Rancher annotation. Defaults to the chart name
| TrackVersions | HelmChart, HelmRepo | Allows selection of multiple *Major.Minor* versions to track from upstream independently.
| Vendor | | Sets the vendor name providing the chart
## Examples
### Helm Repo
2022-12-02 10:20:12 +00:00
#### Minimal Requirements
```yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
```
#### Multiple Release Streams
2022-12-02 08:05:41 +00:00
```yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
Fetch: newer
TrackVersions:
- 0.4
- 1.0
- 1.1
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
```
2022-12-02 08:05:41 +00:00
### Artifact Hub
```yaml
2022-12-02 08:05:41 +00:00
ArtifactHubRepo: kubewarden
ArtifactHubPackage: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
```
2022-12-02 08:05:41 +00:00
### Git Repo
```yaml
GitRepo: https://github.com/kubewarden/helm-charts.git
GitBranch: main
GitSubdirectory: charts/kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
2020-06-30 18:08:43 +00:00
```
2022-12-02 08:05:41 +00:00
### GitHub Release
```yaml
GitRepo: https://github.com/kubewarden/helm-charts.git
GitHubRelease: true
GitSubdirectory: charts/kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
2020-10-16 23:54:42 +00:00
```
2023-01-12 22:59:26 +00:00
## Migrate existing chart to automated updates
These steps are for charts still using `package.yaml` to track upstream chart. These charts should be migrated to receive automatic updates via an `upstream.yaml` by following the steps below. After chart is migrated, it should get updated from your helm/github repo automatically.
2023-01-12 22:59:26 +00:00
#### 1. Fork partner-charts repository, clone your fork, checkout the main-source branch and pull the latest changes. Then create a new branch off of main-source
#### 2. Create directory structure for your company and chart in `packages/<vendor>/<chart>` e.g.
2023-01-12 23:36:06 +00:00
```bash
mkdir -p partner-charts/packages/suse/kubewarden-controller
```
#### 3. Create an `upstream.yaml` in `packages/<vendor>/<chart>`
If your existing chart is using a high patch version like 5.5.100 due to old method of taking version 5.5.1 and modifying it with the PackageVersion, add `PackageVersion` to the `upstream.yaml` (set it to 01 , 00 is not valid). Ideally, when the the next minor version is released e.g. 5.6.X you can then remove `PackageVersion` from the `upstream.yaml` since 5.6.X > 5.5.XXX. E.g.
2023-01-12 22:59:26 +00:00
```yaml
2023-01-12 23:04:32 +00:00
cat <<EOF > packages/suse/kubewarden-controller/upstream.yaml
HelmRepo: https://charts.kubewarden.io
HelmChart: kubewarden-controller
Vendor: SUSE
DisplayName: Kubewarden Controller
PackageVersion: 01 # add if existing chart is using high patch version
2023-01-12 23:04:32 +00:00
ChartMetadata:
kubeVersion: '>=1.21-0'
icon: https://www.kubewarden.io/images/icon-kubewarden.svg
EOF
2023-01-12 22:59:26 +00:00
```
#### 4. If there is an `overlay` dir in `partner-charts/packages/<chart>/generated-changes/` move it to `packages/<vendor>/<chart>/` and ensure only necessary files are present in overlay dir e.g.
2023-01-12 23:36:06 +00:00
```bash
mv partner-charts/packages/kubewarden-controller/generated-changes/overlay partner-charts/packages/suse/kubewarden-controller/
```
Check the old generated-changes/patch directory for any requisite other changes. If there is an edit in `Chart.yaml.patch` that needs to be replicated, it can be handled in the `upstream.yaml` `ChartMetadata` (see https://github.com/rancher/partner-charts#configuration-file). If it is a change for any other file in the chart it can be done via an overlay file. See https://github.com/rancher/partner-charts#overlay
2023-01-12 22:59:26 +00:00
2023-01-24 23:51:57 +00:00
#### 5. Clean up old packages and charts directories:
2023-01-12 22:59:26 +00:00
```bash
git rm -r packages/<chart>
git rm -r charts/<chart>
2023-01-12 22:59:26 +00:00
```
* Note: If a chart is using a logo file in partner-charts repo, make sure the `icon:` variable is set correctly in the `upstream.yaml ChartMetadata`.
2023-01-24 23:51:57 +00:00
#### 6. Stage your changes (To make sure the config works, and to setup the new charts and assets directories)
2023-01-12 22:59:26 +00:00
```bash
export PACKAGE=<vendor>/<chart>
2023-01-12 22:59:26 +00:00
bin/partner-charts-ci stage
```
2023-01-24 23:51:57 +00:00
#### 7. Move the old assets files to the new directory (Sometimes this is unchanged but most times it does change)
2023-01-12 22:59:26 +00:00
```bash
git mv assets/<chart>/* assets/<vendor>/
2023-01-12 22:59:26 +00:00
```
2023-01-24 23:51:57 +00:00
#### 8. Update the `index.yaml` to reflect the new assets path for existing entries
2023-01-12 22:59:26 +00:00
```bash
sed -i 's%assets/<chart>%assets/<vendor>%' index.yaml
2023-01-12 22:59:26 +00:00
```
After doing this, run this loop to validate that every assets file referenced in the index actually exists, it makes sure your paths aren't edited incorrectly.
```bash
for charts in $(yq '.entries[][] | .urls[0]' index.yaml); do stat ${charts} > /dev/null; if [[ ! $? -eq 0 ]]; then echo ${charts}; fi; done
```
The command should return quickly with no output. If it outputs anything it means some referenced assets files don't exist which is a problem.
2023-01-24 23:51:57 +00:00
#### 9. Add/Commit your changes
2023-01-12 22:59:26 +00:00
```bash
git add assets charts packages index.yaml
git commit -m "Migrating <vendor> <chart> chart"
```
2023-01-24 23:51:57 +00:00
#### 10. Push your commit
2023-01-12 22:59:26 +00:00
```bash
git push origin <your branch>
```
#### 11. Open a pull request to the `main-source` branch for review